nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-15 13:53:11 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
ALittle Client
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alligator
Anthill
Aspiegel
Attach
BDCbot
Backlink-Ceck
Badass
BlowFish
BotALot
Buck
BuiltBotTough
BuiltWith
CODE87
CSHttp
Calculon
CazoodleBot
CensysInspect
CheTeam
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Craftbot
Crescent
Curious
Digincore
DigitalPebble
DomCopBot
DomainStatsBot
Domains Project
Ecxi
EroCrawler
ExtLinksBot
Extractor
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Fimap
Flunky
Fuzz
FyberSpider
G-i-g-a-b-o-t
GermCrawler
GetRight
GetWeb
Getintent
GrabNet
HMView
HTMLparser
HTTrack
Haansoft
HaosouSpider
Heritrix
Hloader
HybridBot
Iblog
Id-search
IlseBot
Indy Library
InfoNaviRobot
InfoTekies
IstellaBot
JamesBOT
JennyBot
JetCar
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Lanshanbot
Leap
LexiBot
Lftp
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
MJ12bot
MQQBrowser
MTRobot
Mag-Net
Majestic SEO
MarkWatch
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Mojolicious
Mozlila
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
Needle
Nessus
NetAnts
NetLyzer
Nettrack
NextGenSearchBot
Nikto
Nimbostratus
Nmap
Not
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
Page Analyzer
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picscout
PictureFinder
Pixray
PleaseCrawl
Pockey
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankFlex
RankurBot
RedesScrapy
SBIder
SEOkicks
SISTRIX
ScanAlert
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
Searchestate
Semrush
SentiBot
Seomoz
SiteSucker
SlySearch
SmartDownload
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spammen
Spanner
Spinn3r
Sqlmap
Steeler
SuperBot
SuperHTTP
Szukacz
T8Abot
Telesoft
Telesphoreo
Telesphorep
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
Twice
URLy Warning
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
WebAuto
WebCollage
WebFuck
WebPix
WebSucker
WebWhacker
Webalta
WebsiteQuester
Whacker
Who.is Bot
Widow
Wonderbot
Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
ZoominfoBot
ZumBot
ZyBorg
adscanner
arquivo.pt
autoemailspider
backlink-check
clark-crawler
com.plumanalytics
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
instabid
lwp-request
meanpathbot
muhstik-scan
page scorer
satoristudio.net
seobility
seocompany.store
seostar
sitechecker.pro
siteripz
sogouspider
trendiction.com
trendiction.de
webmeup-crawler
webpros.com
webprosbot
zauba.io
zgrab