nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-21 22:05:02 +00:00

100 lines
1.1 KiB
Text

404checker
ADmantX
ALittle Client
AiHitBot
Alligator
Barkrowler
Buck
BuiltBotTough
CSHttp
Cocolyzebot
CopyRightCheck
Crescent
Devil
Disco
Domains Project
Dragonfly
EMail Wolf
Ebingbong
EroCrawler
Exabot
Flunky
FyberSpider
GrabNet
HEADMasterSEO
HMView
Harvest
Iblog
Indy Library
InfoTekies
Kenjin Spider
Keyword Density
Lftp
Linkbot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
Mail.RU_Bot
MauiBot
Microsoft URL Control
Mojeek
Mojolicious
Net Vampire
NetLyzer
Nimbostratus
Openvas
PageScorer
Pandalytics
Panscient
Picscout
PictureFinder
Pixray
PxBroker
PyCurl
RankActive
RankingBot
Ripper
SEOlyticsCrawler
SMTBot
ScrepyBot
SemrushBot
SeobilityBot
Shodan
Site Sucker
Siteimprove
SpaceBison
Spinn3r
SuperBot
SurveyBot
Telesphoreo
Titan
UnisterBot
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WWW::Mechanize
WebGo IS
WebReaper
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Widow
YoudaoBot
ZmEu
ZumBot
check1.exe
coccocbot
dataforseo.com
domainsproject.org
ips-agent
netEstate NE Crawler
plumanalytics
polaris version
scan.lol
serpstatbot
trendiction.com
ubermetrics-technologies.com
webgains-bot