nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-15 10:07:09 +00:00

100 lines
1 KiB
Text

404enemy
AdsTxtCrawlerTP
Aipbot
AllSubmitter
Alligator
Anarchy99
Anthill
Aspiegel
AwarioSmartBot
BDCbot
BDFetch
BlackWidow
Brandwatch
Buck
BuzzSumo
CheTeam
CherryPicker
Claritybot
CopyRightCheck
Devil
Discobot
Dispatch
DnyzBot
DomainCrawler
EasyDL
Evil
FyberSpider
Fyrebot
GT::WWW
GermCrawler
GetRight
GridBot
Heritrix
Hloader
IRLbot
JennyBot
JikeSpider
JustView
LNSpiderguy
MFC_Tear_Sample
MIIxpc
MQQBrowser
Mag-Net
Majestic12
MegaIndex.ru
Mojolicious
Mozlila
NICErsPRO
NPbot
NetLyzer
Niki-bot
Nimbostratus
Offline Explorer
OpenLinkProfiler
OrangeBot
OutclicksBot
Petalbot
Picscout
ProWebWalker
PxBroker
RSSingBot
Rankivabot
Recorder
Rogerbot
SEOkicks-Robot
SMTBot
ScanAlert
Scrapy
Screaming
ScrepyBot
Seekport
SentiBot
SiteLockSpider
SmartDownload
Stripper
T8Abot
Toata
URLy Warning
V-BOT
WASALive-Bot
WISENutbot
Web Enhancer
Web Pix
WebWhacker
WebZIP
WebsiteQuester
Wonderbot
Zeus
ZumBot
cah.io.community
dataforseo.com
dataforseobot
demandbase-bot
domainsproject.org
netEstate NE Crawler
page scorer
seocompany.store
sitechecker.pro
xpymep1.exe
zgrab