nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-01-20 10:11:46 +00:00

100 lines
1 KiB
Text

80legs
Aboundexbot
Alexibot
Anarchie
Atomseobot
AwarioSmartBot
BBBike
BatchFTP
Black Hole
BlackWidow
Bolt
Craftbot
Crescent
Custo
DIIbot
DTS Agent
Demon
Dispatch
DittoSpyder
DomCopBot
DomainCrawler
Freeuploader
Harvest
Havij
HybridBot
IDBot
IRLbot
InfoNaviRobot
InfraSec Scanner
InternetMeasurement
Iria
JamesBOT
Jbrofuzz
JennyBot
Jetty
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Leap
Linkbot
Lipperhey Spider
Ltx71
MQQBrowser
MSIECrawler
Mb2345Browser
MeanPath Bot
NICErsPRO
NearSite
NetAnts
Nmap
Offline Navigator
Papa Foto
ProWebWalker
Pu_iN
PxBroker
ReGet
RedesScrapy
SEOstats
SalesIntelligent
Screaming
Semrush
SemrushBot
SemrushBot-SI
SeoSiteCheckup
SiteExplorer
SputnikBot
Thumbor
Trendiction
VelenPublicWebCrawler
Virusdie
Voil
WPScan
Web Pix
Web Sauger
WebAuto
WebBandit
WebImageCollector
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whack
YoudaoBot
Zitebot
ZoomBot
ZumBot
arquivo.pt
crawl.sogou.com
demandbase-bot
internetVista monitor
linkfluence
openai
page scorer
pcBrowser
seostar
spyfu
tAkeOut
webmeup-crawler
webpros.com