nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-11-07 10:07:27 +00:00

100 lines
1.1 KiB
Text

360Spider
404checker
404enemy
ADmantX
AfD-Verbotsverfahren
Aspiegel
BDCbot
BetaBot
Bitacle
Brandprotect
CATExplorador
CensysInspect
Chlooe
Collector
DBLBot
DTS Agent
DataCha0s
Demon
Digincore
DnyzBot
DomainSigmaCrawler
Domains Project
Express WebPictures
FHscan
Foobot
Freeuploader
FrontPage
FyberSpider
Getintent
Gotit
GridBot
Heritrix
Hloader
Iblog
Id-search
Image Fetch
Iskanie
JamesBOT
Jorgee
LeechFTP
LeechGet
LibWeb
Lightspeedsystems
Litemage_walker
MIDown tool
MIIxpc
Mag-Net
Majestic SEO
Masscan
Mata Hari
Morfeus Fucking Scanner
Mr.4x3
NearSite
Needle
Net Vampire
OnCrawl
OrangeSpider
Picsearch
Probethenet
RankurBot
RepoMonkey
SalesIntelligent
Scrapy
Seekport
Seomoz
Site Sucker
SiteExplorer
SlySearch
Spanner
Sqlmap
SuperBot
Swiftbot
T8Abot
URLy Warning
V-BOT
VB Project
Vagabondo
VoidEYE
WallpapersHD
Web Auto
Web Sauger
WebAuto
WebLeacher
WiseGuys Robot
Woobot
Wotbox
YoudaoBot
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
crawl.sogou.com
domainsproject.org
magpie-crawler
mediawords
netEstate NE Crawler
pcBrowser
webgains-bot
webmeup-crawler
x09Mozilla