nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-09 10:06:50 +00:00

100 lines
1 KiB
Text

AdsTxtCrawlerTP
AlphaBot
Anarchy
Anthill
Aspiegel
BBBike
Badass
BatchFTP
Black Hole
Boardreader
Brandprotect
Calculon
CensysInspect
Claritybot
Crescent
DTS Agent
Devil
Dirbuster
Disco
DomainCrawler
Exabot
ExtLinksBot
FHscan
Firefox/7.0
GPTBot
GT::WWW
Grafula
Haansoft
IRLbot
IlseBot
IndeedBot
Indy Library
Internet Ninja
Iria
Jetty
Larbin
LeechGet
LinkpadBot
Lipperhey
MIDown tool
MSIECrawler
Majestic SEO
MarkWatch
Mata Hari
Mb2345Browser
NPbot
Navroad
NetAnts
NetLyzer
Nettrack
Nimbostratus
Offline Navigator
OpenLinkProfiler
OutfoxBot
PHPCrawl
PageScorer
Panscient
Pavuk
Pimonster
Pixray
RankActive
RankActiveLinkBot
RankurBot
RocketCrawler
SalesIntelligent
ScanAlert
Scrapy
Seomoz
SiteSnagger
Siteimprove
Sottopop
SpaceBison
Spbot
Sqlmap
SuperBot
T0PHackTeam
Telesphorep
Trendictionbot
TurnitinBot
URLy Warning
VB Project
Voltron
Web Fuck
WebBandit
WebFetch
WebGo IS
Woobot
Zeus
Zitebot
cognitiveseo
crawler.feedback
ips-agent
muhstik-scan
pcBrowser
plumanalytics
siteripz
trendiction.com
webgains-bot
webmeup-crawler
zauba.io