nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-24 22:04:53 +00:00

100 lines
1 KiB
Text

404checker
404enemy
ALittle Client
Alexibot
Alligator
AwarioRssBot
Barkrowler
BetaBot
Buddy
BuzzSumo
CATExplorador
CSHttp
CazoodleBot
ChatGPT-User
Cloud mapping
CrunchBot
Dispatch
Dotbot
ExtractorPro
Flunky
GalaxyBot
GetRight
Go!Zilla
Gotit
GridBot
HEADMasterSEO
HonoluluBot
IlseBot
Joomla
Kozmosbot
LexiBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Ltx71
MarkMonitor
Mata Hari
MicroMessenger
Mr.4x3
Musobot
Navroad
Needle
Netcraft
Nibbler
Nikto
Offline Navigator
OutclicksBot
PECL::HTTP
Pavuk
Piepmatz
Pump
PxBroker
PyCurl
RankFlex
ReGet
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
SMTBot
Scanbot
ScoutJet
Scrapy
ScrepyBot
Semrush
Shodan
Site Sucker
Sitebeam
Sosospider
SpankBot
Steeler
Sucker
T0PHackTeam
Telesoft
TightTwatBot
TinyTestBot
Toweyabot
WISENutbot
WWW-Collector-E
WeSEE
Web Enhancer
WebPix
Website Quester
Woobot
Zermelo
com.plumanalytics
crawler4j
domainsproject.org
isitwp.com
meanpathbot
netEstate NE Crawler
probe-image-size
scalaj-http
seobility
seocompany.store
webgains-bot
webmeup-crawler