nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-11 10:12:41 +00:00

100 lines
1 KiB
Text

80legs
ALittle Client
AdsTxtCrawlerTP
Anarchy
Atomseobot
AwarioRssBot
BBBike
BDCbot
BackStreet
Blow
Brandwatch
Buck
Bullseye
BuzzSumo
Calculon
Claritybot
Cliqzbot
CopyRightCheck
Cosmos
Custo
DTS Agent
DatabaseDriverMysqli
DnBCrawler-Analytics
Dotbot
EMail Siphon
Extractor
FHscan
FacebookBot
Firefox/7.0
GetWeb
GrabNet
HTTP::Lite
Hloader
HonoluluBot
Humanlinks
IDBTE4M
InternetMeasurement
JustView
Leap
LeechGet
LexiBot
LibWeb
Likse
MTRobot
Mag-Net
Mata Hari
MauiBot
Meanpathbot
NearSite
NetSpider
Niki-bot
Nikto
Nimbostratus
OnCrawl
Openvas
OrangeSpider
Pandalytics
PeoplePal
Probethenet
RankFlex
Re-re
RocketCrawler
SEOkicks
SEOstats
Screaming
ScreenerBot
Seekport
SemrushBot
SeoSiteCheckup
Shodan
Sociscraper
Spanner
SputnikBot
Sqlmap
Sqlworm
Sqworm
Tracemyfile
URLy.Warning
VCI
VoidEYE
WISENutbot
WWW-Mechanize
WWWOFFLE
WebImageCollector
WebReaper
WebSucker
WinHTTrack
anthropic-ai
arquivo.pt
backlink-check
cohere-ai
crawler.feedback
dataforseobot
domainsproject.org
gopher
satoristudio.net
sitechecker.pro
webmeup-crawler
x09Mozilla
x22Mozilla