nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-27 10:06:51 +00:00

100 lines
1.1 KiB
Text

ALittle Client
Abonti
Aboundex
Backlink-Ceck
BacklinkCrawler
BatchFTP
Black Hole
Blackboard
Bytespider
Cegbfeieh
CensysInspect
Cliqzbot
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Digincore
DigitalPebble
DittoSpyder
DomainStatsBot
EroCrawler
Express WebPictures
FemtosearchBot
Freeuploader
G-i-g-a-b-o-t
GPTBot
Google-Extended
HTTP::Lite
HybridBot
IDBot
IRLbot
IstellaBot
Jetty
JikeSpider
LeechFTP
Lftp
Lightspeedsystems
Likse
MIDown tool
MIIxpc
MolokaiBot
NPbot
Name Intelligence
NetSpider
OutfoxBot
PageScorer
PeoplePal
Pi-Monster
PictureFinder
Pockey
PyCurl
RankurBot
RealDownload
Reaper
Rogerbot
SEOlyticsCrawler
Semrush
SeoSiteCheckup
Snoopy
Sociscraper
Sogou web spider
SpankBot
Spinn3r
Sqlmap
The Intraformant
Turingos
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VelenPublicWebCrawler
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Collage
WebFetch
WebReaper
WebSauger
WebZIP
Whack
Woobot
Xaldon WebSpider
YoudaoBot
backlink-check
cohere-ai
domainsproject.org
eCatch
heritrix
instabid
meanpathbot
oBot
openai.com
page scorer
plumanalytics
seoscanners
serpstatbot
siteripz
ubermetrics-technologies.com