nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-08 22:04:48 +00:00

100 lines
1 KiB
Text

ADmantX
AIBOT
Abonti
Aboundex
AllSubmitter
Aspiegel
Bandit
Bigfoot
Black Hole
Buck
Bullseye
BunnySlippers
Cegbfeieh
ChatGPT-User
Collector
CopyRightCheck
Craftbot
Crawling at Home Project
Crescent
Demon
DigitalPebble
DomainCrawler
DomainSigmaCrawler
Domains Project
Dragonfly
Ebingbong
EirGrabber
Evil
Exabot
Ezooms
Foobot
Fyrebot
Go!Zilla
GrapeFX
HTMLparser
HTTrack
Haansoft
Heritrix
Hloader
InterGET
JikeSpider
Jorgee
Leap
LeechFTP
LieBaoFast
Lightspeedsystems
Ltx71
MeanPath Bot
Moblie Safari
NPbot
NearSite
Net Vampire
NetLyzer
NextGenSearchBot
Nmap
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Petalbot
PleaseCrawl
ProWebWalker
Psbot
PyCurl
Ripper
SalesIntelligent
ScoutJet
Scrapy
SiteLockSpider
Sosospider
Stripper
SuperHTTP
Surfbot
T8Abot
TeleportPro
TwengaBot
UnisterBot
WASALive-Bot
WBSearchBot
WEBDAV
WWW-Collector-E
WebGo IS
WebPix
Webalta
Website Quester
Widow
Xaldon_WebSpider
Zauba
ZoominfoBot
ZyBorg
archive.org_bot
demandbase-bot
evc-batch
linkdexbot
magpie-crawler
meanpathbot
page scorer
seocompany.store
voyagerx.com
zauba.io