nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-02 10:06:47 +00:00

100 lines
1 KiB
Text

01h4x.com
Aboundexbot
Acunetix
AdsTxtCrawlerTP
Aipbot
Anarchie
BackWeb
Barkrowler
BetaBot
BlackWidow
BotALot
Brandprotect
Brandwatch
Buck
Cegbfeieh
CheeseBot
Crawling at Home Project
Discoverybot
Dispatch
DomainCrawler
Domains Project
EMail Wolf
EirGrabber
Exabot
Express WebPictures
Extractor
Ezooms
FlashGet
Flunky
Go!Zilla
GoZilla
GrapeshotCrawler
HTTP::Lite
HonoluluBot
IndeedBot
InfoTekies
InterGET
JikeSpider
LeechFTP
LinkScan
MIDown tool
Masscan
MeanPath Bot
Mister PiX
Nameprotect
Nessus
Net Vampire
NetLyzer
NetSpider
Offline Explorer
OpenVAS
PageAnalyzer
PageThing.com
Pandalytics
PeoplePal
Pi-Monster
Piepmatz
Pixray
Pu_iN
ScoutJet
SeekportBot
Semrush
Shodan
Snoopy
Sqlmap
Toweyabot
Trendiction
Trendictionbot
Turnitin
Twice
VB Project
VCI
Vacuum
Vagabondo
VeriCiteCrawler
WWW-Collector-E
WebFuck
Webshag
WebsiteQuester
Woobot
Xaldon_WebSpider
YoudaoBot
Zermelo
Zeus
ZyBorg
autoemailspider
axios
backlink-check
coccocbot
dataforseobot
omgili
openai
openai.com
s1z.ru
seostar
sp_auditbot
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
zgrab