nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-17 10:12:08 +00:00

100 lines
1.1 KiB
Text

01h4x.com
Aboundexbot
Acunetix
AdsTxtCrawlerTP
AhrefsBot
Aipbot
Anarchie
BackWeb
Barkrowler
Buddy
Bullseye
CATExplorador
Cegbfeieh
ChatGPT-User
Chlooe
Cloud mapping
Collector
Copyscape
CrazyWebCrawler
Crescent
CrunchBot
DigitalPebble
Discoverybot
DittoSpyder
DomCopBot
EMail Siphon
ExtLinksBot
ExtractorPro
Ezooms
Firefox/7.0
FlashGet
Foobot
Go-Ahead-Got-It
GridBot
HEADMasterSEO
Haansoft
IRLbot
ImagesiftBot
Indy Library
InfoTekies
Jorgee
Libwhisker
Linkbot
MIDown tool
Mata Hari
MolokaiBot
Mozlila
Mr.4x3
Musobot
NetSpider
NetZIP
Offline Explorer
Openfind
PageThing.com
Pandalytics
Panscient
Pi-Monster
PleaseCrawl
ProPowerBot
Probethenet
Psbot
Pump
PyCurl
Re-re
SEOkicks
SISTRIX
SalesIntelligent
SemrushBot-OCOB
SiteExplorer
SocialRankIOBot
Spinn3r
SputnikBot
SurveyBot
T8Abot
TeleportPro
Toata
True_Robot
Turnitin
TwengaBot
Voltron
WebZIP
WebmasterWorldForumBot
Website Quester
Webster
WinHTTrack
Wonderbot
Wprecon
Zeus
archive.org_bot
cah.io.community
crawler4j
dataforseobot
demandbase-bot
domainsproject.org
ips-agent
linkdexbot
omgili
seocompany.store
sitechecker.pro
xpymep1.exe