nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-01-04 10:07:08 +00:00

100 lines
1 KiB
Text

AhrefsBot
Aipbot
AllSubmitter
Anarchie
Anarchy
BackWeb
BacklinksExtendedBot
BetaBot
Bigfoot
Boardreader
BotALot
Brandwatch
CODE87
Chlooe
Cloud mapping
Cogentbot
Collector
Copier
CrunchBot
Custo
DSearch
DigitalPebble
Disco
Dispatch
ExtLinksBot
Extractor
Fimap
FlashGet
Go-Ahead-Got-It
GoZilla
Heritrix
Humanlinks
Intelliseek
Iria
Jbrofuzz
Jorgee
JustView
Leap
LeechGet
LexiBot
Meanpathbot
Musobot
Nameprotect
Net Vampire
Nettrack
Nibbler
Nimbostratus
Nmap
Nuclei
PageThing.com
Picscout
ProPowerBot
Psbot
Quick-Crawler
RSSingBot
RankingBot
Reaper
RocketCrawler
SEOlyt
SEOlyticsCrawler
SEOstats
ScanAlert
Searchestate
SearchmetricsBot
SiteLockSpider
SiteSucker
Snake
SpankBot
Titan
Toata
True_Robot
Turnitin
VCI
VeriCiteCrawler
VoidEYE
Voil
WWW-Collector-E
WebGo IS
WebImageCollector
WebZIP
WebmasterWorldForumBot
Widow
Woobot
Zauba
Zitebot
ZmEu
anthropic-ai
archive.org_bot
arquivo.pt
autoemailspider
crawl.sogou.com
everyfeed-spider
gopher
ips-agent
polaris version
sexsearcher
sysscan
webmeup-crawler
x09Mozilla
xpymep1.exe