nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-28 22:04:46 +00:00

100 lines
1.1 KiB
Text

404enemy
ADmantX
Aboundex
Aipbot
Anarchy
Anarchy99
BackDoorBot
BackWeb
Battleztar Bazinga
Bigfoot
Black Hole
Boardreader
Buddy
Bytespider
CSHttp
Chlooe
Cliqzbot
Cocolyzebot
Cogentbot
Crawling at Home Project
Custo
Demon
Digincore
Dirbuster
DomainStatsBot
Download Wonder
Google-Extended
GridBot
HaosouSpider
Harvest
Havij
IRLbot
Image Sucker
InternetMeasurement
Lanshanbot
LeechFTP
Lightspeedsystems
LinkScan
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
Lmspider
MIDown tool
Mail.RU_Bot
Majestic-SEO
Mass Downloader
Mata Hari
MicroMessenger
Moblie Safari
Mojeek
OpenLinkProfiler
Openvas
OrangeSpider
PECL::HTTP
PageAnalyzer
Pixray
RSSingBot
RocketCrawler
SBIder
SEOstats
SearchmetricsBot
Seekport
Sogou web spider
Sosospider
SpankBot
SuperHTTP
TeleportPro
Toweyabot
Trendiction
Turnitin
Voil
Voltron
WASALive-Bot
WEBDAV
WWW-Mechanize
WWWOFFLE
WebGo IS
WebImageCollector
WebWhacker
WebZIP
Website Quester
WebsiteQuester
Woobot
Xaldon WebSpider
Zitebot
ZoomBot
ZumBot
anthropic-ai
arquivo.pt
domainsproject.org
gopher
instabid
ips-agent
linkdexbot
magpie-crawler
oBot
openai.com
sysscan
x09Mozilla
zauba.io