nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-12 10:07:15 +00:00

100 lines
1.1 KiB
Text

404enemy
Abonti
Aboundexbot
Ankit
Apexoo
Attach
BBBike
BackDoorBot
Bigfoot
Black Hole
Buddy
CCBot
CSHttp
CazoodleBot
ClaudeBot
Cogentbot
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
DBLBot
Devil
DomainAppender
Download Wonder
ECCP/1.0
Fimap
Freeuploader
G-i-g-a-b-o-t
GT::WWW
Genieo
GridBot
HTMLparser
HTTrack
Haansoft
Id-search
Indy Library
InfoTekies
InfraSec Scanner
Kozmosbot
LNSpiderguy
LibWeb
Lightspeedsystems
Linkbot
LinkextractorPro
Litemage_walker
MQQBrowser
MeanPath Bot
Meanpathbot
MicroMessenger
Navroad
NetLyzer
Nikto
Offline Navigator
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
PageScorer
Petalbot
PyCurl
RankActive
ReGet
RealDownload
RebelMouse
Recorder
RepoMonkey
SEOkicks
Searchestate
SenutoBot
SiteLockSpider
Siteimprove
Sogou web spider
Spider_Bot/3.0
Toweyabot
Trendiction
Turnitin
Vacuum
VeriCiteCrawler
WEBDAV
WWW-Mechanize
WWW::Mechanize
WebFetch
WebGo IS
WebImageCollector
WebWhacker
Webster
WiseGuys Robot
Wprecon
Zeus
arquivo-web-crawler
arquivo.pt
dataforseobot
linkdexbot
magpie-crawler
mediawords
scalaj-http
seocompany.store
sexsearcher
zauba.io