nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-13 10:07:26 +00:00

100 lines
1.1 KiB
Text

360Spider
404checker
Asterias
BackDoorBot
BatchFTP
BlowFish
Bolt
Brandprotect
BunnySlippers
Bytespider
Calculon
Chlooe
ClaudeBot
Cloud mapping
Collector
Crescent
Devil
EasyDL
FDM
FacebookBot
Firefox/7.0
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetWeb
Gigabot
Humanlinks
InfoTekies
InterGET
JOC Web Spider
Jbrofuzz
Leap
LexiBot
LibWeb
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
MJ12bot
MarkWatch
Mb2345Browser
Metauri
Microsoft Data Access
Mister PiX
NPbot
NearSite
NetLyzer
NimbleCrawler
Offline Explorer
OpenLinkProfiler
Openfind
OrangeBot
PeoplePal
PictureFinder
Piepmatz
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
ReGet
ScreenerBot
Searchestate
Seekport
SiteSnagger
SiteSucker
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Sqlworm
Surfbot
Teleport
Telesphoreo
Vagabondo
VeriCiteCrawler
VidibleScraper
WeSEE
WebBandit
WebCopier
WebSucker
Webshag
WebsiteExtractor
WinHTTrack
Wotbox
Zeus
anthropic-ai
arquivo-web-crawler
coccocbot
cognitiveseo
crawler.feedback
everyfeed-spider
imagesift.com
instabid
ips-agent
meanpathbot
muhstik-scan
scan.lol
seoscanners
trendiction.com
trendiction.de