nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-20 22:04:48 +00:00

100 lines
1.1 KiB
Text

Aipbot
Anarchy
Anarchy99
Aspiegel
BackDoorBot
BackStreet
BacklinkCrawler
BetaBot
Bigfoot
Blackboard
Boardreader
Brandwatch
CATExplorador
Calculon
CazoodleBot
Chlooe
Disco
Domains Project
ECCP/1.0
Ebingbong
EirGrabber
Evil
Flunky
GermCrawler
Getintent
Gotit
GrabNet
HTTrack
IRLbot
Id-search
IlseBot
InternetSeer
JOC Web Spider
JamesBOT
Jetty
Keybot Translation-Search-Machine
LeechGet
Lftp
LinkWalker
LinqiaMetadataDownloaderBot
Litemage_walker
Ltx71
MIIxpc
MJ12bot
Magnet
Mata Hari
Mb2345Browser
MegaIndex.ru
Minefield
Mozlila
Nessus
NetMechanic
Niki-bot
Openvas
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pavuk
Picscout
Pockey
ProWebWalker
Pu_iN
RSSingBot
RebelMouse
Ripper
SBIder
SentiBot
SeobilityBot
SmartDownload
Snake
Sogou web spider
Sqlworm
Stripper
T0PHackTeam
TinyTestBot
TwengaBot
UnisterBot
Virusdie
Web Sauger
WebLeacher
WebReaper
WebSauger
WebStripper
Website Quester
WebsiteExtractor
WiseGuys Robot
Wonderbot
Wprecon
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
crawl.sogou.com
dataforseobot
magpie-crawler
mediawords
netEstate NE Crawler