nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-25 22:04:59 +00:00

100 lines
1.1 KiB
Text

01h4x.com
ASPSeek
Alexibot
AwarioRssBot
BacklinkCrawler
Barkrowler
BuiltWith
BunnySlippers
BuzzSumo
Bytespider
CSHttp
Chlooe
Claritybot
Copier
CrunchBot
CyotekWebCopy
DataCha0s
Devil
DnyzBot
DomainStatsBot
Ecxi
Express WebPictures
Genieo
Getintent
Go!Zilla
GoZilla
Grafula
GridBot
HMView
HTTP::Lite
HTTrack
Haansoft
Havij
Hloader
IDBTE4M
InfoNaviRobot
InternetSeer
IstellaBot
JamesBOT
JikeSpider
Jyxobot
Kinza
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
MSIECrawler
Meanpathbot
Metauri
Minefield
Mister PiX
Mozlila
Mr.4x3
Nettrack
Nutch
Offline Explorer
OpenLinkProfiler
OpenVAS
Openvas
OutfoxBot
Pavuk
ProPowerBot
ProWebWalker
Proximic
RankFlex
RealDownload
RepoMonkey
SEOprofiler
SISTRIX
ScanAlert
Seekport
SeobilityBot
Snoopy
Sogou web spider
Spbot
SurveyBot
TinyTestBot
Twice
Virusdie
WPScan
WWW-Collector-E
Wallpapers
WeSEE
Web Auto
WebImageCollector
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
ZmEu
ZoomBot
clark-crawler
crawler4j
domainsproject.org
iubenda-radar
lwp-request
netEstate NE Crawler
plumanalytics
probe-image-size
scan.lol
sysscan
trendiction.com