nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-19 10:07:00 +00:00

100 lines
1 KiB
Text

360Spider
AhrefsBot
Ankit
Anthill
AwarioSmartBot
Battleztar Bazinga
Blackboard
BuiltBotTough
Bullseye
BuzzSumo
CCBot
CSHttp
Calculon
Copier
Curious
Deusu
Devil
DigitalPebble
Discoverybot
DomainAppender
Download Wonder
Dragonfly
EMail Wolf
Extractor
FlashGet
FrontPage
Grabber
HTTP::Lite
Haansoft
Harvest
Indy Library
InterGET
Iskanie
Keybot Translation-Search-Machine
LinkScan
LinqiaRSSBot
Lmspider
MJ12bot
MQQBrowser
MeanPath Bot
Mojeek
Needle
Netcraft
NextGenSearchBot
NimbleCrawler
OpenVAS
Openvas
OrangeBot
Page Analyzer
Pandalytics
Panscient
Papa Foto
Picsearch
Pixray
Proximic
Pump
RankFlex
RebelMouse
Recorder
RedesScrapy
Ripper
Screaming
Searchestate
Seekport
SenutoBot
SeobilityBot
SiteSucker
Stripper
Sucuri
SurveyBot
Suzuran
T8Abot
Teleport
TeleportPro
Telesphoreo
True_Robot
V-BOT
VelenPublicWebCrawler
Virusdie
WWW-Mechanize
Web Fetch
WebCopier
WebGo IS
WebImageCollector
WebStripper
WebSucker
Whacker
Whatweb
Zade
Zauba
coccocbot
iubenda-radar
lwp-trivial
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
seocompany.store
seostar
sogouspider