nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-01-29 22:08:05 +00:00

100 lines
982 B
Text

01h4x.com
Aboundexbot
AiHitBot
Ankit
Asterias
AwarioSmartBot
BDCbot
BDFetch
Bandit
BuiltBotTough
ChinaClaw
Chlooe
Citoid
Crescent
CrunchBot
DSearch
DigitalPebble
Discoverybot
DomCopBot
Drip
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot
Ezooms
FHscan
HMView
HybridBot
IRLbot
Image Fetch
Indy Library
InterGET
JOC Web Spider
JetCar
LinkpadBot
Lipperhey
Litemage_walker
MJ12bot
MSFrontPage
MSIECrawler
Magnet
Mata Hari
MegaIndex.ru
Metauri
MicroMessenger
Net Vampire
NetSpider
Netcraft
NextGenSearchBot
Nibbler
Nuclei
Nutch
OpenLinkProfiler
PageAnalyzer
Pi-Monster
Picscout
Piepmatz
Pu_iN
RSSingBot
Reaper
Screaming
ScreenerBot
Seomoz
Site Sucker
SiteSucker
SlySearch
Snoopy
Sosospider
Sottopop
SuperHTTP
Telesphoreo
Thumbor
UnisterBot
V-BOT
VB Project
Voil
WASALive-Bot
WBSearchBot
WEBDAV
Web Sucker
WebPix
WebReaper
WebSauger
WinHTTrack
YaK
YoudaoBot
Zade
check1.exe
cognitiveseo
cohere-ai
crawler4j
everyfeed-spider
instabid
lwp-trivial
spyfu
trendiction.de
webprosbot
xpymep1.exe
zgrab