nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-01 04:41:11 +00:00

100 lines
1 KiB
Text

AIBOT
Alligator
Anarchy
AwarioRssBot
BlackWidow
Boardreader
CazoodleBot
CherryPicker
DBLBot
DatabaseDriverMysqli
Deusu
Dirbuster
DnBCrawler-Analytics
DomainAppender
EMail Wolf
EasyDL
EirGrabber
FDM
Firefox/7.0
GT::WWW
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
HEADMasterSEO
HTMLparser
Humanlinks
Internet Ninja
Iskanie
Kinza
Larbin
LibWeb
LinkScan
Linkbot
LinkextractorPro
LinkpadBot
Lipperhey Spider
MQQBrowser
Moblie Safari
Mojeek
Nameprotect
Nessus
NetSpider
Nettrack
Octopus
Offline Navigator
OpenLinkProfiler
OpenVAS
OutclicksBot
Page Analyzer
Papa Foto
Pi-Monster
PleaseCrawl
Pockey
Probethenet
Pu_iN
Recorder
RepoMonkey
Ripper
SEOkicks
ScanAlert
Scanbot
ScrepyBot
Semrush
Seomoz
Sitebeam
Sociscraper
Steeler
Sucker
T8Abot
Telesphorep
Titan
Trendictionbot
VCI
Vacuum
Virusdie
WEBDAV
WISENutbot
Web Enhancer
WebAuto
WebCopier
WebImageCollector
WebWhacker
Website Quester
WebsiteExtractor
Xaldon WebSpider
Zauba
ZoominfoBot
archive.org_bot
arquivo-web-crawler
gopher
heritrix
netEstate NE Crawler
oBot
scan.lol
seobility
sexsearcher
spyfu
webgains-bot