nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-25 22:06:58 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ALittle Client
Abonti
AhrefsBot
Aipbot
Alexibot
AlphaBot
Anarchy
Atomseobot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackStreet
BackWeb
Barkrowler
BatchFTP
Black Hole
BlackWidow
Blow
BlowFish
BotALot
BuiltWith
CATExplorador
CCBot
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Citoid
Claritybot
Cloud mapping
Collector
Copier
Copyscape
Cosmos
Craftbot
Curious
Custo
CyotekWebCopy
DBLBot
DTS Agent
DatabaseDriverMysqli
Demon
DigitalPebble
Disco
Dispatch
DittoSpyder
DnyzBot
DomainSigmaCrawler
Dotbot
Dragonfly
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
EyeNetIE
Ezooms
Fimap
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Getintent
Gigabot
GoZilla
GrabNet
Grabber
Grafula
HEADMasterSEO
HMView
HTTrack
HaosouSpider
Harvest
HonoluluBot
IDBTE4M
IDBot
IRLbot
IlseBot
Indy Library
Intelliseek
Iria
IstellaBot
JOC Web Spider
JennyBot
JetCar
Jetty
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
Leap
Lftp
LibWeb
LieBaoFast
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Mass Downloader
Masscan
MeanPath Bot
Mediatoolkitbot
Microsoft URL Control
Minefield
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Nessus
NetMechanic
NetZIP
NextGenSearchBot
Nibbler
Nikto
Nmap
Not
Nuclei
OpenVAS
OrangeBot
OutclicksBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PeoplePal
Petalbot
PleaseCrawl
Probethenet
Pu_iN
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Re-re
ReGet
RebelMouse
Recorder
RepoMonkey
Ripper
SBIder
SEOlyticsCrawler
SISTRIX
ScanAlert
ScoutJet
Searchestate
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteExplorer
SiteLockSpider
Sitevigil
SlySearch
SpaceBison
Spanner
Spbot
Sucuri
SuperHTTP
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
Telesoft
TheNomad
Tracemyfile
Trendiction
True_Robot
Turingos
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
Upflow
VCI
Voltron
WASALive-Bot
WWW-Collector-E
WeSEE
Web Auto
WebCopier
WebPix
WebReaper
WebStripper
WebZIP
Webalta
Webshag
WebsiteExtractor
WebsiteQuester
Whacker
Whatweb
Who.is Bot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zauba
ZmEu
ZoomBot
ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
cah.io.community
com.plumanalytics
crawl.sogou.com
crawler.feedback
domainsproject.org
ips-agent
iubenda-radar
linkdexbot
lwp-request
muhstik-scan
netEstate NE Crawler
oBot
s1z.ru
scan.lol
seocompany.store
seoscanners
seostar
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
ubermetrics-technologies.com
webgains-bot
webprosbot
x09Mozilla
xpymep1.exe