nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-28 10:09:06 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
80legs
Aboundex
Aboundexbot
AfD-Verbotsverfahren
Alexibot
AllSubmitter
Anarchy
Ankit
Anthill
Apexoo
BackDoorBot
BackWeb
Battleztar Bazinga
Bitacle
Boardreader
Bolt
BotALot
Buck
CCBot
CODE87
CSHttp
Cegbfeieh
CensysInspect
CheTeam
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Crescent
CrunchBot
CyotekWebCopy
DTS Agent
DataCha0s
Devil
DigitalPebble
Discobot
Discoverybot
Dispatch
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
EasyDL
EroCrawler
ExtractorPro
Fimap
Firefox/7.0
FlashGet
FrontPage
Fyrebot
G-i-g-a-b-o-t
Genieo
GoZilla
GrabNet
Grafula
GrapeFX
GridBot
HMView
HTMLparser
HTTP::Lite
Haansoft
Harvest
Hloader
IDBTE4M
IDBot
IlseBot
Image Sucker
IndeedBot
InfoTekies
InterGET
InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT
JetCar
Jyxobot
LNSpiderguy
Larbin
LeechFTP
Lftp
LieBaoFast
Lightspeedsystems
Likse
Linkbot
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MIIxpc
MJ12bot
MQQBrowser
Mail.RU_Bot
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Musobot
NICErsPRO
Nameprotect
NearSite
Net Vampire
NetLyzer
NetMechanic
NetSpider
Nettrack
Netvibes
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Papa Foto
PeoplePal
Picscout
Picsearch
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
Pu_iN
PxBroker
PyCurl
RankingBot2
ReGet
Reaper
RebelMouse
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SBIder
SEOlyticsCrawler
SISTRIX
ScoutJet
ScreenerBot
ScrepyBot
Searchestate
Semrush
SentiBot
SiteSucker
Sitebeam
SmartDownload
Snoopy
SocialRankIOBot
SpaceBison
Spammen
Spanner
Spinn3r
Sqlmap
Sqlworm
Stripper
SuperBot
Swiftbot
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Titan
True_Robot
Turnitin
TurnitinBot
Twice
URLy.Warning
V-BOT
VB Project
VelenPublicWebCrawler
VidibleScraper
Voil
Voltron
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
Web Auto
Web Fetch
Web Sucker
WebCopier
WebGo IS
WebPix
WebSauger
WebZIP
Website Quester
WebsiteQuester
Who.is Bot
WiseGuys Robot
Wprecon
YoudaoBot
Zauba
Zermelo
ZmEu
ZoomBot
adscanner
backlink-check
cah.io.community
crawler.feedback
demandbase-bot
domainsproject.org
eCatch
instabid
isitwp.com
linkdexbot
lwp-request
netEstate NE Crawler
oBot
plumanalytics
satoristudio.net
scan.lol
seoscanners
sitechecker.pro
sp_auditbot
sysscan
tAkeOut
trendiction.com
voyagerx.com
webmeup-crawler
webprosbot
xpymep1.exe
zauba.io