nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-02 22:07:25 +00:00

250 lines
2.7 KiB
Text

360Spider
ADmantX
ALittle Client
Abonti
Aboundex
AfD-Verbotsverfahren
Anarchie
Anarchy99
Anthill
Aspiegel
Asterias
Attach
AwarioRssBot
BDFetch
BackDoorBot
BackWeb
Bandit
Battleztar Bazinga
BetaBot
Black Hole
BlackWidow
Brandwatch
BuiltBotTough
Bullseye
CCBot
CODE87
Calculon
CazoodleBot
CherryPicker
Cloud mapping
Cosmos
Crawling at Home Project
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Dirbuster
Dispatch
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
Download Wonder
Drip
EMail Siphon
EMail Wolf
Ecxi
Express WebPictures
ExtractorPro
Fimap
FlashGet
Foobot
Freeuploader
Fuzz
Fyrebot
GT::WWW
GetRight
Go-Ahead-Got-It
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
HTTP::Lite
Haansoft
Harvest
HybridBot
IDBTE4M
IRLbot
Iblog
Id-search
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
Iria
JOC Web Spider
JamesBOT
JennyBot
JetCar
Jetty
Larbin
Leap
LeechFTP
LeechGet
LexiBot
LieBaoFast
LinkScan
Linkbot
LinkpadBot
LinksManager
Lmspider
MIIxpc
MQQBrowser
MarkMonitor
Mass Downloader
Mata Hari
MeanPath Bot
Moblie Safari
Mojeek
Msrabot
NICErsPRO
Name Intelligence
NetLyzer
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Not
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Pavuk
Petalbot
Picscout
Picsearch
Piepmatz
Pixray
PleaseCrawl
ProWebWalker
Probethenet
Pu_iN
Pump
PyCurl
Quick-Crawler
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
RankurBot
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
Scrapy
ScreenerBot
ScrepyBot
Seekport
Semrush
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpankBot
Spbot
Spinn3r
SputnikBot
Sqworm
Sucker
SurveyBot
T0PHackTeam
Teleport
Telesoft
TheNomad
TightTwatBot
Trendictionbot
TurnitinBot
Twice
UnisterBot
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Collage
Web Fetch
Web Fuck
Web Sauger
WebAuto
WebCollage
WebFetch
WebGo IS
WebLeacher
WebReaper
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Wonderbot
Xaldon_WebSpider
Xenu
Zade
Zeus
ZmEu
archive.org_bot
arquivo.pt
autoemailspider
cah.io.community
crawler.feedback
dataforseo.com
eCatch
evc-batch
gopher
internetVista monitor
iubenda-radar
lwp-trivial
netEstate NE Crawler
page scorer
polaris version
satoristudio.net
scan.lol
seobility
seocompany.store
sexsearcher
sitechecker.pro
sogouspider
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
x09Mozilla
xpymep1.exe