nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-06 10:09:13 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
ALittle Client
AfD-Verbotsverfahren
AlphaBot
Anarchy99
Anthill
BDCbot
BDFetch
BLEXBot
Backlink-Ceck
Bandit
Black Hole
Bolt
BotALot
Buck
Buddy
BuiltWith
BunnySlippers
CODE87
Calculon
CazoodleBot
CheeseBot
Claritybot
Cliqzbot
Cloud mapping
Collector
Copier
Copyscape
CrazyWebCrawler
CyotekWebCopy
DataCha0s
Deusu
Devil
Discobot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
EMail Siphon
EasyDL
Ecxi
EirGrabber
Evil
ExtLinksBot
ExtractorPro
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
GrabNet
GridBot
HMView
HTTP::Lite
HaosouSpider
Heritrix
Humanlinks
HybridBot
IRLbot
Iblog
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
InfoTekies
Internet Ninja
Iria
Iskanie
JOC Web Spider
Jbrofuzz
Jetty
JustView
Kenjin Spider
Kozmosbot
LeechGet
LexiBot
Lftp
Linkdexbot
LinkpadBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MarkMonitor
MarkWatch
Mata Hari
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Minefield
Mojeek
Mozlila
Mr.4x3
Name Intelligence
Nameprotect
Needle
Nessus
Net Vampire
NetMechanic
NetSpider
NetZIP
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Nmap
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pavuk
Pi-Monster
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankFlex
RankingBot2
Rankivabot
Reaper
RedesScrapy
Rogerbot
SBIder
SEOprofiler
SEOstats
SMTBot
Scrapy
ScrepyBot
Searchestate
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteLockSpider
SiteSucker
Sitevigil
Snapbot
Snoopy
SocialRankIOBot
Sosospider
Spanner
Sqlmap
Sqworm
SurveyBot
T8Abot
Thumbor
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
TurnitinBot
URLy Warning
UnisterBot
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Collage
Web Sauger
WebBandit
WebEnhancer
WebFuck
WebGo IS
WebReaper
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whack
Whacker
Whatweb
Widow
WinHTTrack
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zauba
Zeus
ZumBot
adscanner
arquivo-web-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
heritrix
internetVista monitor
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
probe-image-size
scalaj-http
seoscanners
seostar
serpstatbot
siteripz
sp_auditbot
tAkeOut
trendiction.com
ubermetrics-technologies.com
webgains-bot
webpros.com
webprosbot
x22Mozilla
zauba.io