nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-27 22:07:27 +00:00

250 lines
2.6 KiB
Text

360Spider
Abonti
Aboundex
AfD-Verbotsverfahren
Alexibot
AllSubmitter
Anarchie
Anarchy99
Asterias
Atomseobot
BDFetch
BLEXBot
BackDoorBot
BackStreet
Battleztar Bazinga
Black Hole
Blackboard
Boardreader
Bolt
Brandprotect
BuiltWith
Bullseye
CATExplorador
CCBot
CensysInspect
ChinaClaw
Citoid
Claritybot
Cocolyzebot
Cogentbot
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Discoverybot
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
Evil
ExtLinksBot
Extractor
ExtractorPro
Ezooms
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
GT::WWW
Genieo
Go-Ahead-Got-It
Grabber
GridBot
HMView
HTMLparser
HTTrack
Haansoft
Hloader
HonoluluBot
Humanlinks
IDBot
IndeedBot
InfoTekies
InterGET
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
JustView
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
LexiBot
Lftp
LieBaoFast
Likse
LinkWalker
LinkextractorPro
LinksManager
MFC_Tear_Sample
MIIxpc
MJ12bot
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MauiBot
Meanpathbot
Mediatoolkitbot
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mojolicious
Mr.4x3
Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
NetZIP
Netcraft
Nikto
Ninja
Nmap
Not
Offline Navigator
OnCrawl
OpenVAS
OrangeSpider
OutfoxBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pavuk
PeoplePal
Petalbot
Picsearch
PictureFinder
Piepmatz
Pixray
ProWebWalker
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
Reaper
Recorder
Ripper
SBIder
SEOkicks
SEOprofiler
ScoutJet
Screaming
Seekport
Semrush
SemrushBot
SiteCheckerBotCrawler
Sitebeam
Sitevigil
SlySearch
SmartDownload
Snapbot
SocialRankIOBot
Sociscraper
Spammen
SpankBot
Spanner
Sqlworm
Sqworm
Sucker
Sucuri
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
TheNomad
Thumbor
Tracemyfile
Trendiction
Turingos
Typhoeus
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
WWW-Mechanize
WWW::Mechanize
WallpapersHD
Web Fuck
Web Sauger
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSucker
Webalta
WebmasterWorldForumBot
Website Quester
Webster
Whack
Wonderbot
Woobot
Xenu
Zauba
Zermelo
Zeus
Zitebot
ZoomBot
ZumBot
ZyBorg
adscanner
archive.org_bot
cah.io.community
coccocbot-web
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com
domainsproject.org
eCatch
iubenda-radar
lwp-trivial
muhstik-scan
plumanalytics
seostar
sexsearcher
spyfu
sysscan
tAkeOut
voyagerx.com
webmeup-crawler
webprosbot
x22Mozilla
zgrab