nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-09 22:07:03 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
BetaBot
Blow
Bolt
BotALot
CCBot
CensysInspect
CheTeam
ChinaClaw
Citoid
Claritybot
CopyRightCheck
Crescent
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
Demon
Digincore
Discobot
Discoverybot
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Wolf
EasyDL
Evil
Exabot
EyeNetIE
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GermCrawler
Getintent
Gotit
GrabNet
Grafula
GrapeshotCrawler
HMView
HTMLparser
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
HonoluluBot
Humanlinks
HybridBot
Id-search
Image Fetch
IndeedBot
InternetSeer
JamesBOT
Jbrofuzz
JetCar
JikeSpider
Jorgee
JustView
Jyxobot
Keyword Density
Kinza
Kozmosbot
LibWeb
LieBaoFast
Linkbot
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Mag-Net
Magnet
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Mojeek
Morfeus Fucking Scanner
Mozlila
Navroad
NetLyzer
NetMechanic
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Nutch
Offline Explorer
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
PeoplePal
Picsearch
Pimonster
Pixray
Psbot
Pump
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
Reaper
RepoMonkey
Ripper
SBIder
SEOstats
Searchestate
Semrush
SemrushBot
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
SputnikBot
Sqworm
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
Teleport
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TurnitinBot
Typhoeus
URLy Warning
V-BOT
VB Project
VidibleScraper
VoidEYE
Voltron
WISENutbot
WWWOFFLE
Web Auto
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebBandit
WebCollage
WebCopier
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebsiteExtractor
Whacker
Whatweb
WiseGuys Robot
Wprecon
Xaldon WebSpider
YoudaoBot
Zade
Zeus
ZoominfoBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
check1.exe
crawler.feedback
crawler4j
demandbase-bot
eCatch
facebookscraper
gopher
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
meanpathbot
netEstate NE Crawler
oBot
polaris version
probe-image-size
scalaj-http
scan.lol
seocompany.store
seostar
serpstatbot
sitechecker.pro
siteripz
spyfu
tAkeOut
webpros.com
webprosbot
x09Mozilla
zauba.io
zgrab