nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-17 11:10:45 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
ADmantX
ASPSeek
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Aipbot
BDCbot
BLEXBot
BackWeb
BacklinkCrawler
BatchFTP
BlackWidow
Blackboard
Blow
Brandprotect
Buck
BuiltWith
CATExplorador
CODE87
CheTeam
Claritybot
Cogentbot
CopyRightCheck
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
Custo
DBLBot
DIIbot
DataCha0s
Demon
Digincore
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
DittoSpyder
DomainAppender
DomainSigmaCrawler
Domains Project
Dragonfly
EMail Wolf
EasyDL
Ebingbong
Ecxi
Evil
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Firefox/7.0
Flunky
Foobot
FrontPage
Fyrebot
GalaxyBot
Genieo
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
Grafula
GridBot
HEADMasterSEO
HMView
HTTP::Lite
HybridBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
JikeSpider
Keyword Density
Kozmosbot
LNSpiderguy
Larbin
Leap
Lftp
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft URL Control
Mojeek
Mojolicious
Mr.4x3
Msrabot
NICErsPRO
Navroad
Nessus
NetAnts
NetZIP
Nettrack
Netvibes
NimbleCrawler
Ninja
Not
Offline Explorer
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Panscient
PeoplePal
Pi-Monster
Picsearch
Pimonster
Pockey
ProWebWalker
Probethenet
Psbot
Pu_iN
RSSingBot
RankActive
RankFlex
RankingBot2
Rankivabot
Reaper
RepoMonkey
Rogerbot
SEOlyticsCrawler
SEOstats
SISTRIX
ScanAlert
Scanbot
ScreenerBot
SearchmetricsBot
Semrush
SeoSiteCheckup
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Snapbot
Sottopop
SpaceBison
Spinn3r
Sqlmap
Surfbot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Teleport
TheNomad
Titan
Toata
Tracemyfile
Trendictionbot
TwengaBot
Typhoeus
URLy.Warning
UnisterBot
VB Project
VCI
VidibleScraper
Voil
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
WWWOFFLE
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebFetch
WebImageCollector
WebReaper
WebSauger
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Webster
Widow
WiseGuys Robot
Wprecon
YoudaoBot
Zitebot
ZmEu
ZoomBot
adscanner
archive.org_bot
backlink-check
cah.io.community
check1.exe
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
facebookscraper
gopher
heritrix
internetVista monitor
ips-agent
isitwp.com
lwp-request
magpie-crawler
mediawords
muhstik-scan
pcBrowser
probe-image-size
seocompany.store
seostar
ubermetrics-technologies.com
webprosbot
x09Mozilla
xpymep1.exe