nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-02-07 22:10:04 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ASPSeek
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Anarchie
Ankit
Anthill
Aspiegel
Attach
AwarioSmartBot
BackWeb
Backlink-Ceck
BetaBot
Bitacle
Black Hole
BlackWidow
Blow
Brandprotect
Buddy
BuiltWith
CATExplorador
CCBot
CODE87
CSHttp
CensysInspect
CheTeam
ChinaClaw
Citoid
Claritybot
Cocolyzebot
Collector
Copier
Crawling at Home Project
CrazyWebCrawler
Curious
CyotekWebCopy
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
Dirbuster
DittoSpyder
DnBCrawler-Analytics
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
EroCrawler
Evil
Express WebPictures
Ezooms
FDM
FHscan
Fimap
Firefox/7.0
Foobot
Freeuploader
Fuzz
GT::WWW
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Go!Zilla
GrabNet
Grafula
GridBot
HMView
HTTrack
Harvest
Heritrix
Hloader
HonoluluBot
Humanlinks
HybridBot
IRLbot
IlseBot
Image Fetch
InfoTekies
InterGET
Iskanie
JOC Web Spider
JamesBOT
JennyBot
JetCar
Joomla
Jorgee
JustView
Keyword Density
Lanshanbot
Larbin
Leap
LeechGet
LexiBot
LibWeb
Lightspeedsystems
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MIDown tool
Magnet
Majestic-SEO
MauiBot
Mediatoolkitbot
Microsoft Data Access
Minefield
Mojeek
Mr.4x3
Musobot
Nameprotect
Navroad
NearSite
NetLyzer
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nutch
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
PageAnalyzer
PageThing.com
Pandalytics
Panscient
Pavuk
Pi-Monster
PictureFinder
Piepmatz
Pockey
Probethenet
PxBroker
RSSingBot
RankActive
RankFlex
RankingBot
Rankivabot
RankurBot
ReGet
RealDownload
Recorder
RedesScrapy
RocketCrawler
SBIder
SEOkicks-Robot
SMTBot
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemrushBot
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteExplorer
Snapbot
SocialRankIOBot
Spammen
Spanner
Spbot
Spinn3r
Sqworm
Stripper
SuperHTTP
Szukacz
T0PHackTeam
TheNomad
Thumbor
TightTwatBot
Titan
Toata
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TwengaBot
Twice
Upflow
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
WWW-Mechanize
WWW::Mechanize
WallpapersHD
Web Collage
Web Fetch
Web Fuck
Web Pix
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebPix
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
WinHTTrack
YoudaoBot
Zeus
ZyBorg
backlink-check
check1.exe
coccocbot
crawler4j
eCatch
facebookscraper
gopher
instabid
iubenda-radar
lwp-request
lwp-trivial
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
plumanalytics
polaris version
s1z.ru
seostar
sitechecker.pro
sysscan
tAkeOut
trendiction.com
voyagerx.com
x09Mozilla
x22Mozilla