nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-16 22:07:09 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ALittle Client
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
Anarchy
Anarchy99
Ankit
BackStreet
Bandit
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Blow
Bolt
Buck
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CCBot
CSHttp
Calculon
CazoodleBot
CheTeam
ChinaClaw
Chlooe
Citoid
Claritybot
Cloud mapping
Cogentbot
Copier
Crawling at Home Project
Crescent
CrunchBot
Custo
DBLBot
Deusu
DigitalPebble
Dirbuster
Disco
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
Download Wonder
ECCP/1.0
EMail Siphon
Ecxi
EirGrabber
EroCrawler
Extreme Picture Finder
Ezooms
FDM
Fimap
FlashGet
Freeuploader
FrontPage
Fuzz
GalaxyBot
Getintent
Gigabot
Go-Ahead-Got-It
Gotit
Grafula
GrapeFX
HMView
HTTP::Lite
HTTrack
Haansoft
Heritrix
IDBot
IRLbot
Iblog
Image Fetch
InfoTekies
Intelliseek
InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT
JikeSpider
Kenjin Spider
Keyword Density
LNSpiderguy
Lanshanbot
Leap
Lftp
Linkdexbot
LinkpadBot
Ltx71
MQQBrowser
MSFrontPage
MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Minefield
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
Navroad
Needle
Nessus
NetMechanic
NetSpider
Nettrack
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Not
Nuclei
Nutch
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
Pavuk
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pixray
Pockey
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankurBot
Reaper
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SalesIntelligent
ScoutJet
Screaming
SemanticJuice
Semrush
SeoSiteCheckup
SeobilityBot
Siphon
Sitebeam
SmartDownload
Snake
Snapbot
Sosospider
SpaceBison
Spammen
Spanner
Spbot
Sqworm
Steeler
SuperHTTP
SurveyBot
Szukacz
Teleport
TheNomad
TightTwatBot
Titan
Trendiction
True_Robot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
VB Project
VCI
VelenPublicWebCrawler
WASALive-Bot
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WallpapersHD
WeSEE
Web Fuck
WebCollage
WebCopier
WebLeacher
WebStripper
WebSucker
WebWhacker
WebmasterWorldForumBot
Website Quester
Webster
Who.is Bot
WiseGuys Robot
Woobot
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
demandbase-bot
evc-batch
facebookscraper
gopher
ips-agent
iubenda-radar
magpie-crawler
meanpathbot
probe-image-size
ripz
s1z.ru
satoristudio.net
seocompany.store
sexsearcher
siteripz
sp_auditbot
spyfu
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla
zgrab