nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-13 10:09:05 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
AIBOT
ALittle Client
Aboundexbot
Alexibot
AllSubmitter
Alligator
Anarchy99
Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
Badass
Bandit
Barkrowler
Bigfoot
Bitacle
Black Hole
Blackboard
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
CCBot
Calculon
CazoodleBot
CensysInspect
CheeseBot
CherryPicker
Copier
Cosmos
Craftbot
Crawling at Home Project
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
Digincore
Disco
Dispatch
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Drip
EasyDL
Ecxi
Evil
ExtLinksBot
EyeNetIE
Ezooms
FDM
FHscan
FlashGet
Flunky
Foobot
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetRight
GetWeb
Getintent
Gigabot
GoZilla
GrabNet
GrapeshotCrawler
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Humanlinks
HybridBot
IDBTE4M
IDBot
Iblog
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InternetSeer
Iria
JOC Web Spider
Jbrofuzz
JennyBot
Joomla
Jorgee
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LeechGet
Libwhisker
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
MIIxpc
MQQBrowser
MTRobot
Majestic12
MauiBot
MeanPath Bot
Metauri
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NPbot
Navroad
NearSite
Nessus
Net Vampire
NetAnts
NetSpider
NetZIP
Netvibes
Niki-bot
Nikto
NimbleCrawler
Nmap
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OrangeSpider
OutfoxBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageScorer
Pandalytics
Papa Foto
Pavuk
PeoplePal
Petalbot
Picscout
PictureFinder
ProWebWalker
Quick-Crawler
RankingBot2
ReGet
RealDownload
Reaper
Recorder
SEOprofiler
SEOstats
SalesIntelligent
ScoutJet
Searchestate
SearchmetricsBot
Semrush
SeobilityBot
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sociscraper
Sosospider
Sottopop
SpaceBison
Spanner
Spinn3r
Sqlworm
Sqworm
Sucuri
SuperHTTP
SurveyBot
TeleportPro
Telesoft
TheNomad
Toata
Trendictionbot
Turingos
Typhoeus
Upflow
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
WASALive-Bot
WISENutbot
WWWOFFLE
Web Fetch
Web Fuck
WebAuto
WebEnhancer
WebLeacher
WebsiteQuester
Webster
Whack
Whatweb
Widow
WiseGuys Robot
Wonderbot
Zauba
Zeus
Zitebot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
domainsproject.org
facebookscraper
gopher
internetVista monitor
magpie-crawler
netEstate NE Crawler
pcBrowser
probe-image-size
ripz
s1z.ru
scalaj-http
siteripz
sysscan
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
x09Mozilla
xpymep1.exe
zauba.io
zgrab