nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-29 10:09:36 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
80legs
AIBOT
ALittle Client
ASPSeek
AiHitBot
AllSubmitter
Alligator
Anarchie
Anthill
Aspiegel
Attach
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BacklinkCrawler
Badass
BatchFTP
BetaBot
Bitacle
Black Hole
BlackWidow
BlowFish
Boardreader
BotALot
Brandwatch
BunnySlippers
CATExplorador
CCBot
Calculon
CensysInspect
CheTeam
ChinaClaw
Chlooe
Claritybot
Cogentbot
Collector
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
Custo
DBLBot
DTS Agent
DataCha0s
Deusu
DigitalPebble
Disco
Discoverybot
DittoSpyder
DomCopBot
DomainCrawler
Dotbot
Dragonfly
EMail Wolf
Ebingbong
Ecxi
Evil
Express WebPictures
Extractor
EyeNetIE
FDM
FemtosearchBot
Firefox/7.0
FyberSpider
Fyrebot
Genieo
GermCrawler
Go!Zilla
GrapeshotCrawler
HMView
Haansoft
HaosouSpider
Harvest
Havij
IDBTE4M
IDBot
IlseBot
InfoTekies
Intelliseek
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
JikeSpider
Joomla
Kenjin Spider
Kinza
Lanshanbot
Leap
LeechFTP
LibWeb
Likse
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
Navroad
Net Vampire
NetAnts
NetMechanic
NetZIP
Netvibes
Nibbler
Offline Explorer
Offline Navigator
OpenVAS
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Panscient
PeoplePal
Picsearch
Piepmatz
Pixray
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
ScrepyBot
SearchmetricsBot
Semrush
SemrushBot
SeobilityBot
Siphon
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
Snake
SocialRankIOBot
Sogou web spider
Sosospider
Spanner
Sqlmap
Sqworm
Steeler
T0PHackTeam
Teleport
Telesoft
TightTwatBot
Titan
Toata
Tracemyfile
Trendictionbot
Turingos
URLy Warning
URLy.Warning
VB Project
Vacuum
VoidEYE
Voil
Voltron
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
WeSEE
Web Collage
Web Fetch
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebPix
WebReaper
WebSucker
Who.is Bot
WiseGuys Robot
Wonderbot
Woobot
Wprecon
YoudaoBot
Zeus
archive.org_bot
arquivo.pt
backlink-check
check1.exe
crawler4j
dataforseo.com
facebookscraper
gopher
instabid
ips-agent
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
polaris version
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
seostar
serpstatbot
sogouspider
trendiction.de
webmeup-crawler
x09Mozilla
x22Mozilla