nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-27 22:07:31 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ADmantX
Aboundexbot
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchy
Asterias
Atomseobot
AwarioRssBot
AwarioSmartBot
BDCbot
BLEXBot
BackStreet
Barkrowler
Battleztar Bazinga
Bigfoot
Blow
BlowFish
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Calculon
Cegbfeieh
CheeseBot
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copier
CrazyWebCrawler
Curious
DBLBot
DIIbot
DSearch
Demon
Discobot
Discoverybot
DnyzBot
DomainSigmaCrawler
Dotbot
Download Wonder
Drip
EasyDL
EirGrabber
Evil
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
FDM
Flunky
FyberSpider
G-i-g-a-b-o-t
Genieo
GetRight
GetWeb
Go!Zilla
GoZilla
Grabber
GridBot
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
IlseBot
Image Fetch
IndeedBot
Intelliseek
JamesBOT
Jbrofuzz
JennyBot
Joomla
Jorgee
JustView
Jyxobot
Kinza
LNSpiderguy
LWP::Simple
Leap
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lmspider
MJ12bot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Masscan
MauiBot
MeanPath Bot
Metauri
Microsoft URL Control
Moblie Safari
Mr.4x3
NPbot
Navroad
Net Vampire
NetZIP
Netcraft
NextGenSearchBot
Not
Octopus
Offline Explorer
Offline Navigator
OpenVAS
Openfind
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
PageThing.com
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
Piepmatz
Pixray
Probethenet
Pu_iN
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
Rankivabot
RealDownload
Recorder
Rogerbot
SEOkicks-Robot
SEOprofiler
SISTRIX
SalesIntelligent
Scrapy
Screaming
ScreenerBot
ScrepyBot
Searchestate
SemanticJuice
Semrush
SeoSiteCheckup
Siphon
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Sogou web spider
Spammen
Spanner
SputnikBot
Stripper
SuperBot
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
Telesphoreo
Telesphorep
TightTwatBot
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
TwengaBot
Typhoeus
URLy Warning
VCI
Vagabondo
VeriCiteCrawler
VidibleScraper
Voltron
WEBDAV
WISENutbot
WWWOFFLE
WeSEE
WebBandit
WebFuck
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whack
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
Xaldon_WebSpider
Zauba
Zitebot
ZmEu
ZoominfoBot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
isitwp.com
linkdexbot
lwp-trivial
mediawords
oBot
s1z.ru
satoristudio.net
seobility
seocompany.store
seoscanners
seostar
serpstatbot
sysscan
tAkeOut
trendiction.com
webgains-bot
xpymep1.exe
zauba.io
zgrab