nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-13 22:07:17 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ASPSeek
Aboundex
Acunetix
AiHitBot
Alexibot
Alligator
Anarchie
Asterias
Attach
BDCbot
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Battleztar Bazinga
BlackWidow
Blow
Boardreader
Brandprotect
Buck
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Cliqzbot
Cocolyzebot
Collector
Copier
CrazyWebCrawler
Curious
CyotekWebCopy
DBLBot
Demon
Deusu
Discobot
DomainAppender
Domains Project
Dotbot
Drip
ECCP/1.0
EasyDL
EirGrabber
EroCrawler
ExtLinksBot
Extreme Picture Finder
FDM
Fimap
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HaosouSpider
Hloader
HybridBot
IRLbot
Id-search
Image Sucker
Indy Library
InfoTekies
Intelliseek
InternetSeer
Iria
IstellaBot
JOC Web Spider
JennyBot
Joomla
Jorgee
Keyword Density
Kozmosbot
LeechFTP
LeechGet
LexiBot
LibWeb
Likse
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
MIDown tool
MIIxpc
MTRobot
Majestic SEO
Majestic-SEO
MarkMonitor
Mata Hari
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mister PiX
Moblie Safari
Mojolicious
Mozlila
Msrabot
Musobot
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetAnts
NetLyzer
NetSpider
Netcraft
Nettrack
Netvibes
Nibbler
Nimbostratus
Nmap
Nuclei
Offline Explorer
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pandalytics
Panscient
Pavuk
Picsearch
PictureFinder
Piepmatz
Pixray
PleaseCrawl
ProWebWalker
Pu_iN
Pump
QueryN Metasearch
Quick-Crawler
RankFlex
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
SMTBot
Scanbot
ScoutJet
ScreenerBot
Semrush
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SmartDownload
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spammen
SputnikBot
Stripper
Sucuri
T0PHackTeam
T8Abot
Teleport
Telesphoreo
Telesphorep
Tracemyfile
Trendiction
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
Vacuum
VelenPublicWebCrawler
VoidEYE
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Auto
Web Collage
Web Enhancer
Web Fuck
WebAuto
WebBandit
WebCollage
WebEnhancer
WebGo IS
WebImageCollector
WebPix
WebSauger
WebStripper
WebSucker
WebZIP
Webalta
WebsiteQuester
Widow
WinHTTrack
Wonderbot
Woobot
Wotbox
Zauba
Zeus
ZyBorg
archive.org_bot
arquivo-web-crawler
crawl.sogou.com
ips-agent
isitwp.com
lwp-trivial
mediawords
netEstate NE Crawler
oBot
scalaj-http
seobility
seostar
serpstatbot
sitechecker.pro
sp_auditbot
sysscan
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla