nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-12 20:00:10 +02:00

250 lines
2.5 KiB
Text

404enemy
80legs
ADmantX
AhrefsBot
AiHitBot
Alligator
Anarchie
Apexoo
Asterias
autoemailspider
backlink-check
Badass
Bandit
Barkrowler
BDFetch
Bigfoot
Boardreader
Bolt
BotALot
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
CheeseBot
CheTeam
ChinaClaw
coccocbot-web
Cogentbot
cognitiveseo
Collector
Copier
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Custo
DatabaseDriverMysqli
DBLBot
demandbase-bot
Deusu
Devil
Digincore
Dirbuster
Disco
DittoSpyder
DomainSigmaCrawler
DomainStatsBot
Dragonfly
Drip
DTS Agent
ECCP/1.0
EirGrabber
evc-batch
Evil
Exabot
Express WebPictures
Extractor
EyeNetIE
Ezooms
FHscan
Firefox/7.0
Foobot
GalaxyBot
GermCrawler
Getintent
Gigablast
G-i-g-a-b-o-t
Gotit
GoZilla
GrapeFX
HaosouSpider
Harvest
Havij
HEADMasterSEO
Heritrix
HMView
HTMLparser
HTTrack
IDBot
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
instabid
Internet Ninja
InternetSeer
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
JetCar
JOC Web Spider
Jorgee
Keyword Density
Kozmosbot
Linkdexbot
LinkScan
LinqiaRSSBot
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
Magnet
Mag-Net
magpie-crawler
Majestic SEO
MarkMonitor
MarkWatch
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
mediawords
Microsoft Data Access
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
MSFrontPage
Msrabot
Musobot
Navroad
NearSite
Nessus
NetAnts
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Ninja
Nmap
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OpenVAS
page scorer
PageScorer
Pandalytics
PECL::HTTP
PHPCrawl
Picsearch
Pimonster
plumanalytics
Pockey
Probethenet
ProPowerBot
PxBroker
RankActive
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
RedesScrapy
RepoMonkey
Rogerbot
SalesIntelligent
ScanAlert
scan.lol
Scrapy
Screaming
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOlyticsCrawler
seoscanners
SeoSiteCheckup
Shodan
Siphon
SiteExplorer
SiteLockSpider
SlySearch
Snapbot
Snoopy
Sociscraper
Sottopop
Spammen
Spanner
Steeler
SuperHTTP
Suzuran
Swiftbot
sysscan
Szukacz
T0PHackTeam
tAkeOut
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
trendiction.com
trendiction.de
UnisterBot
Upflow
VB Project
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
Wallpapers/3.0
WASALive-Bot
Webalta
WebAuto
Web Auto
WebCollage
Web Enhancer
WebFuck
Web Fuck
WebImageCollector
WebmasterWorldForumBot
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
Webster
WebStripper
WebSucker
Web Sucker
WebWhacker
WebZIP
WeSEE
Whacker
Who.is Bot
WinHTTrack
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x22Mozilla
xpymep1.exe
YoudaoBot
zauba.io
Zermelo
zgrab
ZmEu
ZyBorg