nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-02 11:52:29 +02:00

250 lines
2.6 KiB
Text

80legs
Abonti
Aboundexbot
AhrefsBot
AiHitBot
AllSubmitter
Apexoo
archive.org_bot
ASPSeek
Attach
BackStreet
BackWeb
Bandit
Barkrowler
Battleztar Bazinga
Black Hole
BlackWidow
Blow
BotALot
Brandwatch
Buddy
BuiltWith
Cliqzbot
Cloud mapping
cognitiveseo
CopyRightCheck
Copyscape
CrazyWebCrawler
Curious
Custo
DBLBot
Demon
Digincore
DigitalPebble
DIIbot
Dirbuster
Discobot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
DSearch
Ebingbong
ECCP/1.0
Ecxi
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
Ezooms
facebookscraper
Firefox/7.0
Foobot
Freeuploader
GalaxyBot
Genieo
GermCrawler
Getintent
Gigabot
GoZilla
Grafula
GrapeshotCrawler
GT::WWW
Havij
Heritrix
HMView
HTMLparser
Humanlinks
Iblog
IDBot
Id-search
IlseBot
Image Fetch
InfoTekies
instabid
InterGET
IRLbot
Iskanie
JetCar
Jetty
JikeSpider
Jorgee
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
LibWeb
Libwhisker
Likse
Linkdexbot
LinkpadBot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
lwp-request
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Masscan
Mass Downloader
Mata Hari
Meanpathbot
MeanPath Bot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MIIxpc
Morfeus Fucking Scanner
Msrabot
MS Web Services Client Protocol
Navroad
NearSite
Needle
Nessus
Netcraft
NetSpider
Netvibes
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Nikto
NPbot
oBot
Octopus
Offline Navigator
OnCrawl
OrangeSpider
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Pavuk
pcBrowser
Pixray
plumanalytics
Pockey
Probethenet
ProPowerBot
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
Rankivabot
RankurBot
RebelMouse
RedesScrapy
ReGet
RocketCrawler
Rogerbot
s1z.ru
ScanAlert
Scanbot
Scrapy
Semrush
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
Shodan
Sitebeam
SiteLockSpider
SiteSnagger
SiteSucker
SlySearch
SMTBot
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Spammen
sp_auditbot
Spbot
Spinn3r
SputnikBot
Sqlmap
Stripper
Sucuri
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
Teleport
Titan
Trendiction
trendiction.com
TurnitinBot
TwengaBot
Upflow
URLy Warning
Vacuum
VB Project
VeriCiteCrawler
Virusdie
Voil
Wallpapers/3.0
WBSearchBot
WebAuto
Web Auto
WebBandit
WebCopier
WebEnhancer
WebFetch
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebPix
Web Pix
WebReaper
Web Sauger
WebsiteQuester
Website Quester
WebStripper
Web Sucker
WebWhacker
Whack
Whatweb
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
xpymep1.exe
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg