nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-31 10:08:04 +02:00

250 lines
2.6 KiB
Text

360Spider
404enemy
Aboundex
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AllSubmitter
AlphaBot
Attach
autoemailspider
BackDoorBot
BacklinkCrawler
BackStreet
Badass
BatchFTP
BDCbot
Bigfoot
Black Hole
BlackWidow
Boardreader
Brandprotect
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CazoodleBot
CCBot
CheeseBot
CheTeam
ChinaClaw
Chlooe
Claritybot
coccocbot-web
Cogentbot
Collector
CopyRightCheck
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
Crescent
Curious
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Deusu
Devil
Dirbuster
Discobot
DomainAppender
DomainStatsBot
Dotbot
Dragonfly
Drip
DTS Agent
EasyDL
evc-batch
Evil
Exabot
ExtractorPro
Extreme Picture Finder
EyeNetIE
facebookscraper
FemtosearchBot
Flunky
FrontPage
Genieo
GermCrawler
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
GoZilla
GT::WWW
Haansoft
HaosouSpider
Harvest
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
IDBot
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
Internet Ninja
internetVista monitor
ips-agent
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
Jorgee
JustView
Kenjin Spider
Kozmosbot
Larbin
LexiBot
Lftp
LibWeb
Likse
Linkdexbot
LinkScan
LinkWalker
Lipperhey
Lmspider
Ltx71
LWP::Simple
lwp-trivial
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
meanpathbot
Meanpathbot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
MIDown tool
MIIxpc
Mister PiX
Morfeus Fucking Scanner
MS Web Services Client Protocol
Nameprotect
NearSite
Nessus
NetAnts
Netvibes
NetZIP
Nibbler
NICErsPRO
NimbleCrawler
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
Page Analyzer
page scorer
Panscient
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
Pi-Monster
Pockey
POE-Component-Client-HTTP
Psbot
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot2
RankurBot
RealDownload
Reaper
RedesScrapy
ReGet
RepoMonkey
Ripper
scan.lol
Scrapy
ScreenerBot
Searchestate
Semrush
SEOlyticsCrawler
SEOprofiler
SEOstats
sexsearcher
Shodan
Siphon
SISTRIX
Siteimprove
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snake
Snapbot
sogouspider
Sosospider
Spammen
sp_auditbot
Spbot
SputnikBot
spyfu
Steeler
Sucuri
SuperBot
Surfbot
Suzuran
Swiftbot
Szukacz
tAkeOut
TeleportPro
Telesphoreo
The Intraformant
Toata
Trendiction
Turnitin
TurnitinBot
Twice
Upflow
URLy Warning
Vagabondo
VCI
VidibleScraper
Voil
WallpapersHD
WebAuto
Web Auto
WebBandit
WebFetch
Web Fetch
WebFuck
Web Fuck
WebGo IS
WebmasterWorldForumBot
webmeup-crawler
WebReaper
Web Sauger
Webshag
WebsiteExtractor
Webster
WebSucker
WebWhacker
WebZIP
WeSEE
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Woobot
x09Mozilla
x22Mozilla
Xaldon WebSpider
xpymep1.exe
YoudaoBot
Zade
Zauba
zauba.io
Zermelo
Zitebot
ZmEu