nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-08-16 11:18:18 +02:00

250 lines
2.6 KiB
Text

360Spider
80legs
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AIBOT
Apexoo
Attach
Backlink-Ceck
BacklinkCrawler
BackWeb
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Blackboard
Black Hole
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
BuzzSumo
Calculon
CCBot
Claritybot
Cogentbot
Copier
CopyRightCheck
Copyscape
crawler.feedback
crawl.sogou.com
Crescent
CrunchBot
Curious
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
Deusu
Digincore
DIIbot
Disco
Discoverybot
DittoSpyder
DomainSigmaCrawler
DomainStatsBot
Dragonfly
DSearch
DTS Agent
Ebingbong
ECCP/1.0
EMail Wolf
EroCrawler
evc-batch
Evil
Extreme Picture Finder
Ezooms
facebookscraper
FDM
FemtosearchBot
Firefox/7.0
FlashGet
GalaxyBot
Genieo
GermCrawler
Getintent
Gigablast
Gigabot
Go-Ahead-Got-It
GrapeFX
HaosouSpider
Harvest
HEADMasterSEO
Heritrix
Hloader
HTTP::Lite
HTTrack
HybridBot
Iblog
IDBot
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
ips-agent
Jbrofuzz
JennyBot
JikeSpider
JOC Web Spider
Joomla
Jorgee
Kenjin Spider
Kozmosbot
LeechGet
Linkdexbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
LWP::Simple
Mag-Net
magpie-crawler
Majestic12
MarkMonitor
MarkWatch
Mata Hari
Meanpathbot
MeanPath Bot
Microsoft Data Access
MIDown tool
MJ12bot
MS Web Services Client Protocol
Nameprotect
NearSite
Needle
NetAnts
Nettrack
NetZIP
NextGenSearchBot
Niki-bot
NimbleCrawler
Ninja
NPbot
Nutch
oBot
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OpenVAS
OrangeBot
OrangeSpider
Page Analyzer
PageScorer
Papa Foto
PeoplePal
Picscout
Pi-Monster
Pixray
POE-Component-Client-HTTP
Probethenet
ProPowerBot
ProWebWalker
Pump
PyCurl
RankActive
RankActiveLinkBot
Rankivabot
RebelMouse
Recorder
RepoMonkey
RocketCrawler
RSSingBot
s1z.ru
SBIder
ScanAlert
Scanbot
ScoutJet
SemrushBot
SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup
SEOstats
sexsearcher
SISTRIX
Sitebeam
SiteExplorer
SiteLockSpider
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
SpankBot
Spanner
Spbot
SputnikBot
spyfu
Sqlworm
Sqworm
Steeler
Sucuri
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphorep
TightTwatBot
Trendiction
Trendictionbot
trendiction.com
TurnitinBot
TwengaBot
Typhoeus
Upflow
Vagabondo
VCI
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WebAuto
WebCopier
WebFuck
WebGo IS
WebmasterWorldForumBot
webmeup-crawler
WebSauger
Web Sauger
WebsiteExtractor
Website Quester
WebStripper
WebSucker
Whack
Whacker
Widow
WinHTTrack
WWW-Collector-E
WWW::Mechanize
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
Zade
Zauba
zauba.io
Zeus
zgrab
ZmEu
ZyBorg