nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-10-06 20:44:10 +02:00

250 lines
2.6 KiB
Text

360Spider
404checker
80legs
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
AlphaBot
Anarchie
ASPSeek
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackWeb
Bandit
BetaBot
Bigfoot
BlackWidow
BlowFish
Brandprotect
Buddy
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
ChinaClaw
Cliqzbot
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
CrazyWebCrawler
CSHttp
Curious
Custo
DatabaseDriverMysqli
demandbase-bot
DigitalPebble
Disco
Discobot
Dispatch
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Dragonfly
Ebingbong
eCatch
ECCP/1.0
EirGrabber
EroCrawler
Evil
Exabot
FDM
FemtosearchBot
Fimap
Firefox/7.0
FrontPage
Fyrebot
GalaxyBot
GetRight
GetWeb
Gigablast
Gigabot
Go-Ahead-Got-It
Gotit
Go!Zilla
Grabber
GrabNet
GridBot
Heritrix
Iblog
IlseBot
Image Fetch
Image Sucker
Indy Library
instabid
Intelliseek
InterGET
InternetSeer
ips-agent
Iskanie
IstellaBot
JamesBOT
JetCar
JikeSpider
JOC Web Spider
Jorgee
JustView
Keyword Density
Kozmosbot
Larbin
LeechFTP
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
LNSpiderguy
LWP::Simple
Mag-Net
magpie-crawler
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
Mata Hari
meanpathbot
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft Data Access
Mister PiX
Mr.4x3
muhstik-scan
Navroad
NearSite
Needle
Nessus
NetSpider
Nettrack
NetZIP
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
OnCrawl
OpenLinkProfiler
OrangeSpider
OutfoxBot
page scorer
Pavuk
pcBrowser
PHPCrawl
PictureFinder
Pimonster
POE-Component-Client-HTTP
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
RealDownload
Reaper
RebelMouse
Recorder
RSSingBot
ScanAlert
ScoutJet
Semrush
SemrushBot
SEOkicks
SEOprofiler
seoscanners
serpstatbot
Shodan
Siphon
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SiteSucker
Snake
Snapbot
SocialRankIOBot
sogouspider
Sogou web spider
Spbot
Sqlworm
Stripper
Sucker
Surfbot
Suzuran
Swiftbot
sysscan
T8Abot
tAkeOut
Telesoft
TheNomad
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
TwengaBot
Typhoeus
Upflow
Vacuum
Vagabondo
VCI
VidibleScraper
Virusdie
VoidEYE
Webalta
WebCollage
Web Collage
WebCopier
WEBDAV
WebEnhancer
WebFetch
WebFuck
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
webmeup-crawler
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
Website Quester
Webster
WebStripper
Web Sucker
WebZIP
Whacker
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Wotbox
WPScan
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
zgrab
ZumBot
ZyBorg