nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-06-27 11:30:04 +02:00

250 lines
2.5 KiB
Text

404checker
80legs
Acunetix
AfD-Verbotsverfahren
Alligator
AlphaBot
ASPSeek
autoemailspider
Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb
Badass
Bandit
Barkrowler
BBBike
BDFetch
BetaBot
Bitacle
Blackboard
BLEXBot
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
Calculon
CCBot
Chlooe
Cliqzbot
Cogentbot
Collector
com.plumanalytics
Copier
Cosmos
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Curious
Custo
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Demon
Devil
Digincore
DigitalPebble
DIIbot
Discobot
Discoverybot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Ebingbong
eCatch
EMail Siphon
EMail Wolf
Evil
EyeNetIE
FDM
FemtosearchBot
FHscan
FlashGet
Flunky
Foobot
FyberSpider
GalaxyBot
Getintent
Go!Zilla
GrabNet
Harvest
Havij
Hloader
HTMLparser
HTTP::Lite
HTTrack
Iblog
Indy Library
InfoNaviRobot
instabid
InterGET
Iria
IRLbot
JetCar
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
LibWeb
Libwhisker
Likse
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey Spider
LWP::Simple
Magnet
magpie-crawler
Majestic12
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
Microsoft Data Access
Microsoft URL Control
MJ12bot
MS Web Services Client Protocol
Musobot
Nameprotect
NearSite
Needle
NetZIP
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
NPbot
Nutch
Octopus
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OrangeBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
PageScorer
Papa Foto
Pavuk
PeoplePal
PHPCrawl
PictureFinder
Pimonster
plumanalytics
ProPowerBot
Pump
PyCurl
RankActiveLinkBot
RankingBot2
Rankivabot
Reaper
RedesScrapy
RocketCrawler
Rogerbot
scan.lol
Scrapy
Screaming
SearchmetricsBot
SEOkicks
SEOlyticsCrawler
SEOprofiler
seoscanners
SeoSiteCheckup
Siphon
SiteExplorer
SiteSnagger
SiteSucker
Site Sucker
Snake
Sogou web spider
Sosospider
Sottopop
Spammen
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
SuperBot
SuperHTTP
SurveyBot
T8Abot
tAkeOut
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Titan
Toata
Toweyabot
Trendiction
trendiction.com
trendiction.de
True_Robot
Turnitin
TurnitinBot
TwengaBot
Vacuum
VB Project
VCI
VeriCiteCrawler
VidibleScraper
Wallpapers/3.0
WBSearchBot
Webalta
WebBandit
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
WebFuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebPix
Web Pix
WebSauger
WebsiteExtractor
Website Quester
WebSucker
Web Sucker
WebZIP
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
WPScan
WWW-Collector-E
WWWOFFLE
x22Mozilla
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zauba
zauba.io
Zitebot