nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-05-05 22:52:13 +02:00

250 lines
2.6 KiB
Text

404checker
Aboundex
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Alexibot
Alligator
AlphaBot
Apexoo
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BackDoorBot
backlink-check
BacklinkCrawler
Badass
BatchFTP
BBBike
BetaBot
BlackWidow
BLEXBot
Bolt
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
Claritybot
Cloud mapping
coccocbot-web
cognitiveseo
Copier
CopyRightCheck
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
CrunchBot
Curious
demandbase-bot
Demon
Deusu
Digincore
DigitalPebble
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
Drip
DSearch
EasyDL
Ebingbong
eCatch
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Ezooms
FemtosearchBot
FlashGet
Freeuploader
Fyrebot
GetRight
Gigablast
Go!Zilla
GrapeshotCrawler
GT::WWW
HaosouSpider
Harvest
heritrix
HTMLparser
HTTrack
Iblog
IlseBot
instabid
Intelliseek
InterGET
Internet Ninja
InternetSeer
ips-agent
IRLbot
JamesBOT
JennyBot
Joomla
Jorgee
Kinza
LexiBot
LibWeb
Likse
Linkdexbot
LinkWalker
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
lwp-request
Magnet
magpie-crawler
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
MeanPath Bot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
muhstik-scan
Navroad
Nessus
Net Vampire
Netvibes
NetZIP
Nikto
NimbleCrawler
Ninja
Nmap
Offline Navigator
OnCrawl
Openfind
OpenVAS
OrangeSpider
OutfoxBot
Pandalytics
Panscient
Pavuk
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
plumanalytics
Pockey
Probethenet
ProPowerBot
ProWebWalker
RankFlex
RankingBot
RankingBot2
RebelMouse
RocketCrawler
Rogerbot
SBIder
ScoutJet
SEOkicks
SEOprofiler
SeoSiteCheckup
sexsearcher
Siphon
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
SmartDownload
Snake
Snapbot
Sogou web spider
Sosospider
SpaceBison
Spammen
sp_auditbot
Sqlmap
Sqworm
SuperHTTP
Swiftbot
Szukacz
tAkeOut
Telesphorep
The Intraformant
Thumbor
Toata
Tracemyfile
Trendiction
True_Robot
TurnitinBot
TwengaBot
URLy.Warning
Vagabondo
VB Project
VidibleScraper
Virusdie
Voil
Voltron
Webalta
Web Auto
WebCollage
Web Collage
WEBDAV
WebFuck
Web Fuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebPix
WebSauger
Web Sauger
Webshag
Website Quester
WebStripper
Web Sucker
WebWhacker
WebZIP
WeSEE
Whacker
WinHTTrack
Woobot
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
zauba.io
Zeus
Zitebot
ZmEu