360Spider
404checker
404enemy
Aboundex
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Aipbot
Apexoo
archive.org_bot
Attach
Badass
Bandit
Barkrowler
Battleztar Bazinga
BBBike
Bitacle
Black Hole
BlackWidow
BotALot
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
CCBot
Cegbfeieh
CheTeam
Claritybot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
com.plumanalytics
Copier
Cosmos
crawler4j
crawl.sogou.com
CrazyWebCrawler
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Demon
Deusu
Devil
DigitalPebble
DIIbot
Disco
DnyzBot
DomainSigmaCrawler
Dotbot
Drip
EasyDL
Ebingbong
eCatch
ECCP/1.0
EirGrabber
EMail Siphon
EroCrawler
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Firefox/7.0
FlashGet
Foobot
FyberSpider
Genieo
Getintent
GetRight
GetWeb
Gotit
Go!Zilla
Grabber
GrabNet
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Havij
HMView
HTTP::Lite
HTTrack
Humanlinks
Iblog
IDBot
IlseBot
IndeedBot
InfoTekies
instabid
InternetSeer
ips-agent
IRLbot
Iskanie
JamesBOT
JennyBot
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Larbin
LeechFTP
LexiBot
Lightspeedsystems
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
lwp-trivial
Magnet
magpie-crawler
Mail.RU_Bot
Masscan
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
mediawords
Metauri
Microsoft Data Access
MIDown tool
MJ12bot
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Nameprotect
Navroad
Needle
Nessus
Netcraft
Net Vampire
Netvibes
Nibbler
NICErsPRO
Niki-bot
Nikto
Ninja
Nutch
Openfind
OpenLinkProfiler
Openvas
OpenVAS
OutclicksBot
OutfoxBot
PageGrabber
PageScorer
Pandalytics
Panscient
PECL::HTTP
PeoplePal
Picscout
ProPowerBot
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot2
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
s1z.ru
SalesIntelligent
ScanAlert
scan.lol
ScreenerBot
SearchmetricsBot
SemrushBot
SEOkicks-Robot
SEOstats
SISTRIX
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
SlySearch
Snake
Snapbot
Snoopy
Sociscraper
sogouspider
Sogou web spider
SpaceBison
Spanner
Sqlworm
Sqworm
Steeler
SuperHTTP
Surfbot
SurveyBot
T8Abot
tAkeOut
Teleport
Telesphoreo
Telesphorep
Thumbor
Toweyabot
Tracemyfile
trendiction.de
TurnitinBot
TwengaBot
Twice
UnisterBot
Upflow
URLy.Warning
Vacuum
VCI
VeriCiteCrawler
Virusdie
WBSearchBot
WebCollage
Web Collage
WebCopier
WebEnhancer
WebFetch
Web Fetch
WebFuck
Web Pix
Web Sauger
WebsiteExtractor
WebsiteQuester
Website Quester
WebStripper
WebWhacker
WebZIP
Whatweb
Who.is Bot
Wotbox
WWW-Mechanize
WWW::Mechanize
x09Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
Zauba
zauba.io
Zermelo
Zitebot