360Spider
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
AlphaBot
Anarchie
ASPSeek
Asterias
Attach
autoemailspider
BackStreet
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Blackboard
BlackWidow
Blow
Boardreader
Bolt
Brandprotect
Buddy
BuiltBotTough
Bullseye
CATExplorador
CheeseBot
CherryPicker
ChinaClaw
coccocbot-web
Collector
Copier
Craftbot
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Dirbuster
Discobot
DittoSpyder
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
DSearch
EasyDL
Ebingbong
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
ExtLinksBot
Extractor
ExtractorPro
Ezooms
facebookscraper
FDM
FemtosearchBot
Firefox/7.0
FyberSpider
GalaxyBot
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
Go!Zilla
Grafula
Haansoft
HaosouSpider
Havij
HTTrack
Humanlinks
HybridBot
Image Sucker
Indy Library
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
JOC Web Spider
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkWalker
LinqiaRSSBot
Litemage_walker
Lmspider
LWP::Simple
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
meanpathbot
mediawords
Microsoft Data Access
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
Msrabot
muhstik-scan
Musobot
Needle
Nessus
netEstate NE Crawler
NetLyzer
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
Ninja
Nmap
Octopus
Offline Navigator
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
Pandalytics
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Picsearch
PictureFinder
Pixray
PleaseCrawl
plumanalytics
ProWebWalker
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
RankurBot
RealDownload
Recorder
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
SBIder
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SemrushBot
SEOkicks
Seomoz
Sitebeam
Siteimprove
SiteSnagger
Site Sucker
Sitevigil
SlySearch
SMTBot
Snake
SocialRankIOBot
Sogou web spider
Sosospider
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sqworm
Sucker
Sucuri
SuperHTTP
Surfbot
T0PHackTeam
tAkeOut
TeleportPro
The Intraformant
Thumbor
Titan
Toata
Tracemyfile
True_Robot
Turingos
TwengaBot
URLy.Warning
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WallpapersHD
WASALive-Bot
Webalta
WebAuto
Web Auto
Web Collage
WEBDAV
Web Enhancer
Web Fetch
WebFuck
WebLeacher
WebPix
Web Pix
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
WebZIP
Whack
Whacker
WISENutbot
Wprecon
WWW-Collector-E
Xenu
xpymep1.exe
YoudaoBot
Zade
zauba.io
Zermelo
Zeus
Zitebot
ZmEu
ZyBorg