360Spider
404checker
404enemy
80legs
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Alexibot
Alligator
AlphaBot
Apexoo
Backlink-Ceck
backlink-check
BackStreet
Bandit
Barkrowler
BatchFTP
BDCbot
BDFetch
Blackboard
BlackWidow
Blow
Brandprotect
Brandwatch
BuiltBotTough
Bullseye
BuzzSumo
CCBot
CheeseBot
Chlooe
coccocbot-web
Collector
crawler4j
crawler.feedback
crawl.sogou.com
CrunchBot
CSHttp
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Demon
Deusu
Devil
DIIbot
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Dotbot
Download Wonder
Dragonfly
DTS Agent
EasyDL
Ebingbong
eCatch
Ecxi
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FHscan
Fimap
Flunky
Foobot
FyberSpider
Genieo
GermCrawler
GetRight
GetWeb
G-i-g-a-b-o-t
Gotit
Go!Zilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HTMLparser
Humanlinks
Id-search
Image Fetch
Image Sucker
InfoTekies
instabid
ips-agent
Iskanie
Jbrofuzz
JennyBot
Jorgee
Jyxobot
Kenjin Spider
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Likse
Linkdexbot
LinkpadBot
LinkScan
LinqiaMetadataDownloaderBot
LWP::Simple
magpie-crawler
Mail.RU_Bot
Majestic SEO
Mata Hari
MauiBot
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
MIDown tool
Mister PiX
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
MS Web Services Client Protocol
Name Intelligence
Navroad
NearSite
NetAnts
Netcraft
NetLyzer
NetMechanic
Nibbler
NICErsPRO
Niki-bot
Nimbostratus
Ninja
Nmap
oBot
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
PageAnalyzer
Page Analyzer
PageGrabber
PECL::HTTP
Picscout
PictureFinder
Pimonster
Pixray
PleaseCrawl
plumanalytics
Probethenet
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot2
RealDownload
Recorder
ReGet
SalesIntelligent
ScanAlert
Scrapy
Screaming
SEOkicks
SEOkicks-Robot
seoscanners
sexsearcher
SISTRIX
SiteExplorer
SiteLockSpider
SiteSnagger
Site Sucker
Snake
Snapbot
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
sp_auditbot
Sqworm
Steeler
Sucker
SuperBot
SurveyBot
sysscan
Szukacz
T0PHackTeam
Teleport
Telesoft
TheNomad
Toata
Toweyabot
Trendictionbot
trendiction.com
trendiction.de
True_Robot
TurnitinBot
URLy Warning
Vacuum
Vagabondo
Virusdie
Voltron
Webalta
WebBandit
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
Website Quester
WebStripper
WebSucker
WebWhacker
WebZIP
WeSEE
Whack
WinHTTrack
WiseGuys Robot
Wotbox
Wprecon
WPScan
WWW-Mechanize
WWW::Mechanize
x09Mozilla
Xenu
Zauba
zauba.io
Zermelo
Zeus
ZmEu
ZumBot