360Spider
404checker
80legs
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Anarchy99
Aspiegel
BLEXBot
BackWeb
Badass
Battleztar Bazinga
Bigfoot
Black Hole
Blow
Bolt
Brandwatch
CazoodleBot
CheeseBot
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copier
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
CrunchBot
DIIbot
Deusu
Digincore
Disco
DnyzBot
DomainCrawler
Dragonfly
Drip
EMail Siphon
Ecxi
Evil
Exabot
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
Gotit
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
Hloader
Humanlinks
IRLbot
Iblog
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iria
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
JustView
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
Leap
LeechGet
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
LinkpadBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
Mediatoolkitbot
Metauri
Moblie Safari
Mr.4x3
NPbot
Name Intelligence
NetMechanic
NetSpider
NetZIP
Nettrack
Nibbler
Ninja
Nmap
Not
Openfind
OrangeBot
PageAnalyzer
Pandalytics
Papa Foto
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
Pockey
ProWebWalker
Probethenet
Psbot
Pu_iN
RankFlex
RankingBot
RankingBot2
Rankivabot
Re-re
Recorder
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
SearchmetricsBot
SemanticJuice
SentiBot
Shodan
Siphon
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SlySearch
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpankBot
Spbot
Spinn3r
Sqlmap
Stripper
Sucuri
SuperBot
Suzuran
T0PHackTeam
Teleport
The Intraformant
TheNomad
Titan
Tracemyfile
Trendiction
Turingos
Turnitin
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VB Project
Vacuum
Vagabondo
VoidEYE
Voil
WEBDAV
WPScan
WWWOFFLE
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Sauger
WebFetch
Website Quester
WebsiteExtractor
Webster
Who.is Bot
Widow
Wonderbot
Xenu
YoudaoBot
Zauba
Zitebot
ZoomBot
ZumBot
ZyBorg
clark-crawler
crawler.feedback
demandbase-bot
evc-batch
gopher
heritrix
instabid
internetVista monitor
ips-agent
iubenda-radar
lwp-request
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
ripz
scalaj-http
seostar
serpstatbot
sogouspider
sp_auditbot
spyfu
tAkeOut
voyagerx.com
webprosbot
x22Mozilla
zgrab