360Spider
80legs
Acunetix
AhrefsBot
AiHitBot
Alligator
arquivo.pt
arquivo-web-crawler
Asterias
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
Barkrowler
Battleztar Bazinga
BDFetch
Blackboard
BLEXBot
BlowFish
Bolt
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CCBot
Cegbfeieh
CheTeam
Cliqzbot
Cloud mapping
coccocbot-web
Collector
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
Crescent
CrunchBot
DatabaseDriverMysqli
Deusu
Dirbuster
Discobot
DittoSpyder
Dotbot
Download Wonder
Dragonfly
DTS Agent
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMail Wolf
EroCrawler
Evil
ExtLinksBot
Extractor
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
FHscan
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
GermCrawler
GetRight
Gigablast
Gotit
GoZilla
Grabber
GrabNet
Grafula
GridBot
HaosouSpider
Havij
heritrix
Hloader
HTMLparser
HTTP::Lite
Humanlinks
Image Fetch
Image Sucker
InfoNaviRobot
Internet Ninja
IRLbot
Iskanie
Jbrofuzz
JetCar
Jetty
Jorgee
JustView
Kenjin Spider
Kozmosbot
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
LNSpiderguy
lwp-request
MarkWatch
Mass Downloader
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
MSFrontPage
Msrabot
Musobot
Name Intelligence
Netcraft
NetMechanic
NetSpider
Net Vampire
NetZIP
NICErsPRO
Niki-bot
NPbot
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
Pandalytics
Papa Foto
pcBrowser
PeoplePal
Picscout
Picsearch
PictureFinder
PleaseCrawl
Probethenet
ProPowerBot
QueryN Metasearch
RankActive
RankurBot
RebelMouse
RedesScrapy
ReGet
Ripper
RSSingBot
ScanAlert
Scanbot
scan.lol
Scrapy
ScreenerBot
Searchestate
SEOkicks
SEOlyticsCrawler
Seomoz
SEOstats
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
Site Sucker
Sitevigil
SlySearch
Snapbot
sogouspider
Sottopop
SpaceBison
Spammen
sp_auditbot
Spbot
spyfu
Steeler
Stripper
Sucker
SuperBot
Surfbot
Suzuran
Szukacz
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
TheNomad
Titan
Tracemyfile
Trendictionbot
trendiction.com
True_Robot
Turingos
Turnitin
TurnitinBot
UnisterBot
URLy.Warning
VCI
Virusdie
WBSearchBot
WebBandit
WebCollage
Web Collage
WebEnhancer
Web Enhancer
Web Fetch
Web Fuck
webmeup-crawler
Web Pix
Web Sauger
WebsiteQuester
Website Quester
Web Sucker
WebWhacker
Whack
Whatweb
Woobot
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
Xaldon_WebSpider
Xenu
xpymep1.exe
Zauba
Zermelo
Zeus
zgrab
ZmEu
ZumBot
ZyBorg