404enemy
80legs
Abonti
Aboundex
Acunetix
AIBOT
Alexibot
Alligator
AllSubmitter
Anarchie
Ankit
Aspiegel
Asterias
Attach
autoemailspider
AwarioRssBot
Backlink-Ceck
backlink-check
BackStreet
Bandit
BatchFTP
BDCbot
BetaBot
Bigfoot
Black Hole
BLEXBot
Bolt
BotALot
BuiltWith
Bullseye
BuzzSumo
Calculon
CCBot
Cegbfeieh
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cogentbot
Collector
Copier
crawler4j
crawler.feedback
crawl.sogou.com
CSHttp
Curious
DataCha0s
demandbase-bot
Demon
Devil
Digincore
DigitalPebble
DIIbot
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
Domains Project
DomainStatsBot
Download Wonder
DSearch
DTS Agent
eCatch
ECCP/1.0
Ecxi
EMail Siphon
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
facebookscraper
FDM
FemtosearchBot
Flunky
FrontPage
FyberSpider
GalaxyBot
GermCrawler
Getintent
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
Haansoft
Havij
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HybridBot
IDBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InternetSeer
internetVista monitor
Iria
Iskanie
IstellaBot
JamesBOT
JennyBot
JikeSpider
Joomla
JustView
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
Lftp
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
lwp-request
LWP::Simple
Magnet
Mag-Net
Majestic12
MarkWatch
Mass Downloader
meanpathbot
Meanpathbot
mediawords
MFC_Tear_Sample
MIDown tool
MIIxpc
Mister PiX
Morfeus Fucking Scanner
MQQBrowser
Mr.4x3
MSFrontPage
Msrabot
muhstik-scan
Nameprotect
Netcraft
NetMechanic
Netvibes
NetZIP
Niki-bot
Nikto
Nutch
oBot
Octopus
Offline Explorer
Offline Navigator
Openfind
OpenLinkProfiler
Openvas
OrangeBot
OrangeSpider
PageAnalyzer
page scorer
PageScorer
Panscient
PeoplePal
Picscout
Pimonster
Probethenet
ProPowerBot
Psbot
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot
RankingBot2
Reaper
RebelMouse
RedesScrapy
Ripper
Rogerbot
ScanAlert
ScoutJet
SearchmetricsBot
SemrushBot
SEOprofiler
SeoSiteCheckup
SEOstats
Siphon
SiteLockSpider
SiteSnagger
Site Sucker
Sitevigil
SlySearch
Snapbot
Sosospider
Sottopop
Spammen
SpankBot
Spanner
Spbot
spyfu
Sqworm
Suzuran
Swiftbot
T0PHackTeam
T8Abot
tAkeOut
Telesoft
The Intraformant
TightTwatBot
Toata
Toweyabot
Trendictionbot
trendiction.de
True_Robot
VeriCiteCrawler
WebCopier
WEBDAV
Web Enhancer
WebGo IS
WebLeacher
webmeup-crawler
WebPix
WebSauger
WebsiteExtractor
Website Quester
Webster
WebStripper
Web Sucker
Whack
Widow
WiseGuys Robot
Woobot
Wotbox
Wprecon
WPScan
WWW-Collector-E
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zermelo
Zeus
zgrab
ZumBot
ZyBorg