360Spider
404enemy
80legs
ADmantX
ALittle Client
ASPSeek
Abonti
AhrefsBot
AiHitBot
Aipbot
Alexibot
AlphaBot
Anarchy99
Ankit
Attach
BBBike
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
Badass
Battleztar Bazinga
Bitacle
Buck
Buddy
BuiltWith
BunnySlippers
Cegbfeieh
CensysInspect
Claritybot
Cloud mapping
Collector
Custo
CyotekWebCopy
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
DigitalPebble
Discobot
DittoSpyder
DomainStatsBot
Domains Project
EasyDL
Ebingbong
Extractor
ExtractorPro
EyeNetIE
FDM
Firefox/7.0
FlashGet
FyberSpider
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Getintent
Gigabot
GoZilla
Grabber
GrapeFX
HTMLparser
HTTrack
Harvest
Heritrix
Hloader
Humanlinks
IDBTE4M
IRLbot
Iblog
Id-search
Image Sucker
IndeedBot
InfoNaviRobot
Internet Ninja
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
Jorgee
JustView
Keyword Density
Lanshanbot
Leap
LeechFTP
Libwhisker
Linkbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MIDown tool
MIIxpc
MSIECrawler
MarkMonitor
MarkWatch
Mata Hari
MeanPath Bot
Meanpathbot
Metauri
Microsoft Data Access
Minefield
MolokaiBot
Morfeus Fucking Scanner
Msrabot
Musobot
NPbot
Name Intelligence
NearSite
NetAnts
NetLyzer
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Ninja
Not
Nuclei
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
PECL::HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Piepmatz
Pimonster
ProPowerBot
ProWebWalker
Pu_iN
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankFlex
Rankivabot
Re-re
Recorder
RedesScrapy
Rogerbot
SEOkicks
SEOkicks-Robot
SISTRIX
Scrapy
Screaming
SearchmetricsBot
Semrush
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Siteimprove
Sitevigil
SlySearch
Snapbot
Sosospider
Spbot
SputnikBot
Sqlmap
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
Teleport
The Intraformant
TheNomad
Titan
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TwengaBot
Twice
Upflow
V-BOT
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WWW-Collector-E
WallpapersHD
Web Fetch
Web Fuck
Web Sauger
WebAuto
WebCollage
WebEnhancer
WebGo IS
WebImageCollector
WebSauger
WebStripper
WebWhacker
WebZIP
WebsiteExtractor
Wotbox
Wprecon
YoudaoBot
Zauba
ZoomBot
ZyBorg
archive.org_bot
arquivo.pt
check1.exe
clark-crawler
coccocbot
com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org
gopher
heritrix
ips-agent
lwp-request
netEstate NE Crawler
polaris version
ripz
scan.lol
seobility
sexsearcher
sitechecker.pro
spyfu
trendiction.de
voyagerx.com
webmeup-crawler
x09Mozilla
xpymep1.exe