80legs
ADmantX
AIBOT
ASPSeek
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy
Attach
AwarioRssBot
AwarioSmartBot
BDFetch
BackWeb
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
BlackWidow
Boardreader
Buck
BuiltBotTough
BunnySlippers
BuzzSumo
CODE87
CSHttp
Chlooe
Claritybot
Cloud mapping
Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
DTS Agent
DatabaseDriverMysqli
Demon
Disco
DnBCrawler-Analytics
DnyzBot
DomCopBot
Domains Project
Download Wonder
EMail Siphon
EasyDL
Ebingbong
ExtLinksBot
Extreme Picture Finder
Ezooms
FDM
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FyberSpider
GT::WWW
GetWeb
Getintent
Gigabot
GoZilla
Grabber
Grafula
Haansoft
Havij
Heritrix
HybridBot
IRLbot
Image Fetch
Indy Library
InfoTekies
IstellaBot
Jbrofuzz
JennyBot
JikeSpider
Joomla
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
LeechFTP
Libwhisker
LieBaoFast
Likse
LinkScan
LinkextractorPro
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Mag-Net
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MegaIndex.ru
Microsoft Data Access
Minefield
Moblie Safari
NICErsPRO
NPbot
Name Intelligence
NearSite
Needle
NetAnts
NetMechanic
NetSpider
NetZIP
Nettrack
Niki-bot
Nimbostratus
Nuclei
Nutch
Octopus
OnCrawl
OpenLinkProfiler
Openfind
OrangeSpider
OutclicksBot
PageAnalyzer
Panscient
Papa Foto
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Quick-Crawler
RankActive
Re-re
ReGet
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOkicks
Scrapy
Searchestate
SearchmetricsBot
SemrushBot
Seomoz
Shodan
SiteExplorer
SiteSnagger
Sitebeam
Sociscraper
SpaceBison
Spammen
SpankBot
Spanner
Spbot
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
SurveyBot
Telesoft
Telesphoreo
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
True_Robot
Turingos
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WASALive-Bot
WPScan
WWWOFFLE
Web Sucker
WebEnhancer
WebFuck
WebLeacher
WebReaper
WebZIP
Webshag
WebsiteExtractor
Webster
Whack
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zeus
Zitebot
ZoomBot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
coccocbot-web
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
evc-batch
gopher
instabid
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
magpie-crawler
mediawords
page scorer
pcBrowser
probe-image-size
s1z.ru
scalaj-http
seobility
sitechecker.pro
siteripz
sp_auditbot
sysscan
tAkeOut
webgains-bot
webmeup-crawler
webprosbot