404checker
80legs
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AhrefsBot
Alligator
Anarchie
Anarchy
Anarchy99
Anthill
Asterias
AwarioSmartBot
BDFetch
BackWeb
BacklinkCrawler
Badass
Bandit
Battleztar Bazinga
BetaBot
Bigfoot
Blackboard
Boardreader
Bolt
Brandprotect
Brandwatch
BuiltWith
Bullseye
CSHttp
Cegbfeieh
CheTeam
CherryPicker
Cliqzbot
Copier
Crescent
Curious
DBLBot
DTS Agent
Devil
Dirbuster
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
EMail Wolf
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
Freeuploader
Fuzz
GetWeb
Getintent
Gigabot
Gotit
Grafula
GridBot
HEADMasterSEO
HMView
HTMLparser
Haansoft
HaosouSpider
Harvest
Havij
Humanlinks
IDBot
IRLbot
IndeedBot
InterGET
Iria
Iskanie
IstellaBot
JOC Web Spider
JikeSpider
JustView
Kenjin Spider
Keyword Density
LNSpiderguy
LieBaoFast
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Msrabot
Nameprotect
Navroad
NetLyzer
NetMechanic
NetZIP
Netcraft
Nibbler
Ninja
Nmap
Nutch
Offline Explorer
OpenLinkProfiler
Openfind
Openvas
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Papa Foto
PictureFinder
Pimonster
Pixray
ProPowerBot
Pu_iN
Quick-Crawler
RankFlex
RankingBot
Rankivabot
Re-re
RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SBIder
SEOprofiler
SEOstats
SMTBot
Scanbot
ScoutJet
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SentiBot
Shodan
Site Sucker
SiteLockSpider
Siteimprove
SlySearch
SmartDownload
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Sqlmap
Sqworm
Steeler
Stripper
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphoreo
Telesphorep
TheNomad
Thumbor
Toata
Tracemyfile
Trendictionbot
TwengaBot
Typhoeus
URLy.Warning
UnisterBot
VB Project
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Collage
Web Pix
WebAuto
WebBandit
WebCollage
WebCopier
WebImageCollector
WebLeacher
WebSucker
WebWhacker
Webster
Whacker
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
YoudaoBot
Zermelo
arquivo-web-crawler
check1.exe
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
demandbase-bot
eCatch
evc-batch
facebookscraper
heritrix
internetVista monitor
ips-agent
isitwp.com
lwp-request
meanpathbot
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seostar
sexsearcher
tAkeOut
trendiction.de
ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla