360Spider
Abonti
ADmantX
AiHitBot
Alligator
arquivo.pt
Aspiegel
Attach
autoemailspider
BackDoorBot
BackStreet
Badass
BatchFTP
BBBike
BDCbot
Bigfoot
Bitacle
Blow
Bolt
Brandwatch
BuiltWith
BuzzSumo
CensysInspect
check1.exe
ChinaClaw
Claritybot
coccocbot-web
Cocolyzebot
CODE87
cognitiveseo
Collector
Copier
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Curious
Custo
Demon
Digincore
DigitalPebble
Dirbuster
DomainAppender
DomainCrawler
DomCopBot
Download Wonder
Dragonfly
DTS Agent
EasyDL
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
evc-batch
Evil
Exabot
ExtLinksBot
Extractor
EyeNetIE
Ezooms
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Freeuploader
Fuzz
FyberSpider
Fyrebot
GermCrawler
GetRight
GetWeb
Gigablast
G-i-g-a-b-o-t
GoZilla
Go!Zilla
GrapeFX
HaosouSpider
Harvest
Heritrix
Indy Library
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
IRLbot
isitwp.com
Jbrofuzz
JetCar
JOC Web Spider
Jorgee
JustView
Jyxobot
Kozmosbot
Lanshanbot
LeechFTP
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
lwp-request
lwp-trivial
Masscan
Mass Downloader
Mb2345Browser
meanpathbot
Meanpathbot
MeanPath Bot
mediawords
MegaIndex.ru
MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
MQQBrowser
Mr.4x3
Msrabot
MTRobot
Navroad
Needle
netEstate NE Crawler
NetLyzer
NetMechanic
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Ninja
Offline Navigator
OrangeSpider
OutfoxBot
PageAnalyzer
Page Analyzer
PageThing.com
Pandalytics
pcBrowser
PECL::HTTP
Petalbot
PHPCrawl
Picsearch
Piepmatz
Pimonster
Pi-Monster
plumanalytics
POE-Component-Client-HTTP
ProWebWalker
Psbot
Pu_iN
Pump
RankActive
RankFlex
RebelMouse
ripz
Rogerbot
RSSingBot
SalesIntelligent
Scanbot
ScoutJet
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SeoSiteCheckup
SEOstats
serpstatbot
SISTRIX
Sitebeam
SiteCheckerBotCrawler
siteripz
Site Sucker
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sosospider
SpaceBison
Spammen
Spanner
sp_auditbot
Spbot
Spinn3r
spyfu
Sqworm
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
tAkeOut
Teleport
Telesphoreo
The Intraformant
Toata
Tracemyfile
Trendictionbot
trendiction.de
TurnitinBot
TwengaBot
Upflow
URLy Warning
URLy.Warning
Vagabondo
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot
WEBDAV
WebFetch
WebFuck
WebLeacher
WebPix
Web Pix
WebsiteExtractor
WebsiteQuester
Website Quester
Web Sucker
WebZIP
WeSEE
Whack
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wprecon
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
xpymep1.exe
YoudaoBot
Zade
Zauba
Zitebot
ZumBot
ZyBorg