360Spider
404enemy
AIBOT
ALittle Client
Abonti
Aboundex
Aboundexbot
Acunetix
AiHitBot
Alligator
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BLEXBot
BatchFTP
BetaBot
Bigfoot
Boardreader
Bolt
Brandwatch
Buddy
BuiltBotTough
Bullseye
CCBot
CensysInspect
CheTeam
CheeseBot
Chlooe
Cloud mapping
Cogentbot
Collector
Copier
DBLBot
DIIbot
DataCha0s
Deusu
Disco
DittoSpyder
DnBCrawler-Analytics
Domains Project
Download Wonder
Ebingbong
EroCrawler
Evil
Extractor
ExtractorPro
Ezooms
FHscan
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
Fyrebot
GT::WWW
Genieo
GoZilla
Gotit
Grabber
GrapeshotCrawler
GridBot
HTTrack
Haansoft
Havij
Hloader
HonoluluBot
Image Sucker
InfoNaviRobot
Intelliseek
InternetSeer
Iria
Iskanie
JOC Web Spider
JamesBOT
JikeSpider
Joomla
Kenjin Spider
Keyword Density
LNSpiderguy
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Musobot
Nameprotect
NetAnts
NetLyzer
Nibbler
Niki-bot
Nikto
Ninja
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OutclicksBot
PHPCrawl
Page Analyzer
PageScorer
Pandalytics
Panscient
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
PleaseCrawl
ProPowerBot
ProWebWalker
Pump
RankActiveLinkBot
RankingBot
Re-re
RealDownload
RebelMouse
Recorder
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
ScoutJet
ScreenerBot
Searchestate
SemanticJuice
SeobilityBot
SiteLockSpider
Siteimprove
Sitevigil
SlySearch
Snake
Snoopy
SocialRankIOBot
SpaceBison
Spbot
Stripper
SuperHTTP
Surfbot
SurveyBot
Swiftbot
T0PHackTeam
T8Abot
Telesphoreo
Thumbor
Titan
Trendictionbot
True_Robot
Turingos
TurnitinBot
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
VB Project
VCI
Vacuum
VeriCiteCrawler
VoidEYE
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
WebCollage
WebFuck
WebGo IS
WebLeacher
WebReaper
Webalta
Webshag
Website Quester
WebsiteQuester
Webster
Whacker
Whatweb
Zermelo
arquivo-web-crawler
autoemailspider
cah.io.community
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
evc-batch
instabid
internetVista monitor
ips-agent
iubenda-radar
linkdexbot
magpie-crawler
page scorer
pcBrowser
polaris version
s1z.ru
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
x09Mozilla
x22Mozilla
zgrab