404checker
404enemy
ADmantX
ALittle Client
Aboundex
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchie
Anarchy
Ankit
Anthill
Aspiegel
Asterias
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BackStreet
BackWeb
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Blow
BlowFish
Bolt
BunnySlippers
BuzzSumo
CSHttp
Calculon
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Chlooe
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrunchBot
CyotekWebCopy
DBLBot
Demon
Deusu
Devil
Digincore
DigitalPebble
Disco
Dispatch
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
Ebingbong
EroCrawler
Evil
Exabot
Extreme Picture Finder
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
GetRight
Getintent
Go-Ahead-Got-It
GrapeshotCrawler
GridBot
HMView
HTTrack
Haansoft
Heritrix
HonoluluBot
IDBTE4M
Image Fetch
IndeedBot
Indy Library
InterGET
IstellaBot
Joomla
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LeechFTP
LeechGet
LexiBot
LibWeb
LinkWalker
Linkbot
LinkextractorPro
Lipperhey
Lmspider
Ltx71
MIIxpc
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
Mb2345Browser
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Mojeek
MolokaiBot
Musobot
NICErsPRO
NPbot
Name Intelligence
NearSite
NetAnts
NetLyzer
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Not
Nutch
Octopus
Openfind
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Petalbot
Picscout
ProPowerBot
Pu_iN
Pump
PxBroker
RSSingBot
RankFlex
RankingBot2
RankurBot
ReGet
RealDownload
RebelMouse
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
SemanticJuice
SemrushBot
SeoSiteCheckup
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
SlySearch
SmartDownload
Sogou web spider
Sottopop
SpaceBison
Spammen
SpankBot
Sqworm
Stripper
Swiftbot
Szukacz
T8Abot
TeleportPro
Telesoft
The Intraformant
Trendiction
Trendictionbot
Turingos
TwengaBot
Twice
URLy Warning
UnisterBot
V-BOT
VB Project
Vacuum
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers
Web Auto
Web Collage
WebAuto
WebCollage
WebCopier
WebFetch
WebReaper
WebStripper
WebSucker
WebWhacker
Webshag
WebsiteExtractor
Webster
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
ZmEu
ZoomBot
ZoominfoBot
adscanner
arquivo-web-crawler
clark-crawler
coccocbot
crawl.sogou.com
crawler4j
eCatch
gopher
heritrix
ips-agent
linkdexbot
magpie-crawler
meanpathbot
probe-image-size
satoristudio.net
seobility
serpstatbot
siteripz
sogouspider
trendiction.de
ubermetrics-technologies.com
voyagerx.com
x09Mozilla