404checker
404enemy
80legs
Abonti
Acunetix
ADmantX
AiHitBot
Aipbot
Alligator
Ankit
ASPSeek
Asterias
autoemailspider
AwarioRssBot
backlink-check
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
BDCbot
BetaBot
Bitacle
Blackboard
BlackWidow
BlowFish
Boardreader
Brandprotect
BuiltBotTough
BuiltWith
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
ChinaClaw
Cliqzbot
Cloud mapping
coccocbot-web
Collector
Copier
Craftbot
crawler.feedback
crawl.sogou.com
CrunchBot
Curious
DataCha0s
demandbase-bot
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Discoverybot
DittoSpyder
DomainAppender
domainsproject.org
Dotbot
Download Wonder
Drip
DTS Agent
eCatch
EMail Siphon
evc-batch
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
FDM
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Foobot
Freeuploader
FyberSpider
Fyrebot
Genieo
Gigabot
Go-Ahead-Got-It
GoZilla
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GT::WWW
Harvest
Hloader
HybridBot
Iblog
Image Fetch
InfoTekies
Intelliseek
internetVista monitor
ips-agent
IRLbot
isitwp.com
Jbrofuzz
JetCar
JikeSpider
Jorgee
JustView
Kozmosbot
Lanshanbot
LeechFTP
LibWeb
Likse
Linkdexbot
LinkScan
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
LNSpiderguy
lwp-trivial
magpie-crawler
MarkWatch
Mata Hari
Mb2345Browser
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
Musobot
Name Intelligence
Nameprotect
NearSite
Nessus
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
Nettrack
NextGenSearchBot
Niki-bot
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OPPO A33
OutfoxBot
PageGrabber
PageScorer
Papa Foto
Pavuk
pcBrowser
PeoplePal
PHPCrawl
PictureFinder
Pimonster
Pockey
POE-Component-Client-HTTP
polaris version
ProPowerBot
Pump
PyCurl
RankActive
RankingBot
RealDownload
RedesScrapy
ReGet
Rogerbot
RSSingBot
s1z.ru
ScanAlert
ScoutJet
Scrapy
Screaming
Searchestate
SEOkicks-Robot
SEOprofiler
seoscanners
SeoSiteCheckup
SISTRIX
Sitebeam
SiteCheckerBotCrawler
SiteExplorer
Siteimprove
SiteLockSpider
Site Sucker
SMTBot
Snake
Snoopy
SocialRankIOBot
sogouspider
Sosospider
Sottopop
Spammen
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
spyfu
Stripper
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
T0PHackTeam
tAkeOut
Teleport
Telesoft
Telesphoreo
TheNomad
Tracemyfile
Trendictionbot
Typhoeus
UnisterBot
Upflow
URLy.Warning
Vacuum
VB Project
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WebAuto
WEBDAV
WebEnhancer
Web Enhancer
WebImageCollector
WebLeacher
webmeup-crawler
WebPix
Web Pix
Web Sauger
Webshag
WebWhacker
Whack
WiseGuys Robot
Wotbox
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xenu
xpymep1.exe
YoudaoBot
Zade
zauba.io
Zermelo
ZmEu
ZyBorg