404checker
Acunetix
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
archive.org_bot
Asterias
AwarioRssBot
Backlink-Ceck
Bandit
Barkrowler
Bitacle
Black Hole
BotALot
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CheeseBot
CherryPicker
Chlooe
Cogentbot
Collector
com.plumanalytics
Copyscape
Cosmos
Craftbot
crawl.sogou.com
Crescent
CSHttp
DataCha0s
Demon
Devil
Digincore
DigitalPebble
DIIbot
Disco
Dispatch
DittoSpyder
DomainAppender
Dotbot
Drip
DSearch
eCatch
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Firefox/7.0
FlashGet
Freeuploader
GalaxyBot
GetRight
GetWeb
Gigablast
Go-Ahead-Got-It
Grabber
GrabNet
Grafula
GrapeFX
GridBot
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
HTTrack
Humanlinks
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
instabid
InterGET
InternetSeer
internetVista monitor
IstellaBot
Joomla
JustView
Jyxobot
Kozmosbot
Likse
LinkextractorPro
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
Mag-Net
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
Mojeek
Msrabot
muhstik-scan
NearSite
Needle
netEstate NE Crawler
Net Vampire
NextGenSearchBot
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nutch
oBot
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PageScorer
pcBrowser
PECL::HTTP
PHPCrawl
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
Psbot
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RealDownload
Reaper
Recorder
RepoMonkey
RocketCrawler
SalesIntelligent
SBIder
Scanbot
Scrapy
Screaming
ScreenerBot
Searchestate
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SeoSiteCheckup
serpstatbot
SISTRIX
Siteimprove
SiteLockSpider
SiteSnagger
Sitevigil
SocialRankIOBot
Sociscraper
SpaceBison
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Steeler
SurveyBot
Szukacz
tAkeOut
Telesoft
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Trendictionbot
trendiction.com
True_Robot
Turnitin
TurnitinBot
UnisterBot
Upflow
Vacuum
Voil
Voltron
Wallpapers/3.0
Webalta
WebAuto
WebBandit
WebCollage
Web Collage
WEBDAV
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
Web Sauger
WebsiteQuester
Webster
WebStripper
Web Sucker
WebWhacker
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wotbox
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Xaldon_WebSpider
YoudaoBot
zauba.io
Zermelo
Zeus
zgrab
ZmEu