404checker
Aboundexbot
Acunetix
ADmantX
AIBOT
AiHitBot
AllSubmitter
Apexoo
archive.org_bot
arquivo-web-crawler
ASPSeek
Asterias
Attach
Backlink-Ceck
backlink-check
Bandit
BDFetch
BetaBot
Bigfoot
Black Hole
BlackWidow
BLEXBot
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
CATExplorador
CazoodleBot
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
Copier
Copyscape
Cosmos
Craftbot
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Deusu
DIIbot
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Dragonfly
DTS Agent
EasyDL
ECCP/1.0
EirGrabber
EMail Wolf
Evil
Exabot
ExtLinksBot
ExtractorPro
FDM
FlashGet
Foobot
Freeuploader
FrontPage
GalaxyBot
GermCrawler
GetRight
Gigablast
Go-Ahead-Got-It
Go!Zilla
Grabber
Grafula
GridBot
Haansoft
Havij
HEADMasterSEO
HTMLparser
Iblog
IDBot
Id-search
IlseBot
IndeedBot
InfoNaviRobot
Internet Ninja
IRLbot
IstellaBot
Jbrofuzz
JennyBot
Jetty
Joomla
Jorgee
JustView
Kenjin Spider
Kozmosbot
Larbin
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
LNSpiderguy
Ltx71
Magnet
Mag-Net
Majestic-SEO
Masscan
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
MIIxpc
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
Msrabot
Name Intelligence
NearSite
Needle
NetAnts
Netcraft
NetMechanic
Nettrack
NetZIP
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nmap
Nutch
Octopus
Offline Navigator
Openfind
OpenLinkProfiler
Openvas
OpenVAS
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PageScorer
Pavuk
PECL::HTTP
PeoplePal
Pimonster
PleaseCrawl
Probethenet
ProPowerBot
PxBroker
QueryN Metasearch
RankActive
RankingBot
RankingBot2
Rankivabot
RealDownload
RebelMouse
Recorder
RepoMonkey
Ripper
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
SBIder
ScanAlert
Scanbot
Scrapy
SemrushBot
SEOkicks
SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup
SEOstats
sexsearcher
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
SMTBot
Snoopy
Sociscraper
Sogou web spider
Spammen
SpankBot
Spinn3r
Steeler
Sucker
Sucuri
SuperBot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
tAkeOut
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Trendiction
trendiction.com
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
Vagabondo
VeriCiteCrawler
WallpapersHD
WBSearchBot
WebAuto
Web Auto
WebBandit
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebFetch
WebFuck
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebSauger
WebsiteQuester
WebSucker
Web Sucker
WebWhacker
WebZIP
WeSEE
Whacker
Whatweb
Who.is Bot
Wonderbot
Woobot
WWW::Mechanize
x22Mozilla
YoudaoBot
Zade
Zermelo
Zeus
ZyBorg