404checker
80legs
AIBOT
ALittle Client
Aboundex
AhrefsBot
AllSubmitter
Anarchy
Anarchy99
AwarioRssBot
BBBike
BDCbot
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Barkrowler
BatchFTP
Black Hole
Blow
Boardreader
BuiltWith
Bullseye
CCBot
CazoodleBot
CheTeam
CherryPicker
Chlooe
Citoid
Claritybot
Cogentbot
Collector
Craftbot
CrazyWebCrawler
Crescent
Custo
Dirbuster
Discobot
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Drip
EasyDL
EroCrawler
Evil
Exabot
Extractor
Ezooms
FemtosearchBot
FlashGet
Flunky
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GetRight
Go-Ahead-Got-It
GoZilla
Grabber
Grafula
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
HybridBot
IDBot
IRLbot
IlseBot
Indy Library
InfoTekies
Intelliseek
Internet Ninja
Iria
JOC Web Spider
Jbrofuzz
JikeSpider
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
MicroMessenger
Microsoft Data Access
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NPbot
Name Intelligence
Net Vampire
NetLyzer
Netvibes
NimbleCrawler
Nuclei
Octopus
Offline Explorer
Openfind
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PageScorer
PageThing.com
Pandalytics
Panscient
Pavuk
Pi-Monster
Piepmatz
Pockey
ProPowerBot
ProWebWalker
Pump
Quick-Crawler
Rankivabot
Ripper
SEOkicks-Robot
SISTRIX
SalesIntelligent
Scanbot
ScoutJet
Searchestate
SearchmetricsBot
SemanticJuice
SemrushBot
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SlySearch
Snake
SocialRankIOBot
Spammen
Spbot
Sqlworm
Sqworm
Steeler
Sucuri
SuperBot
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
The Intraformant
TheNomad
Titan
Toweyabot
TwengaBot
URLy Warning
Upflow
VCI
Vacuum
Vagabondo
VoidEYE
Voil
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Sauger
WebBandit
WebImageCollector
WebStripper
WebSucker
WebWhacker
Website Quester
Webster
Whack
Who.is Bot
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xenu
ZoomBot
ZoominfoBot
archive.org_bot
backlink-check
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
domainsproject.org
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
meanpathbot
mediawords
muhstik-scan
pcBrowser
plumanalytics
s1z.ru
scan.lol
seobility
seoscanners
seostar
sogouspider
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe