404checker
404enemy
ALittle Client
Abonti
Aboundex
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Apexoo
AwarioRssBot
BLEXBot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Bandit
BetaBot
Boardreader
Brandwatch
Buck
Bullseye
CCBot
CODE87
CazoodleBot
CheTeam
ChinaClaw
Chlooe
Claritybot
Cogentbot
Copier
Cosmos
Craftbot
DBLBot
DIIbot
Demon
Digincore
Dirbuster
Discobot
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
EMail Wolf
EasyDL
EirGrabber
EroCrawler
Express WebPictures
Firefox/7.0
FlashGet
Freeuploader
FrontPage
GT::WWW
Genieo
GermCrawler
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grafula
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HTTrack
Hloader
Humanlinks
IDBTE4M
IDBot
Iblog
IlseBot
Image Fetch
Indy Library
Iria
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Larbin
Leap
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkScan
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
MIDown tool
MSFrontPage
MSIECrawler
Majestic SEO
MauiBot
Mediatoolkitbot
MegaIndex.ru
Metauri
Mojolicious
Mozlila
Musobot
Name Intelligence
Navroad
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nuclei
Nutch
Offline Navigator
OnCrawl
OpenVAS
Openfind
OrangeSpider
PECL::HTTP
PHPCrawl
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Papa Foto
Pavuk
Picsearch
ProPowerBot
Probethenet
PyCurl
Quick-Crawler
RSSingBot
Rankivabot
RankurBot
Ripper
SEOkicks-Robot
SMTBot
ScoutJet
Scrapy
Screaming
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
Siphon
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sociscraper
SpankBot
Spanner
SputnikBot
Sqlmap
Sqlworm
Sqworm
Sucuri
Suzuran
Teleport
Telesphorep
Thumbor
Turingos
Turnitin
URLy Warning
Upflow
VB Project
VelenPublicWebCrawler
Virusdie
VoidEYE
WBSearchBot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Collage
Web Enhancer
WebBandit
WebCopier
WebEnhancer
WebLeacher
WebPix
WebReaper
WebStripper
WebWhacker
WebZIP
Webshag
Webster
Whack
Whatweb
Who.is Bot
WinHTTrack
Wotbox
Xenu
Zauba
Zermelo
Zeus
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
check1.exe
crawl.sogou.com
crawler.feedback
crawler4j
evc-batch
facebookscraper
gopher
isitwp.com
lwp-request
magpie-crawler
meanpathbot
page scorer
plumanalytics
ripz
scalaj-http
seobility
seostar
serpstatbot
sogouspider
sp_auditbot
ubermetrics-technologies.com
webmeup-crawler
x22Mozilla
xpymep1.exe
zgrab