404checker
404enemy
ALittle Client
Aboundexbot
Alexibot
AllSubmitter
AlphaBot
Anarchy99
Asterias
AwarioSmartBot
BLEXBot
BackWeb
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Bitacle
Black Hole
BlackWidow
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
Calculon
CherryPicker
Claritybot
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy
DIIbot
Demon
Deusu
Dirbuster
Disco
Discobot
Discoverybot
DomainCrawler
DomainStatsBot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
Ecxi
EirGrabber
Extractor
EyeNetIE
Firefox/7.0
Freeuploader
FyberSpider
GalaxyBot
GermCrawler
GetWeb
GoZilla
Gotit
GridBot
HEADMasterSEO
HTTP::Lite
HTTrack
Harvest
Heritrix
Hloader
HybridBot
Image Fetch
InfoNaviRobot
Internet Ninja
IstellaBot
Jbrofuzz
JikeSpider
Joomla
Keybot Translation-Search-Machine
Larbin
Leap
LeechGet
LexiBot
Lftp
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
MFC_Tear_Sample
MJ12bot
MTRobot
Majestic-SEO
Metauri
Mojeek
Mozlila
Msrabot
Musobot
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Nikto
Ninja
Not
Nutch
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Panscient
Papa Foto
Picscout
PictureFinder
Piepmatz
Pimonster
Pockey
Psbot
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
Rankivabot
Re-re
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
SMTBot
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
SentiBot
SiteSnagger
Siteimprove
SlySearch
Snapbot
Sosospider
SpankBot
Spanner
SputnikBot
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
Surfbot
SurveyBot
Suzuran
Swiftbot
TeleportPro
Telesphoreo
Toweyabot
Trendictionbot
TwengaBot
Typhoeus
URLy Warning
V-BOT
VB Project
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Enhancer
WebAuto
WebCopier
WebEnhancer
WebGo IS
WebReaper
WebSauger
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Webster
Whack
Who.is Bot
Widow
WinHTTrack
Woobot
Xaldon WebSpider
Xenu
Zade
Zeus
Zitebot
ZoomBot
ZumBot
arquivo-web-crawler
cah.io.community
check1.exe
coccocbot
cognitiveseo
com.plumanalytics
crawler4j
demandbase-bot
domainsproject.org
eCatch
instabid
isitwp.com
iubenda-radar
linkdexbot
lwp-request
netEstate NE Crawler
oBot
page scorer
scan.lol
seoscanners
sitechecker.pro
sogouspider
spyfu
webgains-bot
webpros.com
xpymep1.exe
zgrab