360Spider
404checker
Aboundexbot
AiHitBot
Alligator
AllSubmitter
AlphaBot
Apexoo
arquivo-web-crawler
ASPSeek
Asterias
Attach
AwarioSmartBot
Backlink-Ceck
BackStreet
Badass
Barkrowler
BBBike
BDCbot
BDFetch
Bigfoot
Bitacle
Blackboard
BLEXBot
BlowFish
BuiltBotTough
Bullseye
Calculon
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cogentbot
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Cosmos
crawler4j
crawler.feedback
Crescent
CrunchBot
Curious
DatabaseDriverMysqli
DBLBot
demandbase-bot
Digincore
Dirbuster
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainStatsBot
Dotbot
Download Wonder
EasyDL
Ebingbong
eCatch
EirGrabber
EMail Siphon
EMail Wolf
evc-batch
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
FemtosearchBot
Fimap
FlashGet
Freeuploader
Fyrebot
GetRight
GetWeb
Go-Ahead-Got-It
GoZilla
GrapeshotCrawler
GridBot
GT::WWW
HaosouSpider
Havij
heritrix
Heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
HTTrack
Iblog
IDBot
IndeedBot
Indy Library
Intelliseek
InterGET
InternetSeer
ips-agent
Iria
Jetty
JOC Web Spider
Jorgee
JustView
Kenjin Spider
Keyword Density
Lftp
LibWeb
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
LWP::Simple
Mag-Net
Majestic SEO
MarkWatch
MauiBot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
MJ12bot
Mojolicious
Msrabot
NearSite
Nessus
NetAnts
NetLyzer
NetSpider
Netvibes
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
NPbot
Octopus
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
OutfoxBot
PageAnalyzer
PageGrabber
page scorer
PageScorer
Panscient
pcBrowser
Picsearch
PictureFinder
POE-Component-Client-HTTP
Pump
RankingBot2
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
ReGet
RepoMonkey
Rogerbot
s1z.ru
SBIder
ScanAlert
Scanbot
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SEOlyticsCrawler
Seomoz
SEOprofiler
Shodan
Sitebeam
SiteExplorer
Sitevigil
SlySearch
SMTBot
Snake
Snapbot
Sogou web spider
SpaceBison
SpankBot
Spanner
sp_auditbot
spyfu
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesphorep
The Intraformant
TightTwatBot
Titan
Trendiction
Trendictionbot
trendiction.com
True_Robot
Turingos
Turnitin
Typhoeus
Upflow
URLy.Warning
Vacuum
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WallpapersHD
WASALive-Bot
WebAuto
Web Collage
WebCopier
WEBDAV
WebEnhancer
WebFuck
WebLeacher
WebmasterWorldForumBot
WebPix
WebsiteExtractor
Webster
WebStripper
Web Sucker
WebWhacker
Whacker
Widow
Wonderbot
Woobot
Wotbox
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
YoudaoBot
zauba.io
ZumBot