360Spider
80legs
Aboundexbot
ADmantX
AIBOT
Alexibot
Alligator
AllSubmitter
AlphaBot
Anarchie
archive.org_bot
arquivo.pt
arquivo-web-crawler
Aspiegel
ASPSeek
AwarioRssBot
Backlink-Ceck
BacklinkCrawler
BackWeb
Battleztar Bazinga
BBBike
BDFetch
BetaBot
Bitacle
Blackboard
Black Hole
BlackWidow
BLEXBot
Blow
BlowFish
Bolt
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
CheTeam
Chlooe
Cloud mapping
Cogentbot
cognitiveseo
crawler4j
CrunchBot
CSHttp
Custo
DatabaseDriverMysqli
DBLBot
Deusu
Devil
Dirbuster
Disco
Discobot
DittoSpyder
DomainCrawler
Download Wonder
Dragonfly
EasyDL
ECCP/1.0
EMail Siphon
EMail Wolf
EroCrawler
Evil
Exabot
Express WebPictures
EyeNetIE
Ezooms
facebookscraper
FDM
Flunky
Fyrebot
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
GoZilla
Grabber
GrabNet
Grafula
GrapeFX
Haansoft
Harvest
Havij
heritrix
Heritrix
Hloader
HMView
HTMLparser
HybridBot
Iblog
IlseBot
Image Fetch
InfoNaviRobot
InfoTekies
ips-agent
IRLbot
IstellaBot
JetCar
Jetty
JikeSpider
Joomla
Jorgee
JustView
Kozmosbot
Libwhisker
LinkScan
LinkWalker
LinqiaScrapeBot
LNSpiderguy
Ltx71
Magnet
Majestic12
Masscan
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
mediawords
Microsoft Data Access
Microsoft URL Control
MIDown tool
Mister PiX
Morfeus Fucking Scanner
MQQBrowser
Mr.4x3
MSIECrawler
Msrabot
Nameprotect
Navroad
Nessus
NetAnts
netEstate NE Crawler
NetSpider
Nettrack
Net Vampire
Netvibes
NetZIP
Nibbler
Nikto
NPbot
oBot
Offline Navigator
Openfind
OpenLinkProfiler
Openvas
OPPO A33
Page Analyzer
PageScorer
Panscient
Picsearch
Pockey
POE-Component-Client-HTTP
polaris version
Probethenet
ProWebWalker
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot2
RankurBot
RealDownload
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SalesIntelligent
Scrapy
Screaming
Searchestate
Semrush
SEOkicks
SEOlyticsCrawler
SEOprofiler
serpstatbot
sexsearcher
Siteimprove
SiteSnagger
Site Sucker
SlySearch
SMTBot
Snoopy
SocialRankIOBot
Sosospider
Sottopop
SpaceBison
SpankBot
Spinn3r
spyfu
Sqlmap
Sqworm
Sucuri
SuperBot
Surfbot
Szukacz
T8Abot
tAkeOut
TeleportPro
TheNomad
Toata
Tracemyfile
trendiction.com
True_Robot
Turnitin
TurnitinBot
Twice
Upflow
URLy Warning
Vacuum
VB Project
VCI
VidibleScraper
VoidEYE
WallpapersHD
WBSearchBot
WebAuto
WebBandit
WebCollage
WebCopier
WEBDAV
WebFetch
WebLeacher
WebmasterWorldForumBot
WebPix
Web Pix
WebSauger
WebsiteQuester
Website Quester
Webster
WebStripper
Web Sucker
WeSEE
Whack
Whacker
Whatweb
Widow
WinHTTrack
Wprecon
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Xaldon WebSpider
xpymep1.exe
Zade
Zauba
Zermelo
Zeus