360Spider
80legs
Aboundex
Aboundexbot
AIBOT
AiHitBot
Alexibot
Anarchie
Apexoo
Asterias
Attach
autoemailspider
BacklinkCrawler
BackStreet
Badass
BatchFTP
Battleztar Bazinga
BDFetch
Bigfoot
Blackboard
Black Hole
BLEXBot
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
Buddy
BuiltWith
Calculon
CCBot
Cegbfeieh
CheeseBot
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Copier
CopyRightCheck
crawl.sogou.com
Crescent
CrunchBot
CSHttp
Curious
Custo
DatabaseDriverMysqli
Deusu
Devil
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
Dispatch
DomainSigmaCrawler
Dotbot
Drip
DTS Agent
ECCP/1.0
EroCrawler
Exabot
ExtLinksBot
Ezooms
facebookscraper
FDM
FemtosearchBot
Fimap
FlashGet
Freeuploader
FrontPage
FyberSpider
GetWeb
Gigablast
Go-Ahead-Got-It
Go!Zilla
Grabber
GrapeFX
GrapeshotCrawler
Haansoft
HaosouSpider
Heritrix
HTTrack
Humanlinks
HybridBot
Image Fetch
Image Sucker
Indy Library
instabid
Intelliseek
Internet Ninja
InternetSeer
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
JetCar
JikeSpider
JOC Web Spider
Joomla
Jorgee
JustView
Jyxobot
Keyword Density
Kozmosbot
Lanshanbot
LexiBot
Lftp
Lightspeedsystems
LinkWalker
LinqiaRSSBot
Lipperhey Spider
LNSpiderguy
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
Metauri
Microsoft Data Access
MIDown tool
MJ12bot
MSIECrawler
MS Web Services Client Protocol
muhstik-scan
Musobot
Name Intelligence
Navroad
NearSite
Needle
Nessus
netEstate NE Crawler
NetSpider
Nettrack
NextGenSearchBot
NICErsPRO
Niki-bot
NimbleCrawler
Ninja
Nmap
NPbot
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PageGrabber
page scorer
PageScorer
Panscient
Papa Foto
PECL::HTTP
PHPCrawl
Picscout
Picsearch
PictureFinder
Pixray
plumanalytics
Pockey
POE-Component-Client-HTTP
Probethenet
Psbot
Pump
Quick-Crawler
RankActive
RankurBot
RebelMouse
ReGet
RepoMonkey
Rogerbot
ScanAlert
scan.lol
ScreenerBot
Searchestate
Semrush
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
serpstatbot
sexsearcher
SiteLockSpider
SiteSnagger
Site Sucker
Sitevigil
Snake
SocialRankIOBot
Sogou web spider
SpaceBison
SpankBot
Spanner
spyfu
Sqlmap
Sqworm
Steeler
Sucuri
SuperHTTP
Surfbot
SurveyBot
sysscan
T0PHackTeam
Teleport
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
trendiction.com
Turingos
TwengaBot
UnisterBot
Upflow
URLy Warning
URLy.Warning
Vagabondo
VB Project
VCI
WASALive-Bot
WBSearchBot
WebAuto
WebBandit
Web Collage
WebEnhancer
WebLeacher
WebmasterWorldForumBot
WebSauger
WebSucker
Web Sucker
WebWhacker
WeSEE
Whack
Whacker
Whatweb
WinHTTrack
Wonderbot
Woobot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
Zauba