80legs
ADmantX
AIBOT
ASPSeek
Abonti
Aboundex
AiHitBot
Alexibot
Anarchy
Ankit
Anthill
Aspiegel
Attach
BBBike
BDCbot
BDFetch
BackStreet
BackWeb
BacklinkCrawler
Badass
Bandit
Barkrowler
Bigfoot
Blackboard
BlowFish
Buck
Bullseye
BuzzSumo
CODE87
CherryPicker
Chlooe
Cogentbot
CopyRightCheck
Copyscape
Crescent
CrunchBot
DBLBot
DatabaseDriverMysqli
Devil
DigitalPebble
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainStatsBot
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
FemtosearchBot
Fimap
Firefox/7.0
Foobot
Freeuploader
Genieo
GermCrawler
GetRight
GetWeb
Getintent
Gigabot
GoZilla
Gotit
GrabNet
Grabber
GrapeshotCrawler
HTTrack
Haansoft
HaosouSpider
Harvest
Humanlinks
HybridBot
Id-search
IlseBot
Image Sucker
InterGET
InternetSeer
Iria
Iskanie
IstellaBot
Jbrofuzz
JennyBot
Joomla
Jorgee
Keyword Density
Kozmosbot
Leap
LeechFTP
LexiBot
Lftp
LieBaoFast
Lightspeedsystems
Linkbot
LinkpadBot
LinqiaScrapeBot
Litemage_walker
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
MarkWatch
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NICErsPRO
Nessus
Net Vampire
NetMechanic
NetZIP
Niki-bot
Nikto
Openfind
Openvas
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Pandalytics
Papa Foto
Petalbot
Pi-Monster
Picscout
Piepmatz
Pixray
PleaseCrawl
Pu_iN
RankActive
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
Reaper
Recorder
RedesScrapy
Ripper
RocketCrawler
SEOkicks
SEOlyticsCrawler
SalesIntelligent
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
Seekport
SemanticJuice
Semrush
SemrushBot
Shodan
Siphon
SiteExplorer
SiteSnagger
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spbot
Spinn3r
SputnikBot
Sqlmap
Steeler
Stripper
Sucker
Sucuri
SuperHTTP
Swiftbot
The Intraformant
TightTwatBot
Trendictionbot
True_Robot
TwengaBot
Twice
Typhoeus
URLy Warning
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WBSearchBot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Pix
WebBandit
WebEnhancer
WebFuck
WebImageCollector
WebStripper
Webalta
WebmasterWorldForumBot
WebsiteQuester
Widow
Woobot
YoudaoBot
Zade
Zauba
Zermelo
ZmEu
ZumBot
clark-crawler
cognitiveseo
domainsproject.org
gopher
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
plumanalytics
polaris version
ripz
satoristudio.net
serpstatbot
sp_auditbot
spyfu
sysscan
tAkeOut
webpros.com