360Spider
Abonti
Aboundex
Aboundexbot
Acunetix
ADmantX
Aipbot
Alexibot
Anarchie
Apexoo
ASPSeek
Asterias
Attach
BackStreet
BackWeb
Badass
Bandit
Barkrowler
BDCbot
Bigfoot
Bitacle
Blackboard
BlackWidow
Blow
Brandprotect
BuiltBotTough
BuzzSumo
Calculon
CATExplorador
Cegbfeieh
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Collector
Copier
Craftbot
crawler.feedback
CrazyWebCrawler
Crescent
Custo
demandbase-bot
Demon
DigitalPebble
Discobot
Dispatch
DnyzBot
Drip
DTS Agent
EasyDL
EirGrabber
EroCrawler
evc-batch
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
Ezooms
FDM
FemtosearchBot
Foobot
FrontPage
Fyrebot
GalaxyBot
Genieo
Gigablast
Go-Ahead-Got-It
Gotit
Grabber
Grafula
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
Heritrix
Iblog
IDBot
Id-search
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
instabid
InterGET
Internet Ninja
ips-agent
Iria
Jbrofuzz
JetCar
Jetty
JOC Web Spider
Joomla
Jorgee
Jyxobot
Keyword Density
LeechFTP
LeechGet
LexiBot
Lightspeedsystems
Linkdexbot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
lwp-request
LWP::Simple
Magnet
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
meanpathbot
MeanPath Bot
Mediatoolkitbot
Metauri
MIDown tool
Mister PiX
Mojeek
Morfeus Fucking Scanner
MSIECrawler
muhstik-scan
Name Intelligence
NearSite
NetAnts
NetLyzer
NetSpider
Nettrack
Netvibes
NetZIP
NICErsPRO
Nikto
NPbot
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OrangeSpider
PageAnalyzer
page scorer
PageScorer
Panscient
pcBrowser
PHPCrawl
Picsearch
PictureFinder
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
PxBroker
RankingBot
RealDownload
Recorder
RedesScrapy
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
scan.lol
Screaming
SearchmetricsBot
SemrushBot
SEOkicks
SeoSiteCheckup
serpstatbot
Shodan
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SiteSucker
Sitevigil
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sosospider
Spammen
SpankBot
Spanner
sp_auditbot
Spbot
Sqlmap
Sqlworm
SuperBot
Surfbot
sysscan
T8Abot
The Intraformant
TheNomad
TightTwatBot
Titan
Tracemyfile
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
UnisterBot
Upflow
Vacuum
Vagabondo
VCI
VeriCiteCrawler
Voil
WASALive-Bot
Webalta
WebAuto
Web Auto
WebCollage
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
WebStripper
WebWhacker
WebZIP
Widow
WiseGuys Robot
WISENutbot
Wonderbot
Wprecon
WPScan
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon_WebSpider
Xenu
Zauba
zauba.io
Zeus
Zitebot
ZmEu