360Spider
80legs
AIBOT
Aboundex
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchie
Anarchy99
Ankit
Aspiegel
Attach
BDCbot
BDFetch
BatchFTP
BetaBot
Bitacle
Blackboard
Bolt
Brandwatch
Buck
Buddy
Bullseye
BuzzSumo
CATExplorador
Calculon
Cegbfeieh
CensysInspect
ChinaClaw
Cliqzbot
Cloud mapping
Copier
CopyRightCheck
CrazyWebCrawler
Curious
CyotekWebCopy
DIIbot
DTS Agent
Demon
Deusu
Dirbuster
Disco
Discoverybot
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Drip
EMail Siphon
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
Fimap
Freeuploader
FrontPage
Fuzz
Genieo
GermCrawler
Go!Zilla
Grabber
Grafula
GrapeFX
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Haansoft
Humanlinks
IDBot
IRLbot
IlseBot
IndeedBot
Indy Library
InterGET
JamesBOT
Jbrofuzz
JetCar
Jetty
Kenjin Spider
Kinza
LeechGet
LexiBot
Lightspeedsystems
LinkScan
Linkbot
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
MIDown tool
MIIxpc
MJ12bot
MSIECrawler
Mag-Net
Magnet
Majestic-SEO
Majestic12
Mata Hari
Mb2345Browser
Meanpathbot
Metauri
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
NetLyzer
Nettrack
Niki-bot
Nikto
Nimbostratus
Nutch
Octopus
Offline Navigator
OnCrawl
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pavuk
PeoplePal
Petalbot
Picscout
Piepmatz
Pimonster
Pixray
Probethenet
Psbot
Pump
PyCurl
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
ReGet
RebelMouse
Recorder
RedesScrapy
Ripper
RocketCrawler
SalesIntelligent
ScanAlert
ScoutJet
ScreenerBot
Searchestate
Seomoz
Shodan
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Sitevigil
Snapbot
Sogou web spider
Sottopop
SpankBot
Spinn3r
Sqlworm
Stripper
Sucker
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
The Intraformant
Titan
Trendictionbot
True_Robot
Typhoeus
Upflow
V-BOT
VelenPublicWebCrawler
VidibleScraper
Virusdie
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
WebBandit
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebLeacher
WebReaper
WebSauger
WebSucker
Webshag
Who.is Bot
Wonderbot
Wprecon
Xaldon_WebSpider
Zade
Zauba
Zermelo
Zitebot
ZumBot
ZyBorg
archive.org_bot
autoemailspider
backlink-check
cah.io.community
coccocbot-web
cognitiveseo
crawler.feedback
domainsproject.org
eCatch
gopher
internetVista monitor
isitwp.com
lwp-trivial
meanpathbot
muhstik-scan
oBot
pcBrowser
polaris version
probe-image-size
scalaj-http
scan.lol
seoscanners
seostar
serpstatbot
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com