360Spider
404checker
404enemy
ADmantX
ASPSeek
Abonti
Aboundex
AiHitBot
Alligator
AlphaBot
Anarchy99
Anthill
Aspiegel
AwarioSmartBot
BBBike
Backlink-Ceck
Badass
Bandit
BatchFTP
Blow
BlowFish
Boardreader
Brandprotect
Buck
BunnySlippers
CSHttp
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Citoid
Copier
Crescent
Curious
CyotekWebCopy
DTS Agent
Deusu
Discobot
DomainCrawler
DomainStatsBot
Download Wonder
ECCP/1.0
EMail Siphon
Ebingbong
Exabot
ExtLinksBot
EyeNetIE
Ezooms
FemtosearchBot
Fuzz
FyberSpider
Genieo
GermCrawler
GetRight
Go!Zilla
Grafula
GrapeFX
HTTP::Lite
HTTrack
Havij
Hloader
HonoluluBot
HybridBot
IDBTE4M
IDBot
IlseBot
Image Fetch
Image Sucker
Intelliseek
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jetty
Jorgee
JustView
Jyxobot
Keyword Density
Kinza
Lanshanbot
Larbin
Leap
LeechFTP
LeechGet
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
MTRobot
Majestic SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Nessus
Net Vampire
NetLyzer
NetMechanic
Netvibes
NextGenSearchBot
Nimbostratus
Not
Nutch
OnCrawl
OpenVAS
Openvas
OrangeSpider
PECL::HTTP
PageGrabber
PageThing.com
Panscient
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picsearch
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Pump
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot2
RankurBot
Re-re
RealDownload
Recorder
RedesScrapy
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
ScanAlert
Scrapy
Screaming
Searchestate
SearchmetricsBot
Semrush
SeobilityBot
Site Sucker
SiteLockSpider
SiteSucker
Sitebeam
SlySearch
Snake
Sogou web spider
SpaceBison
SpankBot
Spanner
Spinn3r
SputnikBot
Sqworm
Steeler
Surfbot
SurveyBot
Szukacz
Telesoft
True_Robot
Turingos
Turnitin
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
V-BOT
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WWW-Collector-E
WeSEE
Web Enhancer
Web Sauger
WebEnhancer
WebFuck
WebGo IS
WebSauger
WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
Whack
Whacker
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wotbox
Wprecon
Zade
Zermelo
Zeus
Zitebot
ZmEu
adscanner
arquivo-web-crawler
arquivo.pt
dataforseo.com
domainsproject.org
eCatch
iubenda-radar
lwp-trivial
magpie-crawler
mediawords
muhstik-scan
oBot
plumanalytics
polaris version
ripz
s1z.ru
seobility
serpstatbot
sexsearcher
siteripz
sogouspider
spyfu
tAkeOut
voyagerx.com
webgains-bot
x22Mozilla