360Spider
404checker
80legs
ADmantX
AIBOT
ASPSeek
Abonti
Aboundexbot
AiHitBot
Aipbot
AllSubmitter
Anarchie
Anarchy
Anthill
Apexoo
Attach
Bandit
BlackWidow
Blow
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
Calculon
CensysInspect
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Cosmos
Craftbot
CrazyWebCrawler
Custo
CyotekWebCopy
DIIbot
Demon
Deusu
DigitalPebble
Disco
Dispatch
DnyzBot
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
ECCP/1.0
EMail Siphon
EasyDL
Ecxi
Evil
Exabot
Express WebPictures
Extractor
FDM
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
Go!Zilla
Gotit
Grafula
GrapeshotCrawler
GridBot
Heritrix
HonoluluBot
Humanlinks
IDBTE4M
IRLbot
Iblog
Image Sucker
InfoNaviRobot
Iria
JOC Web Spider
JetCar
Jetty
Joomla
Kenjin Spider
Kinza
LNSpiderguy
Larbin
LibWeb
Libwhisker
LinkScan
Linkbot
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
MIDown tool
MIIxpc
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
MarkMonitor
Masscan
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Minefield
Mojeek
Morfeus Fucking Scanner
Mozlila
Musobot
NearSite
NetSpider
Netcraft
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nmap
Not
Octopus
Offline Navigator
OnCrawl
OrangeSpider
POE-Component-Client-HTTP
Pandalytics
Papa Foto
Pavuk
Pi-Monster
PictureFinder
Piepmatz
Pimonster
ProWebWalker
Psbot
Pump
RSSingBot
RankingBot
ReGet
RealDownload
Reaper
Recorder
RepoMonkey
Ripper
SEOkicks
SEOlyticsCrawler
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitebeam
SmartDownload
Snake
SocialRankIOBot
Sogou web spider
SpaceBison
Sqlworm
Steeler
Sucker
SuperBot
SuperHTTP
SurveyBot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Toata
Tracemyfile
Trendiction
URLy Warning
UnisterBot
V-BOT
VB Project
VCI
VelenPublicWebCrawler
Virusdie
WEBDAV
WPScan
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Collage
Web Enhancer
WebBandit
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebWhacker
WebsiteExtractor
Webster
Whatweb
Widow
WinHTTrack
Wonderbot
Xaldon_WebSpider
YoudaoBot
Zade
ZmEu
ZumBot
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
clark-crawler
coccocbot-web
crawler4j
dataforseo.com
demandbase-bot
eCatch
heritrix
instabid
internetVista monitor
ips-agent
iubenda-radar
lwp-request
lwp-trivial
muhstik-scan
s1z.ru
satoristudio.net
scan.lol
seobility
seocompany.store
seoscanners
sogouspider
sp_auditbot
tAkeOut
trendiction.com
webgains-bot
webprosbot
xpymep1.exe
zauba.io