360Spider
80legs
Aboundexbot
Acunetix
AIBOT
AiHitBot
Aipbot
Alligator
Apexoo
ASPSeek
autoemailspider
AwarioRssBot
AwarioSmartBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
BackWeb
Bandit
Bolt
Buddy
BuzzSumo
Calculon
CATExplorador
Cegbfeieh
CheeseBot
Cliqzbot
cognitiveseo
Collector
com.plumanalytics
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Custo
Devil
Digincore
DigitalPebble
DIIbot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Drip
Ebingbong
eCatch
ECCP/1.0
Ecxi
EMail Siphon
EroCrawler
evc-batch
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
facebookscraper
Freeuploader
FrontPage
GalaxyBot
Genieo
GermCrawler
Gigablast
Gotit
Go!Zilla
GrabNet
Grafula
GridBot
Harvest
Havij
Hloader
HMView
HTMLparser
HTTP::Lite
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
Intelliseek
internetVista monitor
ips-agent
Iria
Iskanie
JamesBOT
JennyBot
Jetty
JikeSpider
JOC Web Spider
Joomla
Lanshanbot
Lightspeedsystems
Likse
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
LNSpiderguy
Ltx71
lwp-trivial
magpie-crawler
MarkWatch
Masscan
Mass Downloader
MauiBot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Musobot
Name Intelligence
Nameprotect
Needle
Nessus
NetAnts
Netcraft
NetMechanic
NetSpider
Netvibes
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Nimbostratus
Octopus
Offline Explorer
OnCrawl
OpenVAS
OrangeBot
OrangeSpider
Page Analyzer
Papa Foto
PeoplePal
Picscout
Picsearch
Pi-Monster
plumanalytics
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Psbot
RankActive
RankActiveLinkBot
RankFlex
RankurBot
RealDownload
RebelMouse
ReGet
Ripper
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SEOkicks
SEOprofiler
seoscanners
serpstatbot
Shodan
Siphon
Sitebeam
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
Snake
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spammen
SpankBot
sp_auditbot
spyfu
Sqworm
Surfbot
Swiftbot
sysscan
T0PHackTeam
Teleport
TeleportPro
The Intraformant
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.de
True_Robot
TurnitinBot
Twice
URLy.Warning
Vagabondo
VCI
Virusdie
VoidEYE
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WBSearchBot
WebCopier
WEBDAV
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebReaper
WebSauger
Webshag
Website Quester
Web Sucker
WeSEE
Whack
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
Wprecon
WWW-Collector-E
WWW::Mechanize
Xaldon WebSpider
Zade
Zauba
Zeus
zgrab
Zitebot
ZmEu
ZumBot