360Spider
404checker
80legs
AIBOT
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
Anarchie
Apexoo
Asterias
Attach
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
BatchFTP
BlackWidow
Blow
BlowFish
BuiltWith
Bullseye
CATExplorador
CODE87
CSHttp
Cegbfeieh
CensysInspect
CherryPicker
Cogentbot
Collector
Copier
Cosmos
Craftbot
Crawling at Home Project
Crescent
Custo
DatabaseDriverMysqli
Demon
Deusu
DigitalPebble
Dirbuster
Discobot
Discoverybot
DnyzBot
DomCopBot
Dotbot
Dragonfly
EasyDL
Ebingbong
EirGrabber
Evil
Exabot
Extractor
Extreme Picture Finder
Ezooms
FDM
FHscan
Firefox/7.0
Freeuploader
FrontPage
Fyrebot
GalaxyBot
Go-Ahead-Got-It
GrabNet
GridBot
HTMLparser
Harvest
Hloader
IRLbot
Iblog
IlseBot
Indy Library
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Joomla
Jorgee
LNSpiderguy
Leap
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
Magnet
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Musobot
NICErsPRO
Name Intelligence
NearSite
Nessus
Net Vampire
NetLyzer
NetMechanic
Netcraft
NextGenSearchBot
Nibbler
Ninja
Not
Nuclei
Octopus
Offline Explorer
OpenVAS
OrangeBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Panscient
Papa Foto
Picscout
Picsearch
Pimonster
Psbot
Pu_iN
PyCurl
QueryN Metasearch
Rankivabot
RebelMouse
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Scanbot
Scrapy
SemanticJuice
SentiBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SmartDownload
Sociscraper
Sogou web spider
Sottopop
Sqlworm
Sqworm
Stripper
Sucuri
SurveyBot
Suzuran
T8Abot
Telesphoreo
The Intraformant
Thumbor
Titan
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
URLy.Warning
UnisterBot
Vacuum
Vagabondo
VeriCiteCrawler
Virusdie
Voil
Voltron
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Fetch
Web Pix
Web Sauger
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebReaper
WebSauger
Webshag
Website Quester
Webster
Whacker
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wotbox
Xenu
YoudaoBot
Zeus
ZoominfoBot
ZyBorg
autoemailspider
clark-crawler
coccocbot-web
com.plumanalytics
dataforseo.com
domainsproject.org
facebookscraper
internetVista monitor
lwp-trivial
meanpathbot
netEstate NE Crawler
page scorer
pcBrowser
s1z.ru
satoristudio.net
seoscanners
seostar
sexsearcher
sitechecker.pro
siteripz
sogouspider
spyfu
tAkeOut
trendiction.de
webprosbot
x09Mozilla
x22Mozilla
zauba.io
zgrab