01h4x.com
360Spider
404enemy
ADmantX
AIBOT
Aboundex
Aboundexbot
Acunetix
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchy99
Aspiegel
BBBike
BDCbot
BDFetch
BLEXBot
BackStreet
BackWeb
Badass
Barkrowler
Bitacle
Boardreader
Buck
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
CODE87
Cegbfeieh
CheTeam
Cloud mapping
Cogentbot
Collector
Copier
Copyscape
Crawling at Home Project
CrunchBot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomCopBot
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Exabot
EyeNetIE
FHscan
Firefox/7.0
FlashGet
Fuzz
FyberSpider
Fyrebot
Gigabot
GoZilla
Gotit
GrabNet
Grafula
GridBot
HMView
HTMLparser
Humanlinks
HybridBot
IDBTE4M
IRLbot
Indy Library
Iria
Iskanie
JamesBOT
Jbrofuzz
Joomla
Kenjin Spider
Keyword Density
Leap
LeechFTP
LeechGet
LibWeb
Libwhisker
LinkWalker
LinksManager
Lipperhey
Litemage_walker
Lmspider
MQQBrowser
MSFrontPage
MTRobot
Mail.RU_Bot
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
MegaIndex.ru
MicroMessenger
Mozlila
Msrabot
Musobot
NPbot
Navroad
NearSite
Needle
Nessus
NetLyzer
Netvibes
Nuclei
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
POE-Component-Client-HTTP
PageScorer
Papa Foto
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
ReGet
RealDownload
RepoMonkey
Rogerbot
SISTRIX
ScanAlert
Scanbot
Screaming
ScrepyBot
SentiBot
SeobilityBot
Shodan
Site Sucker
SiteLockSpider
Siteimprove
SlySearch
Snake
Spammen
Spanner
Spinn3r
SputnikBot
Sqlmap
Sucker
Sucuri
SuperBot
SurveyBot
Szukacz
T8Abot
Teleport
The Intraformant
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turingos
Turnitin
UnisterBot
Upflow
Vacuum
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sauger
WebCopier
WebFetch
WebLeacher
WebSauger
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whatweb
WinHTTrack
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
ZmEu
ZoominfoBot
archive.org_bot
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
heritrix
internetVista monitor
isitwp.com
magpie-crawler
meanpathbot
mediawords
muhstik-scan
oBot
satoristudio.net
scalaj-http
seoscanners
seostar
serpstatbot
sogouspider
sp_auditbot
spyfu
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zgrab