360Spider
404checker
404enemy
ADmantX
ALittle Client
Aboundex
AhrefsBot
AiHitBot
Anthill
Aspiegel
AwarioSmartBot
BackStreet
Badass
Bandit
Bigfoot
Bitacle
BlackWidow
BlowFish
Boardreader
Brandprotect
Buddy
BuiltWith
CATExplorador
ChinaClaw
Chlooe
Cocolyzebot
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
CrunchBot
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Dirbuster
Discobot
Dispatch
DnyzBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
Ecxi
Express WebPictures
ExtLinksBot
ExtractorPro
FHscan
FemtosearchBot
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetRight
Gigabot
Go-Ahead-Got-It
GoZilla
Grabber
GridBot
HTMLparser
Haansoft
Harvest
Havij
HonoluluBot
IDBot
Iblog
Id-search
IlseBot
Indy Library
Intelliseek
InterGET
JamesBOT
Jetty
Jorgee
JustView
Kinza
LeechFTP
LeechGet
LexiBot
LieBaoFast
LinkWalker
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MIIxpc
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12
Masscan
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Moblie Safari
MolokaiBot
Musobot
NICErsPRO
Needle
Nessus
Net Vampire
NetLyzer
NetMechanic
NextGenSearchBot
Nibbler
Nikto
Nuclei
Offline Explorer
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PageGrabber
PageScorer
PageThing.com
Picsearch
PictureFinder
PleaseCrawl
ProWebWalker
Psbot
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
ReGet
RealDownload
RebelMouse
RedesScrapy
Ripper
Rogerbot
SEOkicks-Robot
SISTRIX
ScanAlert
ScrepyBot
Searchestate
Seekport
SemanticJuice
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
Sitebeam
Siteimprove
SlySearch
SmartDownload
Snoopy
Sociscraper
Sosospider
Spbot
Spinn3r
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
TheNomad
Toata
Toweyabot
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy.Warning
Vacuum
VeriCiteCrawler
VoidEYE
Voil
Voltron
WISENutbot
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebFetch
WebPix
WebReaper
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Webster
Whacker
Whatweb
Woobot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
ZoomBot
ZoominfoBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
clark-crawler
cognitiveseo
crawl.sogou.com
crawler4j
demandbase-bot
eCatch
evc-batch
facebookscraper
gopher
heritrix
ips-agent
isitwp.com
lwp-request
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
polaris version
probe-image-size
scan.lol
seobility
seostar
sexsearcher
siteripz
sogouspider
webgains-bot
x22Mozilla
zauba.io
zgrab