360Spider
Abonti
Acunetix
ADmantX
AhrefsBot
AIBOT
AiHitBot
Aipbot
AlphaBot
Apexoo
archive.org_bot
Asterias
BackStreet
BBBike
BetaBot
BLEXBot
Blow
BlowFish
Boardreader
Bolt
Buddy
BunnySlippers
CATExplorador
CazoodleBot
Cliqzbot
Cloud mapping
Collector
Copyscape
Craftbot
crawler.feedback
CrazyWebCrawler
CrunchBot
Custo
DatabaseDriverMysqli
DBLBot
Deusu
Digincore
DigitalPebble
DIIbot
Dirbuster
Disco
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
Download Wonder
Dragonfly
Drip
DSearch
eCatch
ECCP/1.0
Ecxi
EirGrabber
evc-batch
Evil
Exabot
ExtractorPro
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
Firefox/7.0
FlashGet
Freeuploader
Genieo
GermCrawler
GetRight
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
Go!Zilla
GrabNet
Grafula
GT::WWW
HaosouSpider
Havij
HEADMasterSEO
Heritrix
HTMLparser
HTTP::Lite
Humanlinks
Image Fetch
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
IRLbot
JamesBOT
JennyBot
Jetty
JikeSpider
JOC Web Spider
Joomla
Jorgee
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
Lftp
LibWeb
Linkdexbot
LinkextractorPro
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lmspider
lwp-request
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
MFC_Tear_Sample
MIDown tool
MIIxpc
Mojeek
Mr.4x3
MSIECrawler
muhstik-scan
Name Intelligence
Nessus
Netcraft
netEstate NE Crawler
NetMechanic
Net Vampire
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nutch
oBot
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PageGrabber
page scorer
Pandalytics
Papa Foto
Pavuk
Picscout
PyCurl
QueryN Metasearch
RankActive
RankFlex
Rankivabot
RankurBot
Recorder
RedesScrapy
Ripper
SBIder
scan.lol
Scrapy
Screaming
ScreenerBot
SEOkicks
SEOlyticsCrawler
SEOprofiler
seoscanners
SEOstats
sexsearcher
Siphon
SISTRIX
Siteimprove
SiteSucker
Site Sucker
Sitevigil
SlySearch
SMTBot
Snoopy
SocialRankIOBot
Sociscraper
Sottopop
Spammen
sp_auditbot
Spbot
SputnikBot
Sqlworm
Sqworm
Sucuri
SurveyBot
Suzuran
Swiftbot
sysscan
T0PHackTeam
T8Abot
Teleport
TheNomad
Thumbor
Trendiction
Trendictionbot
trendiction.com
Turingos
Turnitin
TurnitinBot
TwengaBot
UnisterBot
URLy.Warning
Vagabondo
VCI
VidibleScraper
VoidEYE
Voil
WallpapersHD
Webalta
Web Collage
WebCopier
WebFetch
Web Fetch
WebFuck
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebSauger
WebsiteExtractor
WebsiteQuester
WebSucker
WebZIP
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
WWW::Mechanize
x22Mozilla
Xaldon_WebSpider
zauba.io
ZmEu
ZumBot
ZyBorg