404checker
80legs
Aboundexbot
Aipbot
Alexibot
Alligator
AllSubmitter
Apexoo
arquivo.pt
arquivo-web-crawler
Aspeigel
ASPSeek
Asterias
AwarioRssBot
AwarioSmartBot
BackDoorBot
BackWeb
Badass
BDFetch
BlackWidow
Boardreader
Bolt
BotALot
Brandprotect
Bullseye
BunnySlippers
CATExplorador
CazoodleBot
CCBot
CherryPicker
CheTeam
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
Craftbot
crawler.feedback
CSHttp
Curious
Custo
DatabaseDriverMysqli
Demon
Deusu
Devil
Digincore
Disco
DomainCrawler
DomainStatsBot
Dotbot
DSearch
EasyDL
Ebingbong
ECCP/1.0
EirGrabber
evc-batch
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
Ezooms
facebookscraper
FDM
FlashGet
Foobot
Freeuploader
FrontPage
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
Go!Zilla
GrabNet
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HaosouSpider
Havij
Heritrix
HTTP::Lite
Humanlinks
IDBot
Indy Library
InfoNaviRobot
instabid
Intelliseek
Internet Ninja
internetVista monitor
IRLbot
Iskanie
IstellaBot
JamesBOT
JennyBot
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Linkdexbot
LinkextractorPro
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
lwp-request
LWP::Simple
Magnet
magpie-crawler
Mail.RU_Bot
MarkMonitor
MarkWatch
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
MQQBrowser
MSFrontPage
MSIECrawler
muhstik-scan
Musobot
NetAnts
NetMechanic
Net Vampire
NetZIP
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
NPbot
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openvas
OpenVAS
OrangeSpider
PageGrabber
PageScorer
Pandalytics
pcBrowser
PECL::HTTP
Picsearch
PictureFinder
Pimonster
Pixray
polaris version
Probethenet
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot2
RebelMouse
Recorder
RedesScrapy
RepoMonkey
RSSingBot
s1z.ru
SBIder
Scanbot
scan.lol
Scrapy
ScreenerBot
SEOkicks
SEOkicks-Robot
seoscanners
SeoSiteCheckup
Shodan
SISTRIX
Siteimprove
SMTBot
Snake
Snapbot
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sosospider
SpankBot
Spanner
sp_auditbot
Spbot
spyfu
Sqlworm
Sucuri
SuperBot
SuperHTTP
T0PHackTeam
Telesphoreo
Telesphorep
The Intraformant
Toata
Trendiction
trendiction.com
TwengaBot
Twice
Typhoeus
UnisterBot
Upflow
URLy Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler
VidibleScraper
Voil
WebAuto
Web Auto
WebBandit
WebCollage
WebFetch
WebFuck
WebGo IS
WebLeacher
webmeup-crawler
WebSauger
Webshag
WebsiteExtractor
Website Quester
WebStripper
Whacker
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWWOFFLE
x09Mozilla
Xenu
Zeus
Zitebot
ZmEu