404checker
ALittle Client
Alexibot
AllSubmitter
Aspiegel
Atomseobot
AwarioSmartBot
BDFetch
BacklinkCrawler
Bigfoot
Blow
CODE87
CSHttp
ChinaClaw
Citoid
Crescent
CrunchBot
Curious
Custo
DigitalPebble
DomainStatsBot
Dragonfly
Drip
EMail Siphon
Ebingbong
EroCrawler
Express WebPictures
FDM
Firefox/7.0
Fyrebot
Genieo
Getintent
Gigabot
Go!Zilla
HTTrack
Harvest
Hloader
IDBTE4M
Information Security Team InfraSec Scanner
InfraSec Scanner
Iskanie
Keyword Density
Kinza
LeechGet
LinkWalker
LinkextractorPro
MauiBot
Minefield
Nameprotect
Offline Explorer
OnCrawl
Openvas
OrangeSpider
PageGrabber
Piepmatz
Pixray
ProPowerBot
ProWebWalker
Pu_iN
RankFlex
RankingBot2
Rankivabot
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SMTBot
ScrepyBot
SemanticJuice
SeoCherryBot
SiteLockSpider
Siteimprove
Sogou web spider
SplitSignalBot
Sqlworm
Szukacz
Teleport
Telesphoreo
The Intraformant
TinyTestBot
Toweyabot
Trendictionbot
Twice
URLy Warning
WeSEE
Web Auto
Web Collage
WebStripper
WebSucker
WebsiteQuester
Widow
Xaldon_WebSpider
Zade
Zermelo
Zitebot
adscanner
demandbase-bot
eCatch
iubenda-radar
tAkeOut