360Spider
404checker
AdsTxtCrawlerTP
Anarchy
Black Hole
BlackWidow
BlowFish
Bolt
BotALot
Brandprotect
Bullseye
BunnySlippers
CATExplorador
CCBot
Calculon
CherryPicker
ChinaClaw
Citoid
Cocolyzebot
CrazyWebCrawler
Curious
Custo
DomCopBot
DomainAppender
Ecxi
Firefox/7.0
FrontPage
G-i-g-a-b-o-t
GetWeb
Gotit
HTTrack
Havij
Hloader
HybridBot
Id-search
Iria
JamesBOT
Jetty
JustView
Linkbot
Lipperhey
Ltx71
Mail.RU_Bot
Metauri
Mojeek
Mr.4x3
Needle
NetAnts
NetMechanic
NextGenSearchBot
Niki-bot
Nikto
OpenLinkProfiler
Openfind
Openvas
OrangeBot
PageAnalyzer
PeoplePal
Picsearch
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
PyCurl
QueryN Metasearch
RebelMouse
Recorder
RocketCrawler
SalesIntelligent
ScreenerBot
Seekport
Snoopy
Sucker
Telesphoreo
Turingos
TwengaBot
Typhoeus
UnisterBot
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
WEBDAV
WWW-Mechanize
WebZIP
WebsiteQuester
WiseGuys Robot
Xaldon WebSpider
Zade
crawler.feedback
demandbase-bot
eCatch
evc-batch
heritrix
instabid
linkdexbot
lwp-trivial
page scorer
seobility
seocompany.store
webgains-bot