404checker
80legs
Aboundexbot
ADmantX
AIBOT
Alexibot
AllSubmitter
arquivo.pt
arquivo-web-crawler
autoemailspider
AwarioSmartBot
Backlink-Ceck
BacklinkCrawler
BackStreet
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
Bigfoot
Bitacle
Blackboard
Black Hole
BlackWidow
BLEXBot
Blow
Boardreader
BotALot
Calculon
CheeseBot
Chlooe
Cliqzbot
Cloud mapping
com.plumanalytics
Copyscape
Cosmos
crawler4j
CrazyWebCrawler
CSHttp
Curious
Custo
Demon
Dirbuster
Dispatch
DnyzBot
Domains Project
DomainStatsBot
Dotbot
DSearch
Ecxi
EirGrabber
evc-batch
Exabot
Ezooms
Flunky
FrontPage
Fyrebot
GalaxyBot
Genieo
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
Havij
HEADMasterSEO
heritrix
HTMLparser
HTTrack
Humanlinks
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InterGET
ips-agent
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JetCar
Jetty
JikeSpider
Joomla
JustView
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
LNSpiderguy
Magnet
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft URL Control
MIDown tool
MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
MQQBrowser
Mr.4x3
MSIECrawler
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Netcraft
netEstate NE Crawler
NetMechanic
NetSpider
Net Vampire
NextGenSearchBot
Nibbler
NICErsPRO
NimbleCrawler
NPbot
Openfind
Openvas
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
page scorer
Panscient
PeoplePal
Picscout
Picsearch
Pixray
plumanalytics
Probethenet
ProPowerBot
ProWebWalker
Psbot
Pump
PyCurl
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
RocketCrawler
Rogerbot
SBIder
ScanAlert
ScoutJet
Screaming
SearchmetricsBot
SEOkicks
SEOprofiler
SeoSiteCheckup
SEOstats
Shodan
Siphon
sitechecker.pro
Site Sucker
Sitevigil
SlySearch
SmartDownload
Snake
Snapbot
Sociscraper
Sottopop
Spammen
Spanner
SputnikBot
Sqlmap
Sucker
SuperBot
Swiftbot
tAkeOut
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Tracemyfile
Trendiction
Trendictionbot
Turingos
TurnitinBot
Typhoeus
UnisterBot
Upflow
URLy Warning
Vacuum
VCI
VeriCiteCrawler
Voil
Voltron
WASALive-Bot
WebBandit
WebCollage
Web Collage
WebEnhancer
Web Fetch
WebFuck
WebmasterWorldForumBot
webmeup-crawler
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
Website Quester
WebStripper
WebSucker
WebWhacker
Whacker
Who.is Bot
WISENutbot
Woobot
Wotbox
Wprecon
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x22Mozilla
zgrab
ZmEu
ZumBot
ZyBorg