404checker
Abonti
Aboundexbot
Aipbot
AllSubmitter
ASPSeek
Asterias
Backlink-Ceck
BackStreet
Badass
Bandit
Barkrowler
BBBike
BDCbot
BetaBot
Blackboard
Blow
Bolt
Buddy
BuiltBotTough
Bullseye
BunnySlippers
Calculon
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
CheeseBot
CheTeam
ChinaClaw
Cloud mapping
Cogentbot
cognitiveseo
com.plumanalytics
Cosmos
crawler4j
crawl.sogou.com
Crescent
Custo
DataCha0s
demandbase-bot
Demon
Deusu
Digincore
Dirbuster
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Drip
DTS Agent
EasyDL
eCatch
EMail Wolf
EroCrawler
Express WebPictures
Extractor
ExtractorPro
FDM
FHscan
Fimap
Firefox/7.0
Flunky
Freeuploader
GetRight
G-i-g-a-b-o-t
Go!Zilla
Grabber
Grafula
GrapeshotCrawler
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
Heritrix
HTMLparser
HTTrack
Humanlinks
IDBot
Id-search
Image Sucker
InfoTekies
Internet Ninja
internetVista monitor
Iskanie
JamesBOT
Jetty
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Lanshanbot
Larbin
LeechFTP
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
lwp-request
lwp-trivial
Majestic12
Masscan
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
MIIxpc
MJ12bot
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Musobot
Navroad
Needle
NetAnts
netEstate NE Crawler
NetSpider
Net Vampire
NetZIP
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nutch
oBot
Octopus
Offline Navigator
Openfind
OpenVAS
OrangeSpider
OutclicksBot
PageGrabber
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
PHPCrawl
Pi-Monster
PleaseCrawl
plumanalytics
Probethenet
ProPowerBot
Psbot
PxBroker
Quick-Crawler
RankFlex
RankingBot
RankurBot
ReGet
Rogerbot
RSSingBot
scan.lol
Screaming
ScreenerBot
SearchmetricsBot
SEOlyticsCrawler
Seomoz
SEOprofiler
SeoSiteCheckup
sexsearcher
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
Snake
Snapbot
sogouspider
Sogou web spider
Spammen
sp_auditbot
Spbot
spyfu
Sqlmap
Sqlworm
Stripper
SuperHTTP
Surfbot
SurveyBot
Swiftbot
sysscan
T0PHackTeam
tAkeOut
TeleportPro
Telesoft
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Trendiction
Trendictionbot
Turnitin
Twice
URLy Warning
URLy.Warning
VidibleScraper
Virusdie
Wallpapers/3.0
WallpapersHD
Webalta
Web Auto
WebBandit
WEBDAV
WebEnhancer
Web Fuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Webster
WebSucker
Whack
Whacker
Whatweb
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xenu
Zade
zgrab
Zitebot
ZyBorg