404checker
404enemy
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
AlphaBot
Anarchie
Apexoo
Asterias
autoemailspider
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
Badass
Battleztar Bazinga
Black Hole
Boardreader
BotALot
BuiltBotTough
Bullseye
Calculon
Cegbfeieh
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
com.plumanalytics
Copyscape
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
DataCha0s
demandbase-bot
Demon
Devil
Digincore
Disco
DittoSpyder
Download Wonder
Dragonfly
DSearch
DTS Agent
ECCP/1.0
EirGrabber
EMail Wolf
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Fyrebot
Genieo
Getintent
GetWeb
Go-Ahead-Got-It
Gotit
GoZilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
Haansoft
Havij
Heritrix
Iblog
Image Fetch
Image Sucker
InfoTekies
Intelliseek
InterGET
internetVista monitor
Iria
Iskanie
IstellaBot
Jbrofuzz
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Magnet
magpie-crawler
Majestic12
Majestic-SEO
Mass Downloader
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
MIDown tool
MIIxpc
Mister PiX
MJ12bot
muhstik-scan
Name Intelligence
Nameprotect
Navroad
Needle
Nessus
Netcraft
NetLyzer
NetMechanic
Nettrack
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Nikto
Nimbostratus
Ninja
NPbot
Offline Navigator
Openfind
Openvas
OpenVAS
OrangeBot
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
pcBrowser
PeoplePal
PHPCrawl
Picscout
PictureFinder
Pi-Monster
Pixray
plumanalytics
Pockey
Pump
RankActiveLinkBot
Rankivabot
RankurBot
RealDownload
Reaper
RedesScrapy
ReGet
s1z.ru
SalesIntelligent
Scrapy
Screaming
ScreenerBot
Semrush
SEOkicks-Robot
Seomoz
SEOprofiler
SEOstats
serpstatbot
Shodan
SISTRIX
Siteimprove
SiteSnagger
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
sp_auditbot
Spinn3r
SputnikBot
Sqlmap
Steeler
Sucuri
SurveyBot
Suzuran
Swiftbot
sysscan
T8Abot
tAkeOut
Telesphoreo
Telesphorep
TheNomad
Toweyabot
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
Typhoeus
UnisterBot
URLy.Warning
Vacuum
VCI
VidibleScraper
Virusdie
Voltron
Wallpapers/3.0
WallpapersHD
WBSearchBot
Webalta
WebAuto
Web Auto
WebBandit
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebImageCollector
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
WebStripper
WebSucker
WebWhacker
WebZIP
WeSEE
Whatweb
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
WWW::Mechanize
Xenu
Zauba
Zermelo
Zeus
ZmEu
ZumBot