404checker
404enemy
Aboundex
Acunetix
ADmantX
AfD-Verbotsverfahren
AIBOT
AiHitBot
Ankit
archive.org_bot
arquivo.pt
AwarioRssBot
AwarioSmartBot
backlink-check
BackWeb
Badass
Bandit
Barkrowler
BBBike
Bigfoot
Black Hole
BLEXBot
Boardreader
Bolt
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Collector
CopyRightCheck
Craftbot
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Demon
Dirbuster
Disco
Dispatch
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
DSearch
DTS Agent
EasyDL
Ebingbong
eCatch
ECCP/1.0
EirGrabber
ExtLinksBot
ExtractorPro
EyeNetIE
FemtosearchBot
Firefox/7.0
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
Genieo
GermCrawler
GetRight
GoZilla
Go!Zilla
Grabber
GrabNet
GrapeFX
Haansoft
HaosouSpider
Hloader
HMView
HTTP::Lite
HTTrack
IDBot
Id-search
IlseBot
Indy Library
instabid
Intelliseek
Internet Ninja
InternetSeer
ips-agent
isitwp.com
Iskanie
JamesBOT
Jbrofuzz
JetCar
Jetty
JOC Web Spider
Jyxobot
Keyword Density
Larbin
LeechFTP
LeechGet
LieBaoFast
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkScan
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
Ltx71
Magnet
magpie-crawler
MarkWatch
Masscan
Mata Hari
MauiBot
Metauri
MIDown tool
MIIxpc
MJ12bot
Morfeus Fucking Scanner
MQQBrowser
MSFrontPage
Musobot
Name Intelligence
Navroad
Needle
Nessus
NetLyzer
NetMechanic
Nettrack
NetZIP
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
OpenLinkProfiler
OrangeBot
OutclicksBot
page scorer
Pandalytics
Panscient
pcBrowser
PECL::HTTP
Picscout
Picsearch
PictureFinder
Pimonster
Pi-Monster
plumanalytics
Pockey
Probethenet
ProWebWalker
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RealDownload
Reaper
RebelMouse
Recorder
ReGet
RocketCrawler
Rogerbot
RSSingBot
SalesIntelligent
SBIder
ScanAlert
Scanbot
scan.lol
ScoutJet
Searchestate
SearchmetricsBot
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
sexsearcher
SISTRIX
Sitebeam
SiteExplorer
Sitevigil
SmartDownload
SMTBot
sogouspider
Sosospider
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
spyfu
SuperHTTP
Surfbot
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
Telesphorep
Thumbor
Toata
Toweyabot
Twice
Upflow
VB Project
VCI
VeriCiteCrawler
Virusdie
Wallpapers/3.0
WASALive-Bot
Web Auto
WebCollage
Web Collage
Web Enhancer
WebFetch
Web Fuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Sucker
WebWhacker
Whack
Whacker
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wprecon
WWW-Collector-E
WWW-Mechanize
x09Mozilla
YoudaoBot
Zade
Zeus
zgrab
ZmEu
ZumBot