360Spider
404enemy
Abonti
Aboundex
ADmantX
AfD-Verbotsverfahren
AIBOT
Aipbot
Alexibot
Asterias
BackStreet
BackWeb
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
Black Hole
BlackWidow
BLEXBot
BlowFish
Bolt
BotALot
Brandprotect
BuiltBotTough
CATExplorador
CazoodleBot
CCBot
Cliqzbot
Copyscape
Cosmos
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Custo
demandbase-bot
Devil
Disco
DittoSpyder
DomainStatsBot
Dragonfly
DSearch
DTS Agent
EasyDL
Ebingbong
Ecxi
EMail Wolf
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
Freeuploader
FyberSpider
GalaxyBot
Genieo
GermCrawler
Getintent
GetWeb
Gotit
Grabber
GrabNet
Grafula
GrapeshotCrawler
Heritrix
HTTrack
Humanlinks
IDBot
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoTekies
instabid
InterGET
internetVista monitor
ips-agent
Iria
IRLbot
Iskanie
IstellaBot
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
Likse
LinkpadBot
LinkScan
LinkWalker
LinqiaScrapeBot
Lipperhey
Lmspider
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mass Downloader
MauiBot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MFC_Tear_Sample
Microsoft URL Control
MIIxpc
Mojeek
Morfeus Fucking Scanner
Msrabot
MS Web Services Client Protocol
muhstik-scan
Musobot
Nameprotect
Navroad
NearSite
Nessus
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Ninja
oBot
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
OutclicksBot
OutfoxBot
PageGrabber
PageScorer
Pandalytics
Panscient
Pavuk
PECL::HTTP
Picscout
Picsearch
Pimonster
Pi-Monster
plumanalytics
Pockey
ProWebWalker
PxBroker
PyCurl
RankActive
RankActiveLinkBot
RankingBot2
RankurBot
Reaper
RebelMouse
RedesScrapy
ReGet
s1z.ru
SBIder
ScanAlert
ScoutJet
Screaming
ScreenerBot
SearchmetricsBot
SEOstats
Shodan
Siphon
Sitebeam
SiteExplorer
SiteLockSpider
Snake
Snapbot
Sosospider
SpaceBison
Spanner
sp_auditbot
Sqlmap
Surfbot
Suzuran
Swiftbot
T8Abot
tAkeOut
Teleport
TeleportPro
Telesphorep
Thumbor
TightTwatBot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Upflow
URLy Warning
Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Wallpapers/3.0
Web Auto
WebCollage
Web Collage
WebCopier
WEBDAV
WebFetch
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
webmeup-crawler
WebReaper
WebSauger
Webshag
WebsiteExtractor
Website Quester
Web Sucker
Whatweb
WISENutbot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW::Mechanize
x09Mozilla
Xaldon_WebSpider
Xenu
Zermelo
Zeus
ZmEu
ZumBot