360Spider
404enemy
80legs
Abonti
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Anarchie
ASPSeek
Attach
autoemailspider
Backlink-Ceck
BackStreet
BatchFTP
BBBike
BDFetch
BlackWidow
Blow
BlowFish
Boardreader
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Calculon
CATExplorador
CCBot
Cegbfeieh
CheTeam
ChinaClaw
Claritybot
coccocbot-web
Collector
com.plumanalytics
Copier
Copyscape
crawler4j
Crescent
DataCha0s
demandbase-bot
Deusu
Disco
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
DSearch
EasyDL
Ebingbong
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
evc-batch
Evil
ExtLinksBot
Extreme Picture Finder
EyeNetIE
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
FrontPage
FyberSpider
Fyrebot
Genieo
GermCrawler
Getintent
GetRight
Gigablast
Gotit
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot
Havij
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
HybridBot
Iblog
IDBot
Id-search
Indy Library
InfoNaviRobot
instabid
Intelliseek
InterGET
Internet Ninja
Iskanie
Jbrofuzz
JetCar
Jyxobot
Keyword Density
Lanshanbot
LeechFTP
LeechGet
Lftp
Lightspeedsystems
LinkpadBot
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
lwp-trivial
Mag-Net
Majestic-SEO
Masscan
Mass Downloader
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
Microsoft Data Access
MIDown tool
Mister PiX
MJ12bot
Mojeek
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
MS Web Services Client Protocol
muhstik-scan
Musobot
Name Intelligence
Netcraft
NetMechanic
Nettrack
Net Vampire
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
NimbleCrawler
Nimbostratus
OnCrawl
OpenLinkProfiler
OrangeSpider
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PHPCrawl
Picsearch
Pimonster
Pi-Monster
Probethenet
Pump
PxBroker
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RankurBot
Recorder
Rogerbot
s1z.ru
ScanAlert
Scanbot
ScoutJet
Screaming
SearchmetricsBot
SEOkicks
SEOlyticsCrawler
SeoSiteCheckup
sexsearcher
Shodan
Siphon
SiteLockSpider
Snake
Snapbot
Sociscraper
Sogou web spider
Sosospider
Spammen
SpankBot
Spinn3r
spyfu
Sqlworm
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
tAkeOut
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Trendiction
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
Vacuum
VeriCiteCrawler
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WallpapersHD
WBSearchBot
Web Auto
WebBandit
Web Collage
WebCopier
WebGo IS
webmeup-crawler
WebReaper
WebsiteQuester
Website Quester
WebStripper
WebSucker
WebZIP
WeSEE
Whatweb
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xaldon_WebSpider
zauba.io
Zeus
zgrab
ZmEu