360Spider
404checker
Acunetix
AfD-Verbotsverfahren
AIBOT
AiHitBot
AlphaBot
arquivo-web-crawler
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
BetaBot
Black Hole
BLEXBot
Boardreader
Brandwatch
Buddy
BuzzSumo
Cegbfeieh
CheeseBot
Cliqzbot
Cloud mapping
Cogentbot
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
crawler4j
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
Custo
demandbase-bot
Demon
Devil
Digincore
Disco
Discoverybot
DittoSpyder
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
DSearch
Ebingbong
ECCP/1.0
EMail Siphon
Evil
Exabot
EyeNetIE
Ezooms
facebookscraper
FemtosearchBot
FHscan
Fimap
Freeuploader
FrontPage
FyberSpider
Fyrebot
Genieo
GetRight
Gotit
GoZilla
GrapeFX
Haansoft
Havij
Heritrix
Hloader
HTTP::Lite
Iblog
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
IRLbot
JamesBOT
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
Larbin
LeechFTP
LeechGet
Libwhisker
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Ltx71
Magnet
magpie-crawler
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Meanpathbot
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
MicroMessenger
Mister PiX
Morfeus Fucking Scanner
MQQBrowser
Mr.4x3
Musobot
Name Intelligence
Navroad
Needle
NetAnts
netEstate NE Crawler
NetSpider
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
NPbot
oBot
Offline Navigator
Openfind
OPPO A33
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
Papa Foto
Pavuk
pcBrowser
PECL::HTTP
Picsearch
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
Psbot
PxBroker
PyCurl
RankFlex
RankurBot
RealDownload
Reaper
ReGet
Ripper
RSSingBot
s1z.ru
SBIder
Scanbot
scan.lol
ScoutJet
Screaming
ScreenerBot
SEOkicks
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
Shodan
Sitebeam
SiteLockSpider
SmartDownload
SMTBot
Snapbot
Snoopy
Sociscraper
sogouspider
Sogou web spider
Sottopop
Spanner
Spbot
Spinn3r
SputnikBot
spyfu
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
TeleportPro
Telesoft
Telesphoreo
Telesphorep
Toata
Trendiction
Trendictionbot
trendiction.de
True_Robot
Turingos
TwengaBot
Typhoeus
UnisterBot
VCI
Virusdie
Voil
Voltron
WallpapersHD
WASALive-Bot
WebAuto
WebCollage
WebCopier
WEBDAV
WebEnhancer
WebFuck
Web Fuck
WebPix
WebReaper
Web Sauger
Webster
WebStripper
WebWhacker
WebZIP
Whack
Whatweb
WinHTTrack
WISENutbot
Woobot
Wotbox
Wprecon
WWW-Collector-E
x22Mozilla
Xaldon WebSpider
xpymep1.exe
Zade
zauba.io
zgrab
Zitebot
ZmEu