404checker
404enemy
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Anarchie
archive.org_bot
Asterias
autoemailspider
backlink-check
BackWeb
Badass
BatchFTP
BDCbot
Bigfoot
Bitacle
Blackboard
Black Hole
BLEXBot
Boardreader
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
CATExplorador
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
cognitiveseo
Cosmos
Craftbot
crawler4j
CrazyWebCrawler
CrunchBot
Curious
DBLBot
demandbase-bot
Deusu
Digincore
Dirbuster
Disco
Discobot
DittoSpyder
DomainCrawler
DomainStatsBot
DTS Agent
EasyDL
Ecxi
EirGrabber
EMail Siphon
evc-batch
Evil
Express WebPictures
ExtLinksBot
Extractor
Ezooms
facebookscraper
FDM
Foobot
FrontPage
FyberSpider
GalaxyBot
Genieo
GermCrawler
GetRight
Go-Ahead-Got-It
Gotit
GrapeFX
GrapeshotCrawler
GridBot
HaosouSpider
Havij
Heritrix
HMView
HTMLparser
HTTP::Lite
HybridBot
Iblog
IDBot
IlseBot
Indy Library
InfoNaviRobot
Intelliseek
InternetSeer
internetVista monitor
ips-agent
IRLbot
Jbrofuzz
JetCar
JustView
Jyxobot
Kozmosbot
LexiBot
Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
lwp-trivial
Magnet
Majestic-SEO
MauiBot
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIDown tool
MIIxpc
Mojeek
Morfeus Fucking Scanner
MSFrontPage
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
NetAnts
NetLyzer
Nettrack
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Nimbostratus
Nmap
Nutch
Octopus
Offline Explorer
Openfind
OpenVAS
OrangeSpider
OutfoxBot
Page Analyzer
Pandalytics
Panscient
Papa Foto
PECL::HTTP
Picscout
Picsearch
POE-Component-Client-HTTP
Probethenet
Psbot
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
ReGet
RocketCrawler
s1z.ru
ScanAlert
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
SEOkicks-Robot
Seomoz
SEOprofiler
seoscanners
SEOstats
sexsearcher
Siphon
SISTRIX
Siteimprove
SiteSnagger
Site Sucker
Sitevigil
Snoopy
Spammen
Spanner
Spbot
SputnikBot
Sqlworm
Sqworm
Steeler
Stripper
Sucker
SuperHTTP
Surfbot
sysscan
tAkeOut
Teleport
Telesphoreo
Thumbor
TightTwatBot
Titan
trendiction.com
True_Robot
Turnitin
Upflow
URLy.Warning
Vacuum
VB Project
VeriCiteCrawler
VoidEYE
Voltron
WASALive-Bot
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebSauger
Web Sauger
Webshag
Website Quester
WebStripper
WebWhacker
WebZIP
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
x09Mozilla
x22Mozilla
Xenu
Zade
Zauba
Zermelo
Zeus
zgrab
Zitebot
ZmEu
ZumBot