360Spider
404enemy
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Alligator
AllSubmitter
AlphaBot
ASPSeek
Attach
autoemailspider
backlink-check
BackWeb
Badass
Battleztar Bazinga
BDFetch
Bitacle
Blackboard
BlackWidow
BLEXBot
Blow
Boardreader
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
Calculon
CCBot
CheeseBot
CheTeam
Chlooe
coccocbot-web
Cogentbot
cognitiveseo
Copier
CopyRightCheck
crawler.feedback
crawl.sogou.com
CrunchBot
CSHttp
DataCha0s
demandbase-bot
Demon
Devil
Digincore
DigitalPebble
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
EMail Siphon
evc-batch
Exabot
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
Foobot
Freeuploader
Fyrebot
Genieo
Getintent
GetRight
Gigablast
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
GrapeFX
GrapeshotCrawler
GT::WWW
Haansoft
Harvest
Heritrix
HTTP::Lite
Humanlinks
Id-search
IndeedBot
instabid
internetVista monitor
Iria
IRLbot
JennyBot
JikeSpider
Jyxobot
Keyword Density
Kozmosbot
LeechFTP
Lftp
Libwhisker
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
lwp-trivial
Mag-Net
Mail.RU_Bot
MarkMonitor
MarkWatch
meanpathbot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft URL Control
MSIECrawler
muhstik-scan
Musobot
Name Intelligence
Nameprotect
NearSite
Needle
NetLyzer
NetMechanic
NetSpider
Net Vampire
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Ninja
Nmap
Nutch
oBot
OnCrawl
OrangeBot
Page Analyzer
page scorer
PageScorer
Pandalytics
Papa Foto
PECL::HTTP
PeoplePal
PHPCrawl
POE-Component-Client-HTTP
ProWebWalker
Psbot
PyCurl
Quick-Crawler
RankActiveLinkBot
RankingBot
Rankivabot
Reaper
RebelMouse
Recorder
RedesScrapy
ReGet
RepoMonkey
RocketCrawler
SalesIntelligent
SBIder
scan.lol
Scrapy
ScreenerBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SeoSiteCheckup
serpstatbot
sexsearcher
Shodan
SISTRIX
SiteExplorer
SiteSnagger
Site Sucker
SlySearch
SmartDownload
Snoopy
Sociscraper
SpaceBison
SpankBot
Spanner
Spbot
spyfu
Sqlmap
Sqlworm
SuperBot
SurveyBot
Suzuran
sysscan
Szukacz
T0PHackTeam
Teleport
Telesphoreo
Telesphorep
TightTwatBot
Toata
Tracemyfile
TurnitinBot
URLy Warning
Vacuum
Vagabondo
VidibleScraper
Voil
WASALive-Bot
Webalta
Web Auto
WebBandit
Web Collage
WEBDAV
WebEnhancer
Web Fetch
WebmasterWorldForumBot
webmeup-crawler
Webshag
WebsiteQuester
Website Quester
Webster
WebStripper
WebWhacker
WeSEE
Whack
Widow
WISENutbot
Wonderbot
Woobot
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
YoudaoBot
Zade
Zauba
Zeus
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg