360Spider
404enemy
Abonti
Aboundexbot
AhrefsBot
Alligator
AllSubmitter
AlphaBot
archive.org_bot
ASPSeek
Asterias
Attach
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
Badass
BDFetch
BetaBot
Bigfoot
Bitacle
BlackWidow
BotALot
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
CazoodleBot
CheeseBot
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Craftbot
CrazyWebCrawler
CSHttp
Curious
Custo
DatabaseDriverMysqli
DataCha0s
Demon
Devil
DigitalPebble
DIIbot
Dirbuster
Disco
DittoSpyder
DomainCrawler
Download Wonder
Dragonfly
DTS Agent
Ebingbong
eCatch
EirGrabber
EMail Wolf
EroCrawler
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
GermCrawler
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
Go!Zilla
GrapeshotCrawler
GridBot
GT::WWW
Havij
Heritrix
Hloader
HTMLparser
Humanlinks
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
ips-agent
Iria
Iskanie
JamesBOT
JetCar
JikeSpider
Joomla
Jorgee
Larbin
LeechGet
Lftp
LibWeb
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkScan
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Litemage_walker
lwp-request
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic SEO
Masscan
Mata Hari
Meanpathbot
mediawords
MegaIndex.ru
Microsoft Data Access
Mojeek
Mr.4x3
Musobot
Navroad
NearSite
NetAnts
Netcraft
NetLyzer
NetMechanic
Netvibes
NetZIP
NextGenSearchBot
Nibbler
Nmap
Nutch
OrangeBot
OutclicksBot
PageAnalyzer
page scorer
Papa Foto
Pavuk
pcBrowser
PHPCrawl
Pixray
PleaseCrawl
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
PyCurl
RankActiveLinkBot
Rankivabot
RankurBot
RealDownload
RebelMouse
Recorder
RedesScrapy
ReGet
RepoMonkey
Ripper
RocketCrawler
SalesIntelligent
SBIder
Scrapy
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOlyticsCrawler
Seomoz
sexsearcher
Shodan
SiteExplorer
Siteimprove
SiteLockSpider
SmartDownload
sogouspider
SpaceBison
Spammen
Spanner
Spbot
Spinn3r
Sqworm
Stripper
Sucker
Swiftbot
T0PHackTeam
T8Abot
tAkeOut
Teleport
TeleportPro
TheNomad
TightTwatBot
Titan
Toweyabot
Trendiction
trendiction.com
True_Robot
Turingos
TurnitinBot
Twice
VB Project
VidibleScraper
Voil
Wallpapers/3.0
Web Auto
WebCollage
Web Enhancer
WebFetch
WebImageCollector
WebmasterWorldForumBot
WebPix
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteQuester
Webster
WebStripper
Web Sucker
WeSEE
Whack
Whacker
Widow
WinHTTrack
WISENutbot
Wonderbot
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xenu
Zade
Zauba
zauba.io
Zeus
zgrab
Zitebot
ZyBorg