360Spider
404enemy
80legs
Aboundexbot
Acunetix
ADmantX
AiHitBot
Alligator
AlphaBot
Anarchie
ASPSeek
Asterias
Attach
backlink-check
BacklinkCrawler
BBBike
BDCbot
Bigfoot
Bitacle
Blackboard
Blow
BlowFish
BotALot
Brandprotect
Buddy
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
CCBot
CherryPicker
CheTeam
ChinaClaw
Chlooe
Cliqzbot
Cogentbot
cognitiveseo
Copyscape
Cosmos
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Curious
Custo
DBLBot
demandbase-bot
Demon
Deusu
DigitalPebble
Dirbuster
Discoverybot
DomainCrawler
Download Wonder
Drip
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Exabot
Extractor
Extreme Picture Finder
FDM
FlashGet
Flunky
Freeuploader
FrontPage
Genieo
GetRight
Gigablast
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Grabber
GrabNet
GrapeshotCrawler
GridBot
GT::WWW
Heritrix
HMView
HTTP::Lite
HTTrack
Humanlinks
HybridBot
Id-search
Image Sucker
InfoTekies
Intelliseek
InterGET
InternetSeer
internetVista monitor
ips-agent
Iria
IRLbot
JennyBot
JetCar
JikeSpider
JOC Web Spider
Jyxobot
Keyword Density
Kozmosbot
LeechGet
LexiBot
Lftp
LibWeb
Lightspeedsystems
LinkScan
LinkWalker
LinqiaRSSBot
LNSpiderguy
lwp-trivial
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkWatch
Mass Downloader
MauiBot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
MIIxpc
Mister PiX
Mojeek
Mr.4x3
MS Web Services Client Protocol
Musobot
Navroad
NearSite
Nessus
NetAnts
netEstate NE Crawler
NetMechanic
NetSpider
Netvibes
NetZIP
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nmap
oBot
Openfind
OpenLinkProfiler
Openvas
OrangeBot
OutfoxBot
page scorer
Panscient
Pavuk
PeoplePal
Pi-Monster
POE-Component-Client-HTTP
ProWebWalker
Psbot
Pump
QueryN Metasearch
RankingBot2
RankurBot
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
scan.lol
Scrapy
ScreenerBot
SearchmetricsBot
SemrushBot
SEOkicks
SEOlyticsCrawler
serpstatbot
SISTRIX
SiteLockSpider
SiteSnagger
SMTBot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
SpankBot
Spbot
SputnikBot
spyfu
Sqlworm
SuperBot
SuperHTTP
Swiftbot
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
URLy Warning
VB Project
VidibleScraper
Voil
Voltron
WallpapersHD
WBSearchBot
Webalta
WebAuto
WebCollage
Web Collage
Web Fetch
WebFuck
Web Pix
WebSauger
Webshag
WebsiteQuester
Webster
WebSucker
Web Sucker
WeSEE
Whack
Whacker
Who.is Bot
Widow
WinHTTrack
WISENutbot
Wonderbot
Woobot
WWW-Collector-E
WWW-Mechanize
x09Mozilla
x22Mozilla
Xaldon_WebSpider
Zauba
Zeus
zgrab
Zitebot
ZyBorg