360Spider
404enemy
80legs
AIBOT
Abonti
AllSubmitter
AlphaBot
Ankit
Anthill
Aspiegel
AwarioRssBot
BDCbot
BackWeb
Badass
Bandit
BatchFTP
Bigfoot
BlackWidow
Blackboard
Blow
BlowFish
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
BunnySlippers
Calculon
ChinaClaw
Chlooe
Cliqzbot
Cogentbot
Copyscape
Craftbot
CrazyWebCrawler
Curious
CyotekWebCopy
DSearch
DTS Agent
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Discobot
DnyzBot
DomainCrawler
DomainStatsBot
EMail Wolf
Ecxi
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Firefox/7.0
FlashGet
Foobot
FrontPage
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
Gigablast
Go!Zilla
Gotit
Grabber
GrapeshotCrawler
HMView
HTTP::Lite
HTTrack
HaosouSpider
Harvest
IDBTE4M
IRLbot
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoTekies
Intelliseek
Iria
JamesBOT
Jbrofuzz
Jetty
JikeSpider
Joomla
JustView
Jyxobot
LexiBot
Likse
LinkWalker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MIDown tool
MIIxpc
Mag-Net
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
MauiBot
Mb2345Browser
Microsoft Data Access
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Msrabot
NICErsPRO
NPbot
Nameprotect
Navroad
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP
NextGenSearchBot
Nibbler
Nikto
Ninja
Nuclei
OPPO A33
Octopus
Offline Explorer
OnCrawl
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Pandalytics
Panscient
Pavuk
PeoplePal
Pi-Monster
Piepmatz
PleaseCrawl
Pockey
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
Reaper
RedesScrapy
RepoMonkey
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SeoSiteCheckup
Seomoz
SiteExplorer
SiteLockSpider
SiteSnagger
Siteimprove
SmartDownload
Snake
Snapbot
Sogou web spider
Spammen
SputnikBot
Sqworm
Sucker
Sucuri
SuperBot
Surfbot
Swiftbot
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
TheNomad
Toata
Trendiction
Turnitin
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
V-BOT
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WeSEE
Web Collage
Web Fetch
Web Fuck
WebAuto
WebBandit
WebFetch
WebGo IS
WebSucker
WebZIP
WebsiteExtractor
Webster
Whatweb
Wonderbot
Wprecon
Xenu
YoudaoBot
Zauba
Zitebot
arquivo-web-crawler
autoemailspider
backlink-check
coccocbot-web
cognitiveseo
crawler.feedback
demandbase-bot
domainsproject.org
gopher
instabid
ips-agent
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
polaris version
ripz
satoristudio.net
scan.lol
seostar
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
trendiction.de
webmeup-crawler
x09Mozilla
zgrab