404enemy
80legs
Acunetix
AhrefsBot
Alexibot
AllSubmitter
Anarchie
Apexoo
Asterias
AwarioSmartBot
BackDoorBot
Backlink-Ceck
backlink-check
BackWeb
Barkrowler
BatchFTP
BBBike
BDFetch
Bitacle
Black Hole
Boardreader
Brandprotect
Brandwatch
Buddy
BunnySlippers
BuzzSumo
Calculon
CCBot
Cegbfeieh
CherryPicker
CheTeam
Cliqzbot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler.feedback
Crescent
Curious
DBLBot
Demon
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
domainsproject.org
DomainStatsBot
Dragonfly
Drip
DSearch
DTS Agent
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Firefox/7.0
FyberSpider
GalaxyBot
Getintent
Go-Ahead-Got-It
Go!Zilla
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Harvest
Havij
HEADMasterSEO
Hloader
HMView
HTMLparser
HTTrack
HybridBot
Iblog
IDBot
Image Fetch
Intelliseek
InternetSeer
ips-agent
Iria
IRLbot
isitwp.com
Iskanie
IstellaBot
JennyBot
Jetty
JOC Web Spider
Jyxobot
Lanshanbot
Larbin
LeechGet
Libwhisker
LieBaoFast
Lightspeedsystems
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
lwp-request
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Majestic-SEO
Masscan
meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Mojolicious
MQQBrowser
muhstik-scan
Musobot
Navroad
Nessus
NetMechanic
NetSpider
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Ninja
Nmap
NPbot
Nutch
oBot
Octopus
Openvas
OutclicksBot
page scorer
Papa Foto
PeoplePal
PictureFinder
Pi-Monster
polaris version
ProPowerBot
ProWebWalker
Psbot
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Reaper
RebelMouse
Recorder
ReGet
Rogerbot
RSSingBot
SBIder
ScanAlert
ScoutJet
ScreenerBot
SEOkicks
SEOprofiler
SeoSiteCheckup
serpstatbot
sexsearcher
Siphon
sitechecker.pro
SiteExplorer
SiteSnagger
Sitevigil
SmartDownload
Snapbot
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spammen
SpankBot
Spinn3r
SputnikBot
spyfu
Sqlmap
Sqlworm
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Szukacz
T0PHackTeam
Teleport
TeleportPro
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
Turingos
TurnitinBot
TwengaBot
UnisterBot
Upflow
URLy.Warning
Vacuum
Vagabondo
VB Project
VCI
VidibleScraper
VoidEYE
Voil
WASALive-Bot
WEBDAV
WebLeacher
WebmasterWorldForumBot
WebReaper
WebSauger
Webshag
WebsiteExtractor
Website Quester
Webster
WebSucker
Whatweb
WinHTTrack
WWW-Collector-E
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZyBorg