AIBOT
ALittle Client
Abonti
Aboundex
AhrefsBot
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Ankit
Anthill
Asterias
AwarioRssBot
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
Badass
BatchFTP
BetaBot
Black Hole
BlackWidow
Brandprotect
Brandwatch
BuiltBotTough
BuzzSumo
CATExplorador
CODE87
CheTeam
Chlooe
Claritybot
Copier
Copyscape
CrazyWebCrawler
Custo
CyotekWebCopy
DIIbot
DTS Agent
DigitalPebble
Disco
Discobot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Dragonfly
Ebingbong
EroCrawler
Evil
Exabot
ExtLinksBot
ExtractorPro
Ezooms
FDM
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
FrontPage
Fuzz
Fyrebot
GT::WWW
GalaxyBot
GetRight
Getintent
Go!Zilla
GoZilla
GrabNet
Grabber
Grafula
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
Harvest
Havij
IDBTE4M
Image Fetch
IndeedBot
Indy Library
IstellaBot
JamesBOT
Jbrofuzz
Jorgee
JustView
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
LexiBot
LibWeb
LinkScan
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lmspider
MIDown tool
MJ12bot
MSFrontPage
MSIECrawler
Majestic-SEO
Mass Downloader
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojeek
Mr.4x3
NICErsPRO
NPbot
Name Intelligence
NearSite
Needle
Nessus
NetAnts
NetMechanic
NetZIP
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
PECL::HTTP
PageGrabber
PageScorer
Pandalytics
Pavuk
PeoplePal
Pi-Monster
Picsearch
Pimonster
PleaseCrawl
ProWebWalker
Pump
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot
RepoMonkey
Ripper
RocketCrawler
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScoutJet
Screaming
ScrepyBot
Semrush
SeoSiteCheckup
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSucker
Sitevigil
SlySearch
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spbot
SputnikBot
Suzuran
T8Abot
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
Turnitin
TurnitinBot
Typhoeus
V-BOT
VidibleScraper
Virusdie
WISENutbot
WWW-Collector-E
Wallpapers
Wallpapers/3.0
Web Auto
Web Collage
Web Enhancer
Web Fuck
Web Sauger
WebCopier
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Webster
Whack
WiseGuys Robot
Wotbox
Xaldon_WebSpider
Xenu
Zeus
Zitebot
ZumBot
autoemailspider
check1.exe
clark-crawler
coccocbot-web
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
evc-batch
facebookscraper
instabid
ips-agent
isitwp.com
magpie-crawler
netEstate NE Crawler
page scorer
plumanalytics
polaris version
probe-image-size
scalaj-http
seobility
seostar
siteripz
sogouspider
spyfu
sysscan
tAkeOut
trendiction.com
webprosbot
x09Mozilla
zauba.io
zgrab