404enemy
80legs
Aboundex
Aboundexbot
Acunetix
AIBOT
Aipbot
AllSubmitter
AlphaBot
Apexoo
archive.org_bot
Attach
backlink-check
BacklinkCrawler
BackStreet
BackWeb
BetaBot
Bigfoot
Bitacle
BlackWidow
Blow
BlowFish
Boardreader
Brandprotect
Brandwatch
Buddy
Calculon
CazoodleBot
CheTeam
ChinaClaw
Chlooe
Claritybot
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
com.plumanalytics
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
CSHttp
Curious
Custo
DBLBot
Deusu
Digincore
DIIbot
Discobot
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
DSearch
DTS Agent
Ebingbong
eCatch
ECCP/1.0
EMail Siphon
evc-batch
Exabot
ExtLinksBot
EyeNetIE
Ezooms
FDM
FHscan
Fimap
Flunky
Genieo
Getintent
GetRight
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Go!Zilla
GrapeshotCrawler
GridBot
GT::WWW
HaosouSpider
Havij
HEADMasterSEO
Hloader
HMView
HTMLparser
HTTrack
HybridBot
Iblog
Id-search
IndeedBot
InfoTekies
instabid
InternetSeer
ips-agent
Iskanie
JamesBOT
Jorgee
JustView
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
LeechGet
LexiBot
Likse
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
LNSpiderguy
lwp-request
LWP::Simple
lwp-trivial
Magnet
magpie-crawler
Majestic SEO
MarkWatch
Mata Hari
MauiBot
mediawords
Microsoft URL Control
MIIxpc
MJ12bot
Mojeek
Mr.4x3
MSIECrawler
Musobot
Nameprotect
Needle
NetAnts
NetLyzer
Nettrack
NICErsPRO
Niki-bot
Nikto
Nimbostratus
NPbot
Nutch
Octopus
OnCrawl
Openfind
OrangeSpider
OutfoxBot
PageAnalyzer
PageGrabber
page scorer
PeoplePal
PHPCrawl
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
plumanalytics
Pockey
Probethenet
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankFlex
Rankivabot
RankurBot
RealDownload
RedesScrapy
RocketCrawler
s1z.ru
Scanbot
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
Semrush
SEOprofiler
SeoSiteCheckup
SEOstats
sexsearcher
SISTRIX
Sitebeam
SiteExplorer
SiteLockSpider
Site Sucker
Sitevigil
SmartDownload
Snapbot
Sociscraper
Sosospider
SpankBot
Spinn3r
SputnikBot
spyfu
Sqworm
Sucuri
SuperBot
Surfbot
SurveyBot
sysscan
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Toweyabot
Trendiction
trendiction.com
True_Robot
Turnitin
TurnitinBot
TwengaBot
Typhoeus
Upflow
VB Project
VeriCiteCrawler
Wallpapers/3.0
WBSearchBot
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Fetch
Web Fuck
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
Web Sauger
WebsiteExtractor
WebsiteQuester
WebStripper
WebZIP
Whacker
Whatweb
Who.is Bot
Widow
WISENutbot
Woobot
Wotbox
Wprecon
WWW-Mechanize
WWWOFFLE
Xaldon_WebSpider
xpymep1.exe
Zauba
zauba.io
Zitebot
ZumBot
ZyBorg