404checker
Alexibot
Aspiegel
Attach
BLEXBot
BacklinkCrawler
BetaBot
Blackboard
BlowFish
Boardreader
Bullseye
Cogentbot
Copier
Custo
CyotekWebCopy
DTS Agent
DnBCrawler-Analytics
DomCopBot
EMail Wolf
Ecxi
EroCrawler
Extractor
FDM
Fyrebot
Genieo
GermCrawler
GrapeFX
HMView
Haansoft
Havij
Id-search
IlseBot
Intelliseek
JamesBOT
Lanshanbot
Lftp
LieBaoFast
LinkScan
LinqiaScrapeBot
MIIxpc
MSIECrawler
Mag-Net
Mass Downloader
Meanpathbot
Mediatoolkitbot
Microsoft URL Control
Minefield
NetAnts
NimbleCrawler
Nutch
Openvas
Page Analyzer
PageGrabber
Pandalytics
QueryN Metasearch
Quick-Crawler
RankingBot
SBIder
SMTBot
ScrepyBot
Semrush
SemrushBot
SenutoBot
Siteimprove
Sociscraper
Swiftbot
Teleport
Titan
Vacuum
VidibleScraper
VoidEYE
WeSEE
WebCopier
WebImageCollector
WebLeacher
Website Quester
Whack
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZyBorg
arquivo-web-crawler
crawl.sogou.com
domainsproject.org
eCatch
lwp-request
magpie-crawler
oBot
plumanalytics
seocompany.store
serpstatbot
siteripz
trendiction.de
xpymep1.exe