404checker
404enemy
Aboundex
AdsTxtCrawlerTP
Alexibot
Anarchy99
Apexoo
Asterias
BacklinkCrawler
Bandit
Bolt
BuzzSumo
CheeseBot
ClaudeBot
Cogentbot
Copier
Copyscape
Dirbuster
EroCrawler
EyeNetIE
Fimap
Firefox/7.0
Fyrebot
GermCrawler
GrabNet
GrapeshotCrawler
HEADMasterSEO
Harvest
HonoluluBot
HybridBot
Iblog
Information Security Team InfraSec Scanner
InternetMeasurement
JetCar
Leap
LinkScan
LinkpadBot
Lipperhey Spider
Majestic12
Mass Downloader
MeanPath Bot
Mediatoolkitbot
NPbot
NetLyzer
Netcraft
Nettrack
NextGenSearchBot
NimbleCrawler
Nmap
Offline Explorer
OnCrawl
OutclicksBot
PHPCrawl
PageThing.com
Pi-Monster
Pimonster
Pockey
Psbot
Pu_iN
PxBroker
PyCurl
Rainbot
RankActive
RankurBot
SEOprofiler
SemrushBot-BA
SemrushBot-FT
SemrushBot-OCOB
SeoSiteCheckup
Seomoz
Site Sucker
SiteSucker
SmartDownload
Snake
Snoopy
Spider_Bot/3.0
SplitSignalBot
Sqworm
Sucker
The Intraformant
URLy Warning
URLy.Warning
VB Project
WISENutbot
WWW::Mechanize
Whatweb
WinHTTrack
Wonderbot
Xaldon_WebSpider
Zeus
crawler.feedback
everyfeed-spider
iubenda-radar
muhstik-scan
page scorer
ripz
tAkeOut
trendiction.com
xpymep1.exe
zauba.io