Commit graph

251 commits

Author SHA1 Message Date
emanuele-f
a9d3c78587 Alerts changes
NOTE: database schema changed. Existing alerts will be lost.

- Unified engaged and closed tables
- Simplified hosts engaged alert counters handling: periodically set by lua
- Removed alert engine and replaced with alert periodicity
- Now engage is implicitly derived from the alert end timestamp and periodicity
- New alerts_api.lua to easily emit alerts
- Removed past alerts counter aggregation by hash
- Alert notifications for non-flow alerts are now removed from C and triggered by lua
2019-06-28 10:47:17 +02:00
Simone Mainardi
775b6f8842 Adds InfluxDB total exports 2019-06-25 18:23:58 +02:00
Simone Mainardi
221b224abb Simplifies handling of Influxdb export stats using Lua 2019-06-25 17:22:41 +02:00
Simone Mainardi
9863cfd0ba Reworks InfluxDB export to better handle retries 2019-06-24 17:48:53 +02:00
emanuele-f
f9dd5e5e34 Implement retried/failed exports influxdb counters
Also add support for inline chart custom labels
2019-06-21 17:11:11 +02:00
emanuele-f
b42f795e44 Fix ts file incorrectly deleted after a failed export 2019-06-20 12:07:16 +02:00
emanuele-f
a2f4dc0c24 Add alert generated when InfluxDB export queue is too long 2019-06-19 15:33:56 +02:00
emanuele-f
3898e21558 Improve InfluxDB export logic
Retry multiple times before discarding a file. Also more log messages are now produced.
2019-06-19 14:50:31 +02:00
emanuele-f
956a3713dc InfluxDB export deadline 2019-06-19 11:42:14 +02:00
emanuele-f
89b9aebfd7 Delete ts export queue on startup and add missing error 2019-06-19 11:21:27 +02:00
emanuele-f
aa17725323 Additional debug for RRD 2019-06-19 09:36:58 +02:00
emanuele-f
e43bb6680e Add support for other aggregation functions
monitored host RTT now uses MAX as aggregation function
2019-06-18 16:50:50 +02:00
emanuele-f
dba42d5842 Fix for 0 as last point while using aggregated data 2019-06-18 15:37:24 +02:00
emanuele-f
82305dd24a Fix InfluxDB incorrect timestamp while performing queries 2019-06-18 14:57:09 +02:00
emanuele-f
cfa9986671 Implement InfluxDB export statistics 2019-06-10 15:52:06 +02:00
emanuele-f
1374367e9f Fix influx memory chart and 5min script error 2019-06-07 20:59:32 +02:00
emanuele-f
43078c6758 Fix continuos queries not created on system scripts ts 2019-06-07 19:44:21 +02:00
emanuele-f
ca251bbe26 Add InfluxDB number of series 2019-06-07 17:46:16 +02:00
emanuele-f
08f066637e Add InfluxDB memory usage chart 2019-06-07 17:22:02 +02:00
emanuele-f
f51b0f1cda Add support for influxdb _internal queries at visualization phase
Also implement influxdb storage chart
2019-06-07 16:19:33 +02:00
emanuele-f
ecfa447fcf Fix InfluxDB ts_utils:exists with empty tags 2019-06-03 11:32:49 +02:00
emanuele-f
c8da6bcf34 Fix evexporter_iface RRD collision and add test case 2019-05-30 15:30:23 +02:00
emanuele-f
e74f6ee3b7 Fix host timeseries first point problem.
An additional point is now stored on the ts database to address the issue.

Fixes #2184
2019-05-28 17:17:21 +02:00
emanuele-f
f0ae0f4274 Choose appropriate shard group duration for InfluxDB retention policies 2019-05-21 19:55:21 +02:00
emanuele-f
1be45be32e Fix for already mangled RRD with incompatible rrd_tune 2019-05-16 18:47:41 +02:00
emanuele-f
00afdaa79d Fix for old rrd_tune not supporting adding columns 2019-05-16 11:18:28 +02:00
emanuele-f
3e612869a5 Fix interface RRD overlap between mining category and application
Interface categories are now placed under the ndpi_categories rrd subfolder. Existing data is migrated.
2019-05-16 00:13:43 +02:00
emanuele-f
d3200464d7 Fix "evexporter_iface:traffic" RRD path collision 2019-05-14 20:38:44 +02:00
emanuele-f
f31451d0bb Add test to avoid RRD overlapping paths 2019-05-14 20:38:44 +02:00
emanuele-f
c58d302ad6 Fix possible nil num_ds 2019-05-12 16:36:23 +02:00
emanuele-f
9c8c05b6bb Reduce RRD message verbosity 2019-05-10 16:55:15 +02:00
emanuele-f
794d0459a6 Improve InfluxDB getDiskUsage result check 2019-05-10 10:26:13 +02:00
emanuele-f
c8f78a6882 Add documentation on how to modify existing timeseries schemas 2019-05-07 15:48:32 +02:00
emanuele-f
590d3ff12b Use rrd_tune to fix RRD when a new timeseries metric is added 2019-05-07 14:54:44 +02:00
emanuele-f
16d0af12cd Add missing RRD error checks 2019-05-07 12:54:47 +02:00
emanuele-f
ebc5251a7f Use fully qualified name for retention policy based queries 2019-04-17 15:31:56 +02:00
emanuele-f
316ad4a9bd Add temporary fix for host:contacts schema change 2019-04-04 16:52:43 +02:00
emanuele-f
2c2abae146 Improve error message in InfluxDB multiqueries 2019-04-04 16:52:43 +02:00
emanuele-f
4b2a95ecb4 Add redis flag to debug RRD operations 2019-03-27 15:28:25 +01:00
emanuele-f
4203d8a1c6 Enable influxdb data rollup to speedup queries
Also bind influxdb retention of CQ to the default retention
2019-03-27 12:42:54 +01:00
emanuele-f
dee4685141 Implement batched listSeries to reduce the number of HTTP requests 2019-03-27 10:49:51 +01:00
emanuele-f
c1be2c2a55 Add switch to print InfluxDB queries 2019-03-18 15:27:14 +01:00
emanuele-f
8f5a6495a2 Add InfluxDB download link 2019-03-18 12:09:16 +01:00
Simone Mainardi
71158cb056 Handles deletion of host pools both with InfluxDB and RRDs 2019-03-12 13:16:27 +01:00
emanuele-f
b4bb8599ff Fix InfluxDB total stats accounting one excess point
E.g. calculating a total on 1h interval starting from 11:00
  - Before this patch: total on [11:00,12:00]
  - With this patch: total on [11:00,11:59]
2019-03-06 10:52:22 +01:00
emanuele-f
8977ac81f6 Add ntopng process memory chart 2019-03-05 13:59:38 +01:00
Simone Mainardi
0516e485d1 Fixes category/application name clashes in RRDs 2019-03-04 16:03:12 +01:00
emanuele-f
bec6cacef4 Check InfluxDB on every startup
Fixes #2417
2019-02-25 12:39:56 +01:00
emanuele-f
6c5f6e679e Fix invalid InfluxDB check 2019-02-22 15:11:05 +01:00
emanuele-f
07ff4dee54 Improve InfluxDB connection errors 2019-02-21 10:47:40 +01:00