Commit graph

206 commits

Author SHA1 Message Date
Simone Mainardi
9863cfd0ba Reworks InfluxDB export to better handle retries 2019-06-24 17:48:53 +02:00
emanuele-f
f9dd5e5e34 Implement retried/failed exports influxdb counters
Also add support for inline chart custom labels
2019-06-21 17:11:11 +02:00
emanuele-f
b42f795e44 Fix ts file incorrectly deleted after a failed export 2019-06-20 12:07:16 +02:00
emanuele-f
a2f4dc0c24 Add alert generated when InfluxDB export queue is too long 2019-06-19 15:33:56 +02:00
emanuele-f
3898e21558 Improve InfluxDB export logic
Retry multiple times before discarding a file. Also more log messages are now produced.
2019-06-19 14:50:31 +02:00
emanuele-f
956a3713dc InfluxDB export deadline 2019-06-19 11:42:14 +02:00
emanuele-f
89b9aebfd7 Delete ts export queue on startup and add missing error 2019-06-19 11:21:27 +02:00
emanuele-f
e43bb6680e Add support for other aggregation functions
monitored host RTT now uses MAX as aggregation function
2019-06-18 16:50:50 +02:00
emanuele-f
dba42d5842 Fix for 0 as last point while using aggregated data 2019-06-18 15:37:24 +02:00
emanuele-f
82305dd24a Fix InfluxDB incorrect timestamp while performing queries 2019-06-18 14:57:09 +02:00
emanuele-f
cfa9986671 Implement InfluxDB export statistics 2019-06-10 15:52:06 +02:00
emanuele-f
1374367e9f Fix influx memory chart and 5min script error 2019-06-07 20:59:32 +02:00
emanuele-f
43078c6758 Fix continuos queries not created on system scripts ts 2019-06-07 19:44:21 +02:00
emanuele-f
ca251bbe26 Add InfluxDB number of series 2019-06-07 17:46:16 +02:00
emanuele-f
08f066637e Add InfluxDB memory usage chart 2019-06-07 17:22:02 +02:00
emanuele-f
f51b0f1cda Add support for influxdb _internal queries at visualization phase
Also implement influxdb storage chart
2019-06-07 16:19:33 +02:00
emanuele-f
ecfa447fcf Fix InfluxDB ts_utils:exists with empty tags 2019-06-03 11:32:49 +02:00
emanuele-f
f0ae0f4274 Choose appropriate shard group duration for InfluxDB retention policies 2019-05-21 19:55:21 +02:00
emanuele-f
794d0459a6 Improve InfluxDB getDiskUsage result check 2019-05-10 10:26:13 +02:00
emanuele-f
c8f78a6882 Add documentation on how to modify existing timeseries schemas 2019-05-07 15:48:32 +02:00
emanuele-f
ebc5251a7f Use fully qualified name for retention policy based queries 2019-04-17 15:31:56 +02:00
emanuele-f
316ad4a9bd Add temporary fix for host:contacts schema change 2019-04-04 16:52:43 +02:00
emanuele-f
2c2abae146 Improve error message in InfluxDB multiqueries 2019-04-04 16:52:43 +02:00
emanuele-f
4203d8a1c6 Enable influxdb data rollup to speedup queries
Also bind influxdb retention of CQ to the default retention
2019-03-27 12:42:54 +01:00
emanuele-f
dee4685141 Implement batched listSeries to reduce the number of HTTP requests 2019-03-27 10:49:51 +01:00
emanuele-f
c1be2c2a55 Add switch to print InfluxDB queries 2019-03-18 15:27:14 +01:00
emanuele-f
8f5a6495a2 Add InfluxDB download link 2019-03-18 12:09:16 +01:00
emanuele-f
b4bb8599ff Fix InfluxDB total stats accounting one excess point
E.g. calculating a total on 1h interval starting from 11:00
  - Before this patch: total on [11:00,12:00]
  - With this patch: total on [11:00,11:59]
2019-03-06 10:52:22 +01:00
emanuele-f
8977ac81f6 Add ntopng process memory chart 2019-03-05 13:59:38 +01:00
emanuele-f
bec6cacef4 Check InfluxDB on every startup
Fixes #2417
2019-02-25 12:39:56 +01:00
emanuele-f
6c5f6e679e Fix invalid InfluxDB check 2019-02-22 15:11:05 +01:00
emanuele-f
07ff4dee54 Improve InfluxDB connection errors 2019-02-21 10:47:40 +01:00
emanuele-f
33a26d4ff5 Fix totals in aggregated timeseries 2019-02-08 13:33:14 +01:00
emanuele-f
d28bd1e4e9 Simplify CQ handling by storing data as derivatives
This requires less complexity than integral handling as it can now be handled similarly as gauge metrics
2019-02-07 12:11:44 +01:00
emanuele-f
b82aea611e Properly handle CQ aggregated types for counters 2019-02-06 19:17:41 +01:00
emanuele-f
ce96249702 Fix CQ error 2019-02-05 20:43:30 +01:00
emanuele-f
fde0717ac9 Fix influxdb continuos queries 2019-02-05 16:24:11 +01:00
emanuele-f
4d0f153b06 Avoid different number of points for past queries 2019-02-04 16:51:38 +01:00
emanuele-f
4f60243338 Implement timeseries data read from aggregated retention policies
Aggregation selector can be shown by setting "ntopng.prefs.influxdb.debug_aggregation" = "1"
2019-02-04 13:26:22 +01:00
emanuele-f
8e471d92fb Add first aggregation time for aggregated influxdb data 2019-02-04 13:26:22 +01:00
emanuele-f
10468d83bf Fix 1d aggregation 2019-02-01 17:58:17 +01:00
emanuele-f
e46d4ef5df Fix continuos queries creation 2019-01-31 19:09:00 +01:00
emanuele-f
229c3b13c9 Implement initial InfluxDB rollup support
Currently disabled, enable with
  redis-cli set ntopng.prefs.beta_rollup 1
2019-01-31 12:02:40 +01:00
emanuele-f
d48eb6def0 Stop running HTTP GET requests if the client disconnects
For example, this avoids running too many queries on InfluxDB in parallel when the user clicks multiple items in the gui
2018-12-14 19:49:53 +01:00
emanuele-f
95713ddfc6 Add driver:deleteOldData and delete old RRDs 2018-12-10 17:42:39 +01:00
emanuele-f
9bae8e234a Implement InfluxDB alerts when export fails
Fixes #2193
2018-12-06 14:32:37 +01:00
emanuele-f
d6e78848ed Handle slow InfluxDB queries 2018-11-23 19:08:19 +01:00
emanuele-f
def73cfd4c Cosmetic changes to tests 2018-11-09 12:11:15 +01:00
emanuele-f
12e2e500b1 Implement InfluxDB query test 2018-11-09 12:11:15 +01:00
emanuele-f
e6643f12b1 Fix host traffic total serie issue with InfluxDB 2018-11-02 19:08:32 +01:00