Commit graph

70 commits

Author SHA1 Message Date
emanuele-f
936c869c3f Move expensive string concatenations to C while inserting timeseries 2018-10-12 17:58:59 +02:00
emanuele-f
baef2d6780 Improve timeseries automatic refresh 2018-10-01 17:36:42 +02:00
emanuele-f
c5e2dabf29 Remove total for gauge metrics in InfluxDB 2018-10-01 15:34:02 +02:00
emanuele-f
f82a8e9767 Return 0 filled points instead of nil when no data is available on InfluxDB
This behaviour makes InfluxDB consistent with the RRD driver
2018-10-01 10:49:51 +02:00
emanuele-f
97a280e14f Add partial sums in timeseries topk 2018-09-25 11:56:13 +02:00
emanuele-f
134bc7e373 Fix RRD total with sampled series 2018-09-24 18:26:30 +02:00
emanuele-f
b604288c9b Avoid returning topk items with zero bytes 2018-09-24 16:40:07 +02:00
emanuele-f
b8aa23f46d Add redis option to enable slow InfluxDB queries debug
Enable with:
  redis-cli set "ntopng.prefs.debug_influxdb_queries" 1
2018-09-24 16:40:07 +02:00
emanuele-f
58a0d54be3 Fix InfluxDB statistics 2018-09-24 16:40:07 +02:00
emanuele-f
e64c2c8fd7 Fix RRD totals 2018-09-24 16:25:21 +02:00
emanuele-f
38ebfc3fc3 Fix InfluxDB top talkers computation 2018-09-24 16:25:00 +02:00
Simone Mainardi
bf43aceb9c Refactors data delete_data_utils for the use with nEdge 2018-09-20 10:47:41 +02:00
Simone Mainardi
409c8f50ab Checks return value upon RRD directory deletion 2018-09-20 08:54:08 +02:00
emanuele-f
254a0fe5ce Optimize some InfluxDB queries 2018-09-18 17:20:20 +02:00
emanuele-f
f5b4181e08 Fix wrong InfluxDB export ID causing getLatestTimestamp issues 2018-09-18 17:20:20 +02:00
emanuele-f
6ef85d8998 Implement InfluxDB query timing 2018-09-17 18:52:07 +02:00
emanuele-f
1c7234e18f Optimize InfluxDB query by avoiding group-by on high cardinality iface:traffic 2018-09-17 18:52:07 +02:00
emanuele-f
129e824eea Add InfluxDB information in runtime status and about page
Closes #2010
2018-09-12 18:05:20 +02:00
emanuele-f
cd9941a205 Fix occasional "attempt to concatenate local 'label' (a nil value)" 2018-09-11 18:06:15 +02:00
emanuele-f
ffe2c629bc Implement timeseries cleanup
Closes #1940
2018-09-11 17:16:56 +02:00
emanuele-f
42dcd75485 Fix invalid mac addresses graphs path 2018-09-11 12:30:05 +02:00
emanuele-f
91ae4c5172 Implement experimental hourly deltas writes
redis-cli set "ntopng.prefs.enable_ts_deltas_writes" "1"
2018-09-07 17:12:18 +02:00
emanuele-f
9e42fd263f Fix wrong query label 2018-09-07 17:12:18 +02:00
emanuele-f
10426a5d3c Add nindex driver skelethon 2018-09-04 15:28:31 +02:00
emanuele-f
f91a385eda Fix fist/last point issue on InfluxDB when data is not aligned 2018-08-24 15:33:22 +02:00
emanuele-f
c400bd3992 Check existing InfluxDB database to avoid errors for unprivileged users
Closes #1937
2018-08-24 10:10:55 +02:00
emanuele-f
0004e08191 Add experimental support for 5sec granularity for host timeseries
To enable it (only on *InfluxDB* right now):

- uncomment HOST_NUM_TIMESERIES_POINTS in ntop_defines.h
- run `redis-cli set ntopng.prefs.30_sec_dump 1` and restart ntopng
2018-08-23 18:10:46 +02:00
emanuele-f
354dd697c0 Add max value checks for traffic and packets metrics 2018-08-20 16:19:01 +02:00
emanuele-f
0caf680dc0 Fix influx2Series bugs and add more tests 2018-08-17 15:00:42 +02:00
emanuele-f
102da47f26 Add initial point to the graph to match the selected time frame 2018-08-16 17:55:31 +02:00
emanuele-f
6ba093872f Fix multiple alignment issues with timeseries 2018-08-16 17:06:38 +02:00
emanuele-f
cacbdaa9e7 Fix compatibility with ntopng 3.4 RRD format 2018-08-13 18:41:45 +02:00
emanuele-f
d4ea15619f Add support for InfluxDB authentication 2018-08-13 14:36:06 +02:00
emanuele-f
8ba803a766 Improve influxDB version check and set 1.5.1 as min required 2018-08-10 18:54:30 +02:00
emanuele-f
20e8b4aaca Implement getLatestTimestamp API 2018-08-10 18:54:30 +02:00
emanuele-f
b2107b6f36 Move influxdb data export into driver api 2018-08-10 18:54:30 +02:00
emanuele-f
00e85721ff Fix bad values number check 2018-08-09 16:03:22 +02:00
emanuele-f
6ab25c9207 Properly skip InfluxDB empty points 2018-08-09 15:50:04 +02:00
emanuele-f
186fad5b09 Move regression and other tests to separate directory 2018-08-09 15:50:04 +02:00
emanuele-f
4f5878daec Fix influx2Series points bug with sampling 2018-08-09 15:50:04 +02:00
emanuele-f
d777c94219 Fix influx2Series points bug 2018-08-09 15:50:04 +02:00
emanuele-f
19ed505ff8 Improve influxdb listSeries 2018-08-09 11:58:40 +02:00
emanuele-f
1af40bd42f Improve InfluxDB support
- Automatically create the database at startup
- Add database name option
- Add maximum retention time option
- Check InfluxDB version
2018-08-03 16:32:06 +02:00
emanuele-f
303d36b382 Fix occasional RRD error in topk 2018-08-02 18:03:17 +02:00
emanuele-f
9e8b7e7f76 Fix influxdb missing past comparison line 2018-08-01 09:26:54 +02:00
emanuele-f
ffd6d9ac9f Add past period series for graphical comparison 2018-07-31 17:43:29 +02:00
emanuele-f
af1fc50ce6 Add preference to select the timeseries database to use 2018-07-30 12:53:55 +02:00
Simone Mainardi
0b86f17a21 Prevents RRD files exception on fresh ntopng installs
Prevents

25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/SSL.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/SSL.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/HTTP.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/HTTP.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/SSH.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/SSH.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/Unknown.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/Unknown.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/sFlow.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/sFlow.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/DNS.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/DNS.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/ICMP.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/ICMP.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
2018-07-25 13:26:12 +02:00
Simone Mainardi
d14fd57858 Adapts old bytes and packets rrd RRAs to the new format
The new timeseries library now transparently tries and uses old RRA names
for bytes and packets.

Fixes #1882
2018-07-25 13:10:34 +02:00
emanuele-f
5ec9557109 Timeseries driver documentation. 2018-07-22 21:07:01 +02:00