Commit graph

251 commits

Author SHA1 Message Date
emanuele-f
ffe2c629bc Implement timeseries cleanup
Closes #1940
2018-09-11 17:16:56 +02:00
emanuele-f
42dcd75485 Fix invalid mac addresses graphs path 2018-09-11 12:30:05 +02:00
emanuele-f
91ae4c5172 Implement experimental hourly deltas writes
redis-cli set "ntopng.prefs.enable_ts_deltas_writes" "1"
2018-09-07 17:12:18 +02:00
emanuele-f
9e42fd263f Fix wrong query label 2018-09-07 17:12:18 +02:00
emanuele-f
10426a5d3c Add nindex driver skelethon 2018-09-04 15:28:31 +02:00
emanuele-f
f91a385eda Fix fist/last point issue on InfluxDB when data is not aligned 2018-08-24 15:33:22 +02:00
emanuele-f
c400bd3992 Check existing InfluxDB database to avoid errors for unprivileged users
Closes #1937
2018-08-24 10:10:55 +02:00
emanuele-f
0004e08191 Add experimental support for 5sec granularity for host timeseries
To enable it (only on *InfluxDB* right now):

- uncomment HOST_NUM_TIMESERIES_POINTS in ntop_defines.h
- run `redis-cli set ntopng.prefs.30_sec_dump 1` and restart ntopng
2018-08-23 18:10:46 +02:00
emanuele-f
354dd697c0 Add max value checks for traffic and packets metrics 2018-08-20 16:19:01 +02:00
emanuele-f
0caf680dc0 Fix influx2Series bugs and add more tests 2018-08-17 15:00:42 +02:00
emanuele-f
102da47f26 Add initial point to the graph to match the selected time frame 2018-08-16 17:55:31 +02:00
emanuele-f
6ba093872f Fix multiple alignment issues with timeseries 2018-08-16 17:06:38 +02:00
emanuele-f
cacbdaa9e7 Fix compatibility with ntopng 3.4 RRD format 2018-08-13 18:41:45 +02:00
emanuele-f
d4ea15619f Add support for InfluxDB authentication 2018-08-13 14:36:06 +02:00
emanuele-f
8ba803a766 Improve influxDB version check and set 1.5.1 as min required 2018-08-10 18:54:30 +02:00
emanuele-f
20e8b4aaca Implement getLatestTimestamp API 2018-08-10 18:54:30 +02:00
emanuele-f
b2107b6f36 Move influxdb data export into driver api 2018-08-10 18:54:30 +02:00
emanuele-f
00e85721ff Fix bad values number check 2018-08-09 16:03:22 +02:00
emanuele-f
6ab25c9207 Properly skip InfluxDB empty points 2018-08-09 15:50:04 +02:00
emanuele-f
186fad5b09 Move regression and other tests to separate directory 2018-08-09 15:50:04 +02:00
emanuele-f
4f5878daec Fix influx2Series points bug with sampling 2018-08-09 15:50:04 +02:00
emanuele-f
d777c94219 Fix influx2Series points bug 2018-08-09 15:50:04 +02:00
emanuele-f
19ed505ff8 Improve influxdb listSeries 2018-08-09 11:58:40 +02:00
emanuele-f
1af40bd42f Improve InfluxDB support
- Automatically create the database at startup
- Add database name option
- Add maximum retention time option
- Check InfluxDB version
2018-08-03 16:32:06 +02:00
emanuele-f
303d36b382 Fix occasional RRD error in topk 2018-08-02 18:03:17 +02:00
emanuele-f
9e8b7e7f76 Fix influxdb missing past comparison line 2018-08-01 09:26:54 +02:00
emanuele-f
ffd6d9ac9f Add past period series for graphical comparison 2018-07-31 17:43:29 +02:00
emanuele-f
af1fc50ce6 Add preference to select the timeseries database to use 2018-07-30 12:53:55 +02:00
Simone Mainardi
0b86f17a21 Prevents RRD files exception on fresh ntopng installs
Prevents

25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/SSL.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/SSL.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/HTTP.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/HTTP.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/SSH.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/SSH.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/Unknown.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/Unknown.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/sFlow.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/sFlow.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/DNS.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/DNS.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
25/Jul/2018 13:18:19 [LuaEngine.cpp:4325] ERROR: Error 'opening '/var/tmp/ntopng/0/rrd/ICMP.rrd': No such file or directory' while calling rrd_fetch_r(/var/tmp/ntopng/0/rrd/ICMP.rrd, AVERAGE): is the RRD corrupted perhaps?
25/Jul/2018 13:18:19 [dashboard.lua:78] [rrd.lua:327] RRD driver does not support listSeries on multiple tags
2018-07-25 13:26:12 +02:00
Simone Mainardi
d14fd57858 Adapts old bytes and packets rrd RRAs to the new format
The new timeseries library now transparently tries and uses old RRA names
for bytes and packets.

Fixes #1882
2018-07-25 13:10:34 +02:00
emanuele-f
5ec9557109 Timeseries driver documentation. 2018-07-22 21:07:01 +02:00
emanuele-f
efaabaa2c6 Fix swapped columns in RRD driver 2018-07-20 20:02:46 +02:00
emanuele-f
0dbf689987 Add test for influx2Series 2018-07-20 19:32:20 +02:00
emanuele-f
12c8fc3156 Fix occasional series ponts differences in InfluxDB 2018-07-20 19:12:29 +02:00
emanuele-f
3612c64f91 Fix nil data_type and add series consinstency check 2018-07-20 15:38:13 +02:00
emanuele-f
4cafac6a81 Fix InfluxDB charts statistics 2018-07-20 14:39:17 +02:00
emanuele-f
d0169db76d Fix issue with empty points in influxDB gauge metrics 2018-07-20 14:39:17 +02:00
emanuele-f
667bc2e8c6 Move ninetififthPercentile to common utilities 2018-07-20 14:39:17 +02:00
emanuele-f
61e2d6f85e InfluxDB chart fixes and query examples 2018-07-19 17:21:41 +02:00
Emanuele Faranda
4cbe45a948
New pro charts features and timeseries api (#1865)
* Integrate modified nvd3 library with zoom and multicharts working support

* Fix count in RRD driver

* Initial chart ajax migration

* Update nvd3 with zoom stack support

* Fix RRD listSeries with directories

* Work in progress graphs

* Compatibility fix

* Initial support for schema based api

* Add missing script

* Fix listSeries for existance check

* Implement topk timseries api

* Implement topk queries and fix labels and formats

* Migrate interface top sender and receivers

* Migrate charts to new API

* Move timeseries list for menu inside respective scripts

* Add support for extended labels

* Fix missing fields while chaning graph resolution

Also Rename drawRRD in drawGraphs

* Fix historical tabs

* Add missing time fence in influx topk

* Add graphs support for custom statistics visualization

* Initial support for graphs statistics footer

* Implement statistics in single graphs for RRD driver

* Move sampling function into the driver and fix graph statistics

* Fix max/min value offset

* Implement influxdb sampling use built-in FILL

* Implement stats and total serie in influxdb driver

* Update nvd3 with multiChart fixes

* Update nvd3 with new multiChart fixes

* RRD driver fixes

* Move metrics type from single metric to schema

* Handle ajax errors and empty data in charts

* Fix flow device interfaces graphs

* Use timeserie label as timeseries dropdown text

* Implement topk aggregation into one data serie

* ts_utils module now provides all the schemas

* Migrate ntop.exist(rrd) to ts_utils.exist

* Fix timeseries dropdown label

* L4 protos fixes for charts

* Migrate getProtoVolume to new API

* Integrate nvd3 fix for tooltip position

* Initial community graphs migration to timseries API

* Fix community timeseries dropdown and historical tabs

* Hide total serie by default

* Remove l4 protos from topk charts
2018-07-18 15:09:19 +02:00
emanuele-f
f2ad866bd0 Fix influx_query error 2018-06-27 18:18:29 +02:00
emanuele-f
5d50622341 Use schema name in timeseries API 2018-06-27 17:18:23 +02:00
emanuele-f
39a7375727 Add start_time filter in ts_utils.listSeries 2018-06-27 16:47:33 +02:00
emanuele-f
bd8ca9b6e7 Fix negative values handler in influxdb queries 2018-06-27 13:05:25 +02:00
emanuele-f
1f7cbfd13e Implement ts_utils.listSeries 2018-06-26 18:30:12 +02:00
emanuele-f
84c32d499b Implement experimental timeseries query API 2018-06-26 12:07:09 +02:00
Luca Deri
203404df5b Added changes to seamlessly use LuaJIT (default) or the standard (non JIT) Lua 2018-06-12 23:05:30 +02:00
emanuele-f
2f89d21b36 Remove lua_utils dependency from timeseries 2018-06-01 10:41:54 +02:00
emanuele-f
2b15b65f37 Use a single file for timeseries export 2018-05-28 10:28:26 +02:00
emanuele-f
42083f1865 Rework influxdb exporter 2018-05-25 13:52:06 +02:00