Commit graph

40 commits

Author SHA1 Message Date
emanuele-f
2a1b30326d Move SNMP iteration function to pro 2018-12-10 18:37:46 +01:00
emanuele-f
95713ddfc6 Add driver:deleteOldData and delete old RRDs 2018-12-10 17:42:39 +01:00
emanuele-f
99a0cf0dd6 Optimize foreachLocalRRDHost for timeseries extraction 2018-10-12 14:20:27 +02:00
Simone Mainardi
df45cac64f Implements SNMP devices iterator
The iterator has the ability to stop when there is
an ntopng shutdown in progress
2018-09-12 20:01:19 +02:00
emanuele-f
a594e648c4 Generalize high resolution timeseries
In InfluxDB, 5 minutes timeseries are now written with a minimum of 1 minute resolution
2018-09-03 14:43:52 +02:00
emanuele-f
0004e08191 Add experimental support for 5sec granularity for host timeseries
To enable it (only on *InfluxDB* right now):

- uncomment HOST_NUM_TIMESERIES_POINTS in ntop_defines.h
- run `redis-cli set ntopng.prefs.30_sec_dump 1` and restart ntopng
2018-08-23 18:10:46 +02:00
emanuele-f
b2107b6f36 Move influxdb data export into driver api 2018-08-10 18:54:30 +02:00
emanuele-f
1af40bd42f Improve InfluxDB support
- Automatically create the database at startup
- Add database name option
- Add maximum retention time option
- Check InfluxDB version
2018-08-03 16:32:06 +02:00
emanuele-f
af1fc50ce6 Add preference to select the timeseries database to use 2018-07-30 12:53:55 +02:00
emanuele-f
44abcd442c Add POST timeout to prevent housekeeping from blocking indefinitely 2018-07-30 12:48:41 +02:00
Emanuele Faranda
4cbe45a948
New pro charts features and timeseries api (#1865)
* Integrate modified nvd3 library with zoom and multicharts working support

* Fix count in RRD driver

* Initial chart ajax migration

* Update nvd3 with zoom stack support

* Fix RRD listSeries with directories

* Work in progress graphs

* Compatibility fix

* Initial support for schema based api

* Add missing script

* Fix listSeries for existance check

* Implement topk timseries api

* Implement topk queries and fix labels and formats

* Migrate interface top sender and receivers

* Migrate charts to new API

* Move timeseries list for menu inside respective scripts

* Add support for extended labels

* Fix missing fields while chaning graph resolution

Also Rename drawRRD in drawGraphs

* Fix historical tabs

* Add missing time fence in influx topk

* Add graphs support for custom statistics visualization

* Initial support for graphs statistics footer

* Implement statistics in single graphs for RRD driver

* Move sampling function into the driver and fix graph statistics

* Fix max/min value offset

* Implement influxdb sampling use built-in FILL

* Implement stats and total serie in influxdb driver

* Update nvd3 with multiChart fixes

* Update nvd3 with new multiChart fixes

* RRD driver fixes

* Move metrics type from single metric to schema

* Handle ajax errors and empty data in charts

* Fix flow device interfaces graphs

* Use timeserie label as timeseries dropdown text

* Implement topk aggregation into one data serie

* ts_utils module now provides all the schemas

* Migrate ntop.exist(rrd) to ts_utils.exist

* Fix timeseries dropdown label

* L4 protos fixes for charts

* Migrate getProtoVolume to new API

* Integrate nvd3 fix for tooltip position

* Initial community graphs migration to timseries API

* Fix community timeseries dropdown and historical tabs

* Hide total serie by default

* Remove l4 protos from topk charts
2018-07-18 15:09:19 +02:00
emanuele-f
84c32d499b Implement experimental timeseries query API 2018-06-26 12:07:09 +02:00
Luca Deri
4a1c5c5696 Improved ntopng shutdown time/latency 2018-06-13 00:27:38 +02:00
Luca Deri
203404df5b Added changes to seamlessly use LuaJIT (default) or the standard (non JIT) Lua 2018-06-12 23:05:30 +02:00
emanuele-f
12d5e6a8bf Check influxdb export file name 2018-05-28 11:28:43 +02:00
emanuele-f
2b15b65f37 Use a single file for timeseries export 2018-05-28 10:28:26 +02:00
emanuele-f
42083f1865 Rework influxdb exporter 2018-05-25 13:52:06 +02:00
Luca Deri
7806e3caee Fixed invalid termination with pcap interfaces with multiple -i devices
Disabled debug trace
2018-04-04 21:16:22 +02:00
Luca Deri
945a9f9789 Added callback for local hosts 2018-03-27 23:38:16 +02:00
Luca Deri
b8a870b631 Experimental TS code 2018-03-24 11:37:04 +01:00
Luca Deri
f0c936c368 Updated (C) to 2018 2018-03-22 21:59:42 +01:00
emanuele-f
1079beb244 Rename local hosts iteration function 2017-11-30 17:40:01 +01:00
emanuele-f
d350a3131f Remove json from hosts checkpoint and fix host iterator bug 2017-11-30 16:26:22 +01:00
Simone Mainardi
6d4c9dc1cc Aligns max. rrd dump time with configured heartbeat 2017-11-29 15:40:58 +01:00
Simone Mainardi
4a9c17c8dd Reworks top-talkers to greatly improve speed 2017-11-28 11:41:42 +01:00
Simone Mainardi
46439a8c02 Greatly reduces the number of open files in second.lua 2017-11-23 15:51:12 +01:00
emanuele-f
0afb961ca2 Abstract lua batched iterator 2017-11-23 13:07:51 +01:00
Luca
caaf27d5a6 Implemented batched hosts and l2-devices walk 2017-11-22 19:38:08 +01:00
Simone Mainardi
6e3cb6324f Optimizes second.lua callback 2017-11-22 13:11:11 +01:00
Simone Mainardi
a99c7a9544 Implements old RRD files deletion (frontend + partial backend) 2017-10-04 19:39:32 +02:00
Simone Mainardi
c54b2523a1 Implements per-MAC RRDs (backend)
MAC bytes rrd is currently created if enabled from the preferences.
2017-10-04 13:07:13 +02:00
Simone Mainardi
7e1af2b196 Implements customizable per-interface RRD generation
Implements #1429
2017-09-06 16:02:32 +02:00
emanuele-f
9c973ca439 Move host activity detection code to attic 2017-05-17 22:19:37 +02:00
Simone Mainardi
3bedb40a97 Implements old aggregated flows cleanup 2017-05-16 22:57:57 +02:00
Luca
33f81e1f68 Small code rework in callback utils 2017-04-19 08:59:08 +02:00
Simone Mainardi
10f80539a7 Restores partial 5min aggregations 2017-03-23 23:52:27 +01:00
Simone Mainardi
796d503c89 Restores broken VLAN rrds 2017-03-23 22:47:53 +01:00
emanuele-f
84b8499a23 Add check to report periodic 5min script running out of time 2017-03-15 15:54:51 +01:00
Josh Soref
1861217869 spelling: excluding 2017-03-07 05:05:13 +00:00
emanuele-f
2affcfb208 Clean callback scripts code 2017-03-04 12:39:48 +01:00