Commit graph

357 commits

Author SHA1 Message Date
Simone Mainardi
4f30ce04a3 RRD queue fixes and debug info 2020-03-01 13:50:58 +01:00
Simone Mainardi
cce4dcf568 Implements in-mem RRD writes queue, avoids json enc/dec 2020-02-29 22:30:00 +01:00
Simone Mainardi
488165c592 Adds drops counter when the RRD export queue is full 2020-02-29 10:09:02 +01:00
Simone Mainardi
a288bbf40c Adds experimental RRD write queue 2020-02-28 19:47:44 +01:00
Simone Mainardi
19dabd2c97 Adds timeseries for system alerts counters 2020-02-28 17:54:16 +01:00
Luca Deri
8e1da33141 Implemented debug code for RRD 2020-02-28 17:20:30 +01:00
Simone Mainardi
3405b7184e Writes new_flow timeseries every minute (not every second)
Implements #3456
2020-02-28 15:35:16 +01:00
Simone Mainardi
474fe19e07 Writes CPU load every 5 secs (/proc/loadavg doesn't update faster)
Additional fix for #3465
2020-02-28 11:55:26 +01:00
Simone Mainardi
918ab6283c Fixes RRD points always written as integers without decimals
Fixes #3465
2020-02-28 10:56:13 +01:00
Simone Mainardi
eaa3935a8e Adds and charts CPU states active and idle 2020-02-28 10:20:11 +01:00
Simone Mainardi
d41c0104d3 Generalizes rrd stats into timeseries stats 2020-02-27 19:11:44 +01:00
Simone Mainardi
f6bd1b3493 Adds timeseries of iowait 2020-02-27 18:20:42 +01:00
emanuele-f
b194643a18 Join exported and dropped flows into a single timeseries 2020-02-27 12:15:53 +01:00
emanuele-f
ea4f936d07 Join interface packets and drops into a single timeseries 2020-02-27 12:09:43 +01:00
Luca Deri
301991836d Added some debug code 2020-02-27 08:42:10 +01:00
emanuele-f
7b6ce10940 Improve empty RRD files detection for faster recovery 2020-02-26 19:09:08 +01:00
emanuele-f
a6dab125d5 Improve dropped alerts information
- Add informative label
- Add dropped alerts timeseries and chart
- Generate a system alert whenever alerts are dropped on a network interface
- Add a periodic activity warning when some alerts are dropped on that activity

Closes #3025
2020-02-26 16:05:19 +01:00
Simone Mainardi
d5fab4169c Marks certain interface minute timeseries as critical 2020-02-26 14:17:44 +01:00
emanuele-f
da805487d3 Typo fix 2020-02-26 10:53:33 +01:00
emanuele-f
c777e9f8da Fix for influxdb setup error 2020-02-26 10:52:10 +01:00
emanuele-f
a7d7d6e2ed Revert "Move host score to 5mins"
This reverts commit ab1aaeb38f.
2020-02-25 15:42:27 +01:00
emanuele-f
f689f50e2a Fix host:score schema change errors 2020-02-25 15:03:36 +01:00
emanuele-f
ab1aaeb38f Move host score to 5mins 2020-02-25 12:50:06 +01:00
Simone Mainardi
1840de69bf Implements total counters for RRD writes and dropped points 2020-02-24 23:38:34 +01:00
Simone Mainardi
de0f321470 Fix to count dropped RRD points 2020-02-24 19:36:10 +01:00
Simone Mainardi
c0600a9731 Flow user scripts ts marked as critical 2020-02-24 16:43:41 +01:00
Simone Mainardi
a2237266ee Adds total rrd writes and drops to periodic scripts timeseries 2020-02-24 12:54:43 +01:00
emanuele-f
1a6d170188 Add slow_rrd warning and set interface ts as critical 2020-02-21 10:44:24 +01:00
Simone Mainardi
a0612895fe Implements slow rrd checks and updates in C 2020-02-19 19:28:07 +01:00
Simone Mainardi
a7ea7f76ed Implements detection of slow timeseries append 2020-02-19 18:45:36 +01:00
emanuele-f
7c534a557c Add the is_critical_ts flag to force timeseries write 2020-02-19 15:31:36 +01:00
emanuele-f
d1140ec9fd Avoid timeseries read operations to display the chart icon
Now the icon is displayed whenever the timeseries are enabled for the given context
2020-02-19 13:27:20 +01:00
Simone Mainardi
214d9185d4 Implements variable deadlines depending on script periodicities 2020-02-18 19:27:57 +01:00
Simone Mainardi
0e64fd94d6 Implements deadlines for periodic and user scripts 2020-02-18 18:44:41 +01:00
Simone Mainardi
00158e8bc2 Implements error handling in line protocol generation 2020-02-16 14:30:08 +01:00
emanuele-f
8d51dae0e5 Implement Misbehaving vs Alerted flows chart 2020-01-27 15:37:36 +01:00
Luca Deri
170bc60f19 Updated (C) 2020-01-08 23:52:51 +01:00
Simone Mainardi
b44de6e18d Implements discarded probing traffic counters and timeseries 2019-12-31 16:01:24 +01:00
Simone Mainardi
c873aee41b Implement counter and chart for new flows per second 2019-12-27 12:29:55 +01:00
Simone Mainardi
dacaa7e3db Migrates font-awesome 5 fa to fas 2019-12-18 11:50:02 +01:00
emanuele-f
e28d0ec755 Reduce the 1d aggregation visualization interface when 1h is disabled 2019-12-18 11:44:04 +01:00
emanuele-f
262fc931f6 Disable InfluxDB 1h data rollup to reduce db pressure 2019-12-18 11:31:31 +01:00
emanuele-f
a3432e00e8 Implement ntopng plugins
Plugins are a convenient way to group together related lua scripts.
Their primary use case is to group user scripts and their alert/status
definition.
The builtin ntopng user scripts and definitions are now
packed into plugins directories. In future, we will support loading of
user created plugins.
Plugins are loaded at startup into some runtime directories and then
used. Other changes provided by this commit include:

- Add sample flow logger plugin
- Initial support for system user scripts
- Rename edge to threshold
- Migrate system probes to user scripts/plugins
- Migrate scripts to more explicit alerts_api.checkThresholdAlert api
2019-12-10 09:25:57 +01:00
emanuele-f
d86d58a80d Make InfluxDB query timeout configurable 2019-11-29 12:10:59 +01:00
emanuele-f
2a04c8fe35 Log influxdb queries in redis 2019-11-26 13:54:52 +01:00
Simone Mainardi
49ddb55620 Adds interface TCP keepalive packets 2019-11-25 16:02:04 +01:00
emanuele-f
478c97b743 Inhibit some influxdb queries when the database does not respond
This reduces the gui loading time when such event occurs
2019-11-25 15:39:21 +01:00
emanuele-f
20ef1a4ebc Fix ts_utils.listSeries in redis.lua being performed on every page load
This was caused by probe.getTimeseriesMenu being called at every page load by the timeseries
code to load the schemas. probe.loadSchemas is now called instead.
2019-11-25 15:39:21 +01:00
emanuele-f
c8a13abcf7 RRD path fix 2019-11-21 11:46:06 +01:00
emanuele-f
1fd65ac44c Flow user scripts enhancements
- Add title label in hash table utilization gauges
- List Hash Tables charts and Periodic Activities charts in a single page
- Replace Periodic Activities max duration column with time utilization percentage
- Add api to add a straight line in the charts
- Show max duration time as a straight line in Periodic Activities charts
- Move dropped flow calls charts to the Peridic Activities page
- Fix expert view number of calls 0
- Fix interface/host/network trigger alert label
- Move chart icon to separate column in redis and influxdb pages
- Fix interface menu selection in Hash Tables and Periodic Activities
- Highlight issues with a warning triangle in Hash Tables and Periodic Activities
- Fix some page navigation issues with extra_params
- Fix wrong schema graph options passed to nv_graph_utils
2019-11-20 20:09:45 +01:00