Commit graph

477 commits

Author SHA1 Message Date
emanuele-f
7c534a557c Add the is_critical_ts flag to force timeseries write 2020-02-19 15:31:36 +01:00
emanuele-f
d1140ec9fd Avoid timeseries read operations to display the chart icon
Now the icon is displayed whenever the timeseries are enabled for the given context
2020-02-19 13:27:20 +01:00
Simone Mainardi
214d9185d4 Implements variable deadlines depending on script periodicities 2020-02-18 19:27:57 +01:00
Simone Mainardi
0e64fd94d6 Implements deadlines for periodic and user scripts 2020-02-18 18:44:41 +01:00
Simone Mainardi
00158e8bc2 Implements error handling in line protocol generation 2020-02-16 14:30:08 +01:00
emanuele-f
8d51dae0e5 Implement Misbehaving vs Alerted flows chart 2020-01-27 15:37:36 +01:00
Luca Deri
170bc60f19 Updated (C) 2020-01-08 23:52:51 +01:00
Simone Mainardi
b44de6e18d Implements discarded probing traffic counters and timeseries 2019-12-31 16:01:24 +01:00
Simone Mainardi
c873aee41b Implement counter and chart for new flows per second 2019-12-27 12:29:55 +01:00
Simone Mainardi
dacaa7e3db Migrates font-awesome 5 fa to fas 2019-12-18 11:50:02 +01:00
emanuele-f
e28d0ec755 Reduce the 1d aggregation visualization interface when 1h is disabled 2019-12-18 11:44:04 +01:00
emanuele-f
262fc931f6 Disable InfluxDB 1h data rollup to reduce db pressure 2019-12-18 11:31:31 +01:00
emanuele-f
a3432e00e8 Implement ntopng plugins
Plugins are a convenient way to group together related lua scripts.
Their primary use case is to group user scripts and their alert/status
definition.
The builtin ntopng user scripts and definitions are now
packed into plugins directories. In future, we will support loading of
user created plugins.
Plugins are loaded at startup into some runtime directories and then
used. Other changes provided by this commit include:

- Add sample flow logger plugin
- Initial support for system user scripts
- Rename edge to threshold
- Migrate system probes to user scripts/plugins
- Migrate scripts to more explicit alerts_api.checkThresholdAlert api
2019-12-10 09:25:57 +01:00
emanuele-f
d86d58a80d Make InfluxDB query timeout configurable 2019-11-29 12:10:59 +01:00
emanuele-f
2a04c8fe35 Log influxdb queries in redis 2019-11-26 13:54:52 +01:00
Simone Mainardi
49ddb55620 Adds interface TCP keepalive packets 2019-11-25 16:02:04 +01:00
emanuele-f
478c97b743 Inhibit some influxdb queries when the database does not respond
This reduces the gui loading time when such event occurs
2019-11-25 15:39:21 +01:00
emanuele-f
20ef1a4ebc Fix ts_utils.listSeries in redis.lua being performed on every page load
This was caused by probe.getTimeseriesMenu being called at every page load by the timeseries
code to load the schemas. probe.loadSchemas is now called instead.
2019-11-25 15:39:21 +01:00
emanuele-f
c8a13abcf7 RRD path fix 2019-11-21 11:46:06 +01:00
emanuele-f
1fd65ac44c Flow user scripts enhancements
- Add title label in hash table utilization gauges
- List Hash Tables charts and Periodic Activities charts in a single page
- Replace Periodic Activities max duration column with time utilization percentage
- Add api to add a straight line in the charts
- Show max duration time as a straight line in Periodic Activities charts
- Move dropped flow calls charts to the Peridic Activities page
- Fix expert view number of calls 0
- Fix interface/host/network trigger alert label
- Move chart icon to separate column in redis and influxdb pages
- Fix interface menu selection in Hash Tables and Periodic Activities
- Highlight issues with a warning triangle in Hash Tables and Periodic Activities
- Fix some page navigation issues with extra_params
- Fix wrong schema graph options passed to nv_graph_utils
2019-11-20 20:09:45 +01:00
emanuele-f
fc962d73f3 Improve and clean up pending flow scripts call logic
Pending calls are now visualized into the FlowHash "Call Stats" chart
2019-11-15 18:10:16 +01:00
Alfredo Cardigliano
d2b7cea9c8 Keeping track of resident memory only (fix #3040) 2019-11-15 09:42:08 +01:00
emanuele-f
4628ad3bcd Fix invalid upsampling due to missing points in composed charts 2019-11-14 20:03:43 +01:00
Simone Mainardi
47169b82be Reworks counting of skipped flow lua calls 2019-11-11 18:22:37 +01:00
emanuele-f
4d45ffff08 Add missed calls stats 2019-11-08 17:13:24 +01:00
emanuele-f
8b6c3cb80f Fix slack alert endpoint error 2019-11-05 16:39:28 +01:00
emanuele-f
cfc1f0fe57 Fix ht:lua_calls chart
Fixes #3021
2019-10-31 18:06:02 +01:00
emanuele-f
33949d31fd Rework benchmark stats and charts 2019-10-31 17:48:53 +01:00
emanuele-f
e978a83151 Improve user scripts charts
Fixes #3020
2019-10-31 13:30:24 +01:00
emanuele-f
34c196d99e User scripts stats improvements 2019-10-30 10:53:54 +01:00
Simone Mainardi
cce73c2f44 Implements lua interpreters telemetry 2019-10-28 23:47:03 +01:00
Simone Mainardi
dc748b1b6d Implements stats for periodic scripts duration 2019-10-28 17:10:03 +01:00
Alfredo Cardigliano
b42989154c Drawing active items in addition to idle in the internals chart 2019-10-25 12:14:53 +02:00
emanuele-f
58a12f1241 Add user scripts benchmark charts
Implements #2999
2019-10-24 20:24:13 +02:00
emanuele-f
8747af5f2b Reduce max queue length 2019-10-24 17:00:03 +02:00
emanuele-f
3882e2f26d Fix invalid failed exports key 2019-10-24 16:34:06 +02:00
emanuele-f
0d04eb2d5c Stop writing points if InfluxDB export is failing.
The dropped points are accounted and shown in the gui. Dropped points alert are generated as usual.

Fixes #2998
2019-10-24 16:09:01 +02:00
Simone Mainardi
955eed4b50 Reworks idling and purging of hash table entries to make it faster 2019-10-24 15:48:18 +02:00
Simone Mainardi
60e657c0d2 Makes hash table state counters as gauges 2019-10-23 14:25:12 +02:00
Simone Mainardi
15e17a801a Implements per-state hash entry counters and writes them to ts 2019-10-23 13:09:02 +02:00
emanuele-f
10aa5542f8 Rework alertEntity functions to avoid modules circular dependencies
Fixes #2975
2019-10-23 13:01:57 +02:00
Simone Mainardi
3950c3ddc8 Support for 5-min timeseries resolution in InfluxDB 2019-10-15 15:06:20 +02:00
Simone Mainardi
002f1e7176 InfluxDB writes are now done with second precision
Implements #2935
2019-10-14 09:44:15 +02:00
Simone Mainardi
aa652145d0 Unifies flows, timeseries and top-talkers data retention
Implements #2897
2019-10-07 16:35:32 +02:00
Simone Mainardi
039034435b Prevents InfluxDB export retries on missing timeseries files
Fixes #2873
2019-09-27 10:18:25 +02:00
emanuele-f
907b260ece Fix for missing "other" series 2019-09-20 18:49:28 +02:00
emanuele-f
acac611c29 Add missing tags in last-timestamp check 2019-09-16 20:19:08 +02:00
emanuele-f
d29bb578c0 Add last-timestamp check to avoid adding invalid 0 points in the charts
The issue occurred in InfluxDB due to a delay between buffering and actual export.
This possible addresses #2853
2019-09-16 20:04:30 +02:00
Simone Mainardi
165a53d18e Adds timeseries of ZMQ messages received and dropped 2019-09-10 19:49:16 +02:00
emanuele-f
1d248331f6 Implement optimized exists query in InfluxDB
This avoids returning too much results when using standard listSeries
2019-09-05 16:02:20 +02:00