Commit graph

147 commits

Author SHA1 Message Date
Simone Mainardi
a0612895fe Implements slow rrd checks and updates in C 2020-02-19 19:28:07 +01:00
Simone Mainardi
a7ea7f76ed Implements detection of slow timeseries append 2020-02-19 18:45:36 +01:00
Simone Mainardi
0e64fd94d6 Implements deadlines for periodic and user scripts 2020-02-18 18:44:41 +01:00
Simone Mainardi
00158e8bc2 Implements error handling in line protocol generation 2020-02-16 14:30:08 +01:00
Simone Mainardi
dacaa7e3db Migrates font-awesome 5 fa to fas 2019-12-18 11:50:02 +01:00
emanuele-f
e28d0ec755 Reduce the 1d aggregation visualization interface when 1h is disabled 2019-12-18 11:44:04 +01:00
emanuele-f
262fc931f6 Disable InfluxDB 1h data rollup to reduce db pressure 2019-12-18 11:31:31 +01:00
emanuele-f
d86d58a80d Make InfluxDB query timeout configurable 2019-11-29 12:10:59 +01:00
emanuele-f
2a04c8fe35 Log influxdb queries in redis 2019-11-26 13:54:52 +01:00
emanuele-f
478c97b743 Inhibit some influxdb queries when the database does not respond
This reduces the gui loading time when such event occurs
2019-11-25 15:39:21 +01:00
emanuele-f
1fd65ac44c Flow user scripts enhancements
- Add title label in hash table utilization gauges
- List Hash Tables charts and Periodic Activities charts in a single page
- Replace Periodic Activities max duration column with time utilization percentage
- Add api to add a straight line in the charts
- Show max duration time as a straight line in Periodic Activities charts
- Move dropped flow calls charts to the Peridic Activities page
- Fix expert view number of calls 0
- Fix interface/host/network trigger alert label
- Move chart icon to separate column in redis and influxdb pages
- Fix interface menu selection in Hash Tables and Periodic Activities
- Highlight issues with a warning triangle in Hash Tables and Periodic Activities
- Fix some page navigation issues with extra_params
- Fix wrong schema graph options passed to nv_graph_utils
2019-11-20 20:09:45 +01:00
emanuele-f
4628ad3bcd Fix invalid upsampling due to missing points in composed charts 2019-11-14 20:03:43 +01:00
emanuele-f
8747af5f2b Reduce max queue length 2019-10-24 17:00:03 +02:00
emanuele-f
3882e2f26d Fix invalid failed exports key 2019-10-24 16:34:06 +02:00
emanuele-f
0d04eb2d5c Stop writing points if InfluxDB export is failing.
The dropped points are accounted and shown in the gui. Dropped points alert are generated as usual.

Fixes #2998
2019-10-24 16:09:01 +02:00
emanuele-f
10aa5542f8 Rework alertEntity functions to avoid modules circular dependencies
Fixes #2975
2019-10-23 13:01:57 +02:00
Simone Mainardi
002f1e7176 InfluxDB writes are now done with second precision
Implements #2935
2019-10-14 09:44:15 +02:00
Simone Mainardi
aa652145d0 Unifies flows, timeseries and top-talkers data retention
Implements #2897
2019-10-07 16:35:32 +02:00
Simone Mainardi
039034435b Prevents InfluxDB export retries on missing timeseries files
Fixes #2873
2019-09-27 10:18:25 +02:00
emanuele-f
907b260ece Fix for missing "other" series 2019-09-20 18:49:28 +02:00
emanuele-f
acac611c29 Add missing tags in last-timestamp check 2019-09-16 20:19:08 +02:00
emanuele-f
d29bb578c0 Add last-timestamp check to avoid adding invalid 0 points in the charts
The issue occurred in InfluxDB due to a delay between buffering and actual export.
This possible addresses #2853
2019-09-16 20:04:30 +02:00
emanuele-f
1d248331f6 Implement optimized exists query in InfluxDB
This avoids returning too much results when using standard listSeries
2019-09-05 16:02:20 +02:00
Simone Mainardi
3a5de882fe Fixes lua nil-call exception upon InfluxDB errors
Fixes
WARNING: Script failure [/home/simone/ntopng/scripts/callbacks/system/timeseries.lua][/home/simone/ntopng/scripts/lua/modules/alerts_api.lua:223: attempt to call a nil value (global 'alertEntity')]
2019-08-16 20:48:11 +02:00
emanuele-f
c183a577be Alerts API cleanup and JSON migration 2019-07-29 15:17:22 +02:00
Simone Mainardi
e28bb2ae96 Implements InfluxDB overall health checks 2019-07-04 12:49:39 +02:00
Simone Mainardi
5187a36d37 Implements flags to detect recent InfluxDB export failures and dropped points 2019-07-04 11:38:10 +02:00
emanuele-f
47e5d87e44 Show InfluxDB setup errors in the header
Fixes #2702
2019-07-03 16:59:29 +02:00
emanuele-f
0957bef845 Fix InfluxDB error with partial reply during setup
Fixes #2703
2019-07-03 14:30:14 +02:00
Simone Mainardi
9f3bb73ddc Keeps InfluxDB export stats since startup 2019-07-02 18:42:09 +02:00
Simone Mainardi
0e3de3efe6 Fixes InfluxDB memory calculation
Fixes #2694
2019-07-01 18:44:48 +02:00
Simone Mainardi
0ed48a245b Adds better description of InfluxDB monitored metrics 2019-06-30 12:56:04 +02:00
Simone Mainardi
80fb89b093 Uses a hash to keep InfluxDB counters (easier to delete in bulk) 2019-06-28 19:05:53 +02:00
Simone Mainardi
6ff75df695 Fixes InfluxDB alerts not set on the system interface 2019-06-28 18:51:12 +02:00
Simone Mainardi
9a5297f0d5 Prevents InfluxDB dropped points alerts from being triggered too often 2019-06-28 18:36:42 +02:00
Simone Mainardi
b34332ec60 Raises influxdb max export queue len to 200 2019-06-28 18:23:36 +02:00
Simone Mainardi
1019f024e4 Adds influxdb dropped points alert 2019-06-28 18:21:25 +02:00
emanuele-f
2df194a282 Implement alert release 2019-06-28 15:06:39 +02:00
emanuele-f
a9d3c78587 Alerts changes
NOTE: database schema changed. Existing alerts will be lost.

- Unified engaged and closed tables
- Simplified hosts engaged alert counters handling: periodically set by lua
- Removed alert engine and replaced with alert periodicity
- Now engage is implicitly derived from the alert end timestamp and periodicity
- New alerts_api.lua to easily emit alerts
- Removed past alerts counter aggregation by hash
- Alert notifications for non-flow alerts are now removed from C and triggered by lua
2019-06-28 10:47:17 +02:00
Simone Mainardi
775b6f8842 Adds InfluxDB total exports 2019-06-25 18:23:58 +02:00
Simone Mainardi
221b224abb Simplifies handling of Influxdb export stats using Lua 2019-06-25 17:22:41 +02:00
Simone Mainardi
9863cfd0ba Reworks InfluxDB export to better handle retries 2019-06-24 17:48:53 +02:00
emanuele-f
f9dd5e5e34 Implement retried/failed exports influxdb counters
Also add support for inline chart custom labels
2019-06-21 17:11:11 +02:00
emanuele-f
b42f795e44 Fix ts file incorrectly deleted after a failed export 2019-06-20 12:07:16 +02:00
emanuele-f
a2f4dc0c24 Add alert generated when InfluxDB export queue is too long 2019-06-19 15:33:56 +02:00
emanuele-f
3898e21558 Improve InfluxDB export logic
Retry multiple times before discarding a file. Also more log messages are now produced.
2019-06-19 14:50:31 +02:00
emanuele-f
956a3713dc InfluxDB export deadline 2019-06-19 11:42:14 +02:00
emanuele-f
89b9aebfd7 Delete ts export queue on startup and add missing error 2019-06-19 11:21:27 +02:00
emanuele-f
e43bb6680e Add support for other aggregation functions
monitored host RTT now uses MAX as aggregation function
2019-06-18 16:50:50 +02:00
emanuele-f
dba42d5842 Fix for 0 as last point while using aggregated data 2019-06-18 15:37:24 +02:00