Commit graph

2159 commits

Author SHA1 Message Date
Luca Deri
fcd8b0bedc Implements #3517 2020-03-08 11:55:41 +01:00
Simone Mainardi
ca48edd07e Removes slow rrd writes status which is no longer used 2020-03-06 18:35:17 +01:00
Simone Mainardi
48056f23c5 Handles errors and retries when executing sqlite statements
Fixes #3518
2020-03-06 16:04:50 +01:00
Simone Mainardi
6887b924fe Implements caching of alerts (avoids a sqlite lookup)
Implements #3483
2020-03-05 19:06:39 +01:00
emanuele-f
1c7dabf247 Pass current periodic activity time from C
This prevents possible inconsistencies between the C and lua time
2020-03-05 17:09:40 +01:00
Luca
31466a9832 Reworked periodic activities thread pool 2020-03-04 19:37:59 +01:00
emanuele-f
94f175194b Initial changes for MUD recording 2020-03-04 17:05:53 +01:00
Simone Mainardi
88693f5f6a Adds flow tcp seq issues (ooo, retx, lost) over ZMQ 2020-03-04 15:01:24 +01:00
Luca Deri
317e30a230 Reworked timeseries.lua behaviour to run more often with no deadline whatsoever 2020-03-04 12:37:08 +01:00
emanuele-f
0facf0e27d Implement host timeseries off/light/mode selection
Closes #3466
2020-03-03 15:52:04 +01:00
Alfredo Cardigliano
21462270e2 Fix use after free in zmq_remote_stats (#3496) 2020-03-03 13:50:02 +00:00
emanuele-f
b4dbb88492 Fix invalid source_id_last_zmq_remote_stats map item delete
Also fixes:
 - Missing source_id_last_zmq_remote_stats cleanup on shutdown
 - Leak in Ntop::registerInterface when maximum interfaces number is reached
 - Concurrent access to Ntop::registerInterface from registerSubInterface

Fixes #3495
2020-03-03 13:00:54 +01:00
Simone Mainardi
1e82eb073b Adds and enforces periodic activities max duration
Implements #3477
2020-03-02 19:09:54 +01:00
Alfredo Cardigliano
ce1e730203 -F nindex;debug to add all nindex info to the json 2020-03-02 10:59:08 +01:00
Simone Mainardi
cce4dcf568 Implements in-mem RRD writes queue, avoids json enc/dec 2020-02-29 22:30:00 +01:00
Simone Mainardi
9fd86de371 Reworks timeseries export into classes {InfluxDB,RRD}TimeseriesExporter 2020-02-29 18:25:33 +01:00
Simone Mainardi
488165c592 Adds drops counter when the RRD export queue is full 2020-02-29 10:09:02 +01:00
Alfredo Cardigliano
ef16436576 Support for EXPORTER_IPV6_ADDRESS parsing and disaggregation 2020-02-28 18:47:46 +01:00
Simone Mainardi
3405b7184e Writes new_flow timeseries every minute (not every second)
Implements #3456
2020-02-28 15:35:16 +01:00
Alfredo Cardigliano
765474fa70 Option -F nindex;{dump,load} to dump and load json flows (for debugging only) 2020-02-27 18:51:59 +01:00
Simone Mainardi
d41c0104d3 Generalizes rrd stats into timeseries stats 2020-02-27 19:11:44 +01:00
emanuele-f
297195abab Add dropped/stored/queries system stats for alerts 2020-02-27 13:27:47 +01:00
Alfredo Cardigliano
d83b2fb0ba Option to dump json flows to disk with -F nindex;debug 2020-02-26 16:34:46 +01:00
emanuele-f
a6dab125d5 Improve dropped alerts information
- Add informative label
- Add dropped alerts timeseries and chart
- Generate a system alert whenever alerts are dropped on a network interface
- Add a periodic activity warning when some alerts are dropped on that activity

Closes #3025
2020-02-26 16:05:19 +01:00
Alfredo Cardigliano
c3d3984285 Add more info to flow serialize (json) 2020-02-26 13:23:07 +01:00
Luca Deri
517184c2aa Reworked thread pool assignment 2020-02-26 08:28:10 +01:00
Simone Mainardi
4ed8cfecc3 Implements merge of multiple identical alerts
Implements #3430
2020-02-25 18:14:28 +01:00
emanuele-f
8abdb926cd Handle /proc/net/dev counters wrapping on 32bit platforms.
Fixes #3398
2020-02-25 16:56:58 +01:00
emanuele-f
a7d7d6e2ed Revert "Move host score to 5mins"
This reverts commit ab1aaeb38f.
2020-02-25 15:42:27 +01:00
Simone Mainardi
55cdb6c5ea Reworks slow rrd calc for periodic activites 2020-02-25 13:30:10 +01:00
emanuele-f
ab1aaeb38f Move host score to 5mins 2020-02-25 12:50:06 +01:00
emanuele-f
3cd4532b3e Improve periodic activities flags logic 2020-02-25 11:21:47 +01:00
Simone Mainardi
1840de69bf Implements total counters for RRD writes and dropped points 2020-02-24 23:38:34 +01:00
Simone Mainardi
de0f321470 Fix to count dropped RRD points 2020-02-24 19:36:10 +01:00
Simone Mainardi
a2237266ee Adds total rrd writes and drops to periodic scripts timeseries 2020-02-24 12:54:43 +01:00
emanuele-f
a428bb665f Add work completion indicator to ht_stats/stats/5min dump 2020-02-21 17:43:07 +01:00
Simone Mainardi
bd46b7268e Implements system alerts for not executed activities 2020-02-21 14:00:06 +01:00
emanuele-f
53c032f9f6 Add expected start/end time columns 2020-02-21 13:35:17 +01:00
Simone Mainardi
d1f11c7de7 Implements slow and not executed periodic activity alerts 2020-02-21 13:29:20 +01:00
emanuele-f
4944556992 Do not execute timeseries.lua if the driver is not InfluxDB 2020-02-21 12:08:07 +01:00
Simone Mainardi
f8b17578e7 Prevents reset of last and max scripts duration 2020-02-20 17:09:22 +01:00
emanuele-f
96299661b3 Implement periodic activities status monitor 2020-02-20 16:59:11 +01:00
Simone Mainardi
3f735c01a8 Implements periodic activites last queued time 2020-02-20 16:05:29 +01:00
Simone Mainardi
133f9e80bb Implements sleeping/queued/running states for threaded activities 2020-02-20 15:48:41 +01:00
Simone Mainardi
66975c70df Adds last start time to periodic activities 2020-02-20 00:04:45 +01:00
Simone Mainardi
a0612895fe Implements slow rrd checks and updates in C 2020-02-19 19:28:07 +01:00
Simone Mainardi
1cd375d756 Implements per-activity rrd writes duration 2020-02-19 15:34:29 +01:00
Simone Mainardi
214d9185d4 Implements variable deadlines depending on script periodicities 2020-02-18 19:27:57 +01:00
Simone Mainardi
0e64fd94d6 Implements deadlines for periodic and user scripts 2020-02-18 18:44:41 +01:00
Simone Mainardi
7f449f8e64 Implements deadline-related ntopng methods 2020-02-18 15:47:28 +01:00