Commit graph

354 commits

Author SHA1 Message Date
Simone Mainardi
188ec66c25 Implements scriptable SNMP devices alerts 2019-11-22 18:00:31 +01:00
Alfredo Cardigliano
88a2c9c36f Email Notification improvements: add smtps support, add username/password configuration 2019-11-22 11:34:22 +01:00
Simone Mainardi
5b81a3ab9e Implements low goodput calculation in lua 2019-11-21 16:37:33 +01:00
Simone Mainardi
a893e0a2c0 Implements IP addresses retrieval by Mac address 2019-11-20 18:44:01 +01:00
Simone Mainardi
9cb566ed41 Computes lua scripts deadlines in C to prevent missing scheduled activities 2019-11-19 13:02:13 +01:00
emanuele-f
3dd7d2215d Remove matchesL7 call 2019-11-15 16:58:59 +01:00
emanuele-f
7d0888d302 Flow user scripts optimizations 2019-11-15 15:52:36 +01:00
Alfredo Cardigliano
e38835a603 Rename SSL to TLS (fix #3013) 2019-11-15 12:40:01 +01:00
emanuele-f
60fc7e0cfb Improve flow.lua and add statistics 2019-11-15 10:51:19 +01:00
emanuele-f
c19bda5425 Move internal alerts queue from redis to C 2019-11-14 12:07:29 +01:00
emanuele-f
df0556cb87 Optimize flow alerts generation
This provides a ~10x speedup by performing the JSON serialization work in C
(and thus avoiding Lua->C overhead). This also implements two in-memory alerts
queues (one for sqlite and one for the notifications) in order to reduce Redis load.
Alerts queue are now global instead of per-interface as there is only 1 dequeing thread.
2019-11-14 11:54:13 +01:00
Simone Mainardi
05e6dc1677 Implements bi- and mono-directional flow callbacks filter
Implements #3055
2019-11-13 18:14:49 +01:00
Simone Mainardi
7b7b7f9eec Fixes use of THW information to detect probing 2019-11-13 16:49:31 +01:00
emanuele-f
739c87a52d Initial flow user scripts optimization 2019-11-11 18:04:48 +01:00
emanuele-f
26abe5e958 Split flow.getDurationInfo in smaller functions 2019-11-08 20:14:02 +01:00
Luca
5f72aa0c2e nDPI cleanup 2019-11-08 11:38:03 +00:00
Luca
f3d207a840 Disabled category cleanup 2019-11-07 06:55:02 +00:00
Luca
1fb32a0795 Unified nDPI struct across interfaces 2019-11-06 23:02:35 +00:00
Luca
077d112392 Merge branch 'dev' of https://github.com/ntop/ntopng into dev 2019-11-06 09:18:19 +00:00
Luca
0e523a4308 Changes to minimize the risk of categories reload 2019-11-06 09:17:53 +00:00
Alfredo Cardigliano
cb2f37529e Reworked storeFlowAlert (using Lua table instead of many params now) 2019-11-06 10:02:15 +01:00
emanuele-f
54140b6f1a Migrate alertable disabled alerts preference to lua
This avoids performing multiple hget on redis, thus increasing performance
2019-11-05 14:59:38 +01:00
Luca
aad44a5bca Merge branch 'dev' of https://github.com/ntop/ntopng into dev 2019-11-04 17:58:26 +01:00
Luca
71532321b5 Implemented redis stats 2019-11-04 17:58:12 +01:00
emanuele-f
675adcf90e Migrate hosts disabled flow status preference to lua
By loading all the preferences at once in flow.lua setup() the
redis load is reduced and design is simpler.
2019-11-04 16:50:26 +01:00
emanuele-f
01953cf76f Harden categories reload to avoid crashes if multiple housekeeping run concurrently 2019-11-04 12:01:27 +01:00
Luca Deri
d61470c653 Workaround for #3033 but a proper fix is necessary 2019-11-02 20:22:35 +01:00
Simone Mainardi
c171574957 Reads CPU load from /proc/loadavg 2019-11-01 18:35:57 +01:00
Alfredo Cardigliano
d10dfc7762 Deferred flow alerts insertion through a redis queue. Removed alerts DB select when printing flow details. 2019-10-31 12:53:23 +01:00
Simone Mainardi
64b3892909 Counts user scripts execution time using clock ticks 2019-10-30 17:52:59 +01:00
emanuele-f
378a1e2cd8 Optimize nDPI categories reload to avoid packet drops 2019-10-29 12:07:27 +01:00
Simone Mainardi
cce73c2f44 Implements lua interpreters telemetry 2019-10-28 23:47:03 +01:00
Simone Mainardi
dc748b1b6d Implements stats for periodic scripts duration 2019-10-28 17:10:03 +01:00
Simone Mainardi
f98dd234e8 Decouples periodic stats updates using a thread pool 2019-10-28 12:21:57 +01:00
Simone Mainardi
68246efd01 Decouples periodic hash table updates using a thread pool 2019-10-27 17:40:07 +01:00
Alfredo Cardigliano
c7120e23f3 Hide periodic user scripts in pcap dump mode (unless --original-speed is specified) 2019-10-25 16:45:23 +02:00
emanuele-f
0d04eb2d5c Stop writing points if InfluxDB export is failing.
The dropped points are accounted and shown in the gui. Dropped points alert are generated as usual.

Fixes #2998
2019-10-24 16:09:01 +02:00
Alfredo Cardigliano
afbb34e262 TCP SYN Scan detection (implements #2963) 2019-10-24 15:35:26 +02:00
emanuele-f
d1d789ea88 Improve category lists limits and reporting 2019-10-23 18:12:24 +02:00
Simone Mainardi
15e17a801a Implements per-state hash entry counters and writes them to ts 2019-10-23 13:09:02 +02:00
emanuele-f
ac8d6f1110 Fix host MUD user script 2019-10-22 15:35:19 +02:00
Simone Mainardi
7683989920 Fixes crash after flow status migration to Lua 2019-10-22 11:31:32 +02:00
emanuele-f
b3374651ce Merge branch 'alerts_cleanup' into dev 2019-10-22 10:50:21 +02:00
emanuele-f
b3a8c6d49a Migrate C flow status alerts to Lua user scripts
- Alerts and flow status cleanup
- Community flow user scripts migration
- Implement scripts filters by l7 proto and packet interface only
- Migrate flow2statusinfojson
- Lower flow periodic update to 30 seconds if there is flow activity
- Display flow scripts without a gui section
2019-10-22 10:42:22 +02:00
Simone Mainardi
1ec35c3042 Fixes and cleanup of disabled alerts 2019-10-22 10:33:42 +02:00
Luca Deri
fa10f4b6e1 Compilation fixes 2019-10-21 22:56:31 +02:00
Simone Mainardi
661dbbbeb0 Removes unnecessary alerts expired code 2019-10-21 17:47:17 +02:00
Simone Mainardi
e80dc962f4 Optimizes host.getFullInfo with smaller functions in periodic scripts 2019-10-21 16:21:03 +02:00
Simone Mainardi
f8443ff03d Disk space reclaim and defrag of alerts db 2019-10-17 12:12:28 +02:00
Simone Mainardi
bdbd44819c Fixes nEdge flows drop 2019-10-16 19:17:14 +02:00