Commit graph

509 commits

Author SHA1 Message Date
emanuele-f
675adcf90e Migrate hosts disabled flow status preference to lua
By loading all the preferences at once in flow.lua setup() the
redis load is reduced and design is simpler.
2019-11-04 16:50:26 +01:00
emanuele-f
e978a83151 Improve user scripts charts
Fixes #3020
2019-10-31 13:30:24 +01:00
Simone Mainardi
2d0b9e005a Generalizes hosts/flows periodic stats update 2019-10-28 12:07:11 +01:00
Simone Mainardi
68246efd01 Decouples periodic hash table updates using a thread pool 2019-10-27 17:40:07 +01:00
Simone Mainardi
00f8c7d681 Handles slow flow scripts causing long delays and slow purges 2019-10-25 12:16:01 +02:00
Simone Mainardi
02464a9536 Additionsl inc/dec uses fixes 2019-10-24 17:28:57 +02:00
Alfredo Cardigliano
c29409673b Added alerts for TCP SYN Scan Host and Network as victims (implements #2963) 2019-10-24 16:59:33 +02:00
Simone Mainardi
249f804c4c Handles inc/dec uses after new hash entries purging 2019-10-24 16:58:08 +02:00
Alfredo Cardigliano
afbb34e262 TCP SYN Scan detection (implements #2963) 2019-10-24 15:35:26 +02:00
Simone Mainardi
e80dc962f4 Optimizes host.getFullInfo with smaller functions in periodic scripts 2019-10-21 16:21:03 +02:00
Luca
aa908c97cf Merge branch 'dev' of https://github.com/ntop/ntopng into dev 2019-10-11 11:41:29 +02:00
Luca
d1417519ec Reworked bitmap handling 2019-10-11 11:41:20 +02:00
Simone Mainardi
48caf68f69 Fixes invalid state transitions 2019-10-11 11:15:38 +02:00
Simone Mainardi
b81592e49f nEdge compilation fixes 2019-09-30 20:04:42 +02:00
Simone Mainardi
da1dbe4ab0 Reworks hash entries idling 2019-09-24 14:29:20 +02:00
Simone Mainardi
a44def039f Fixes custom catecories not counted in nDPI stats 2019-09-13 10:20:08 +02:00
Simone Mainardi
968e21d984 Implements flow lua callbacks in the periodic activities thread 2019-09-12 15:36:41 +02:00
Simone Mainardi
0373feca8b Fixes all IPv6 hosts marked as broadcast domain hosts 2019-09-11 17:44:26 +02:00
emanuele-f
4d62d68655 Add active alerted flows filter and count
Closes #2821
2019-09-10 17:52:22 +02:00
emanuele-f
c3fa094e99 Improve MUD prefs handling
Also implement a non-inline reloadPrefs Host method to avoid slowing down packet capture
2019-09-10 11:10:33 +02:00
emanuele-f
48d688d501 Add support for MAC MUD 2019-09-06 15:53:15 +02:00
Alfredo Cardigliano
38a53ec1fa Transferring flows status bitmap to the client/server host. Added anomalous flows reasons to the host details page. 2019-09-05 17:55:00 +02:00
emanuele-f
fbb66951b5 Add alert score on hosts 2019-09-03 13:36:27 +02:00
Simone Mainardi
3bfedf8f4c Implements ThroughputStats and reworks GenericTrafficElement 2019-09-03 11:07:21 +02:00
Simone Mainardi
a3821b5327 Minor SSL to JA3 changes 2019-08-26 16:58:34 +02:00
Simone Mainardi
11aa854cba Handles hosts HASSH fingerprints 2019-08-26 16:55:39 +02:00
emanuele-f
2b2a74af79 Fix bad time resolution of values for some host exported timeseries
- active_flows.as_client
- active_flows.as_server
- total_flows.as_client
- total_flows.as_server
- contacts.as_client
- contacts.as_server
- DNS, TCP, ICMP stats

Fixes #2776
2019-08-21 15:37:17 +02:00
emanuele-f
d1c5275302 Move suppressed alerts flag to C to reduce Redis load 2019-08-20 11:54:25 +02:00
Emanuele Faranda
c829c4c3c3
Unify os (#2755)
* Unify OS information.

Now OS information is only stored into the Host. The lua uses numeric IDs to handle OS.

* Fix network discovery OS

* Show OS detail into the host details page
2019-08-08 12:09:51 +00:00
Simone Mainardi
940bf0bde3 Minor code cleanup 2019-07-24 16:29:51 +02:00
Luca Deri
084a48fdb3 Merge branch 'dev' of https://github.com/ntop/ntopng into dev 2019-07-22 15:58:35 +02:00
Luca Deri
e0563d28bc Improved host port stats 2019-07-22 15:49:39 +02:00
Simone Mainardi
9b6714823a Implements hash entries lifecycle as a finite states machine
Fixes certain sporadic race conditions
2019-07-22 15:18:39 +02:00
emanuele-f
6a6cedc899 Add ability to disable host alerts on specific flow status 2019-07-22 12:16:12 +02:00
emanuele-f
c715bb36f3 Implement per-alert-type host counters
Such counters will be used in the future to generate alert timeseries.
Counters are not currently serialized as internally discussed.

Closes #2728
2019-07-19 17:27:23 +02:00
Luca Deri
1f10876a0b Work in progress towards flow alert generation preference handling in hosts 2019-07-19 16:40:21 +02:00
Simone Mainardi
824027da2a Implements lua calls of idle hosts with triggered alerts 2019-07-18 18:15:23 +02:00
Simone Mainardi
0fd3be6b79 Implements hosts purge mark algorithm 2019-07-18 15:19:36 +02:00
Simone Mainardi
be85b2ebc8 Implements algorithm to purge hosts only after checking their alerts 2019-07-18 13:34:45 +02:00
Simone Mainardi
7eae30e914 Allows ntopng to work without Host instances and hosts HT 2019-07-16 19:02:36 +02:00
emanuele-f
7b1190f24f Fix host alerts counter 2019-07-16 11:33:51 +02:00
Luca Deri
3b3af9bb9f Implemented local hosts services hashes 2019-07-15 23:36:45 +02:00
Luca Deri
6a547616e2 Implemented local hosts ports stats 2019-07-15 18:55:11 +02:00
Simone Mainardi
92feace075 Implements an host housekeep task to reset flood counters periodically 2019-07-15 09:37:18 +02:00
Simone Mainardi
24624c8ed0 Implements new minute-by-minute top talkers 2019-07-09 15:43:09 +02:00
emanuele-f
8fc588ca00 Remove checkpointable
checkpointHostTalker and scanAlert must be fixed
2019-07-08 15:31:37 +02:00
Luca
76ef993dfe Reworked alerts 2019-07-07 15:09:24 +02:00
Simone Mainardi
5c3c2ae30c Removes unnecessary locks when accessing the mac addresses hash 2019-07-05 11:31:15 +02:00
emanuele-f
a9d3c78587 Alerts changes
NOTE: database schema changed. Existing alerts will be lost.

- Unified engaged and closed tables
- Simplified hosts engaged alert counters handling: periodically set by lua
- Removed alert engine and replaced with alert periodicity
- Now engage is implicitly derived from the alert end timestamp and periodicity
- New alerts_api.lua to easily emit alerts
- Removed past alerts counter aggregation by hash
- Alert notifications for non-flow alerts are now removed from C and triggered by lua
2019-06-28 10:47:17 +02:00
emanuele-f
c506ef6aeb Implement L7 num flows charts 2019-06-27 10:00:14 +02:00