Commit graph

56 commits

Author SHA1 Message Date
Simone Mainardi
8b9038a70c Waits plugins reload before initializing recipients 2020-09-17 14:13:30 +02:00
Simone Mainardi
b1b90c13d6 Implements alert queues monitoring backend
Implements #4324
2020-09-15 18:05:56 +02:00
Simone Mainardi
6924651ec5 Refactors creation of builtin endpoints and recipients
Implements #4386
2020-09-10 12:01:23 +02:00
Simone Mainardi
9e99fa1403 Uses new in-memory queues for alert recipients (avoid Redis) 2020-09-08 18:36:18 +02:00
Simone Mainardi
85f555a908 Removes intermediate alert queues - only leaves recipient queues
Implements #4366
2020-09-04 17:41:55 +02:00
Simone Mainardi
1d4930fc13 Initial work to add the SQLite plugin and builtin recipient 2020-09-03 19:35:28 +02:00
Luca Deri
aa1dc0b31d Implements #4217 2020-07-29 22:51:36 +02:00
Simone Mainardi
c623f21ba0 Refactors old host_pools_utils to nEdge-only host_pools_nedge 2020-07-16 18:17:19 +02:00
Simone Mainardi
012ef619da Avoids calling old initPools on non-nEdge 2020-07-16 17:59:19 +02:00
Luca Deri
7388bcdd44 Added startup tracing 2020-07-03 17:17:25 +02:00
Simone Mainardi
5ade224d85 Implements global host pools
Implements #4086

Refactors host pools to global

Implements host pools migration

Migration fixes

nEdge changes for host pools migration

Create README.host_pools_migration.md
2020-07-01 12:02:09 +02:00
emanuele-f
d43d4e5e74 Make DHCP names cache expire after 1 day
Addresses #3641
2020-05-08 10:15:31 +02:00
Simone Mainardi
e487427aab Refactors alert_utils and enterprise_alert_utils
Addresses #3720

Alerts Refactor: alert_utils as module

Alerts Refactor: notify_ntopng_start and notify_ntopng_stop

Alerts Refactor: processAlertNotifications

Alerts Refactor: checkStoreAlertsFromC

Alerts Refactor: formatAlertNotification

Alerts Refactor: notification_timestamp_rev

Alerts Refactor: formatAlertMessage

Alerts Refactor: getConfigsetAlertLink

Alerts Refactor: alertNotificationActionToLabel

Alerts Refactor: flushAlertsData

Alerts Refactor: disableAlertsGeneration

Alerts Refactor: newAlertsWorkingStatus and other

Alerts Refactor: drawAlerts

Alerts Refactor: drawAlertTables

Alerts Refactor: printAlertTables

Alerts Refactor: checkDeleteStoredAlerts

Alerts Refactor: getUnpagedAlertOptions

Alerts Refactor: getTabParameters

Alerts Refactor: getAlerts

Alerts Refactor: getNumAlerts

Alerts Refactor: performAlertsQuery

Alerts Refactor: sec2granularity

Alerts Refactor: granularity2id

Alerts Refactor: granularity2sec

Alerts Refactor: alertEngineLabel

Alerts Refactor: alertEngine

Alerts Refactor: alertEngineRaw

Alerts Refactor: alertTypeDescription

Alerts Refactor: alertType

Alerts Refactor: alertTypeLabel

Alerts Refactor: alertTypeRaw

Alerts Refactor: alertSeverity

Alerts Refactor: alertSeverityLabel

Alerts Refactor: alertSeverityRaw

Alerts Refactor: get_make_room_keys

Alerts Refactor: enterprise_alert_utils
2020-04-10 14:03:20 +02:00
Luca Deri
7769beecad Added blog check at startup 2020-03-25 08:12:04 +01:00
Luca Deri
170bc60f19 Updated (C) 2020-01-08 23:52:51 +01:00
emanuele-f
139a16ffe3 Fix protocol categories association lost after reboot
After the recent changes, there is only one global nDPI struct which
is share across all the interfaces. However, the struct can be swapped
during normal operating, so it's necessary to reload the associations
every time a new nDPI struct is allocated.

Fixes #3139
2019-12-19 15:11:21 +01:00
Simone Mainardi
f9b6921983 Fixes devices policies reload and alerts generation
Fixes #3102
2019-12-19 11:42:24 +01:00
Simone Mainardi
692463fbc9 Fixes initial misdetection of flows with custom protocols 2019-12-19 10:38:51 +01:00
emanuele-f
b5197ba452 Integrate configsets with user scripts configurations 2019-12-16 17:36:30 +01:00
emanuele-f
3a6897bb84 Community plugins fixes 2019-12-10 11:48:03 +01:00
emanuele-f
a3432e00e8 Implement ntopng plugins
Plugins are a convenient way to group together related lua scripts.
Their primary use case is to group user scripts and their alert/status
definition.
The builtin ntopng user scripts and definitions are now
packed into plugins directories. In future, we will support loading of
user created plugins.
Plugins are loaded at startup into some runtime directories and then
used. Other changes provided by this commit include:

- Add sample flow logger plugin
- Initial support for system user scripts
- Rename edge to threshold
- Migrate system probes to user scripts/plugins
- Migrate scripts to more explicit alerts_api.checkThresholdAlert api
2019-12-10 09:25:57 +01:00
emanuele-f
191e530f6f Clean category lists error status on startup and remove debug prints 2019-11-04 13:07:24 +01:00
emanuele-f
373118f4cc Fix missing systemd interface cleanup on startup
This caused the timeseries export directory to fill up as reported in #2985
2019-10-23 10:54:54 +02:00
Simone Mainardi
ca5bcd86bf Deprecates sticky hosts
Fixes #2907
2019-10-14 18:50:18 +02:00
emanuele-f
8e6cd5962a Fix blacklisted host alerts not generated when reading from PCAP dump 2019-09-03 17:50:08 +02:00
emanuele-f
89b9aebfd7 Delete ts export queue on startup and add missing error 2019-06-19 11:21:27 +02:00
emanuele-f
00afdaa79d Fix for old rrd_tune not supporting adding columns 2019-05-16 11:18:28 +02:00
emanuele-f
3e612869a5 Fix interface RRD overlap between mining category and application
Interface categories are now placed under the ndpi_categories rrd subfolder. Existing data is migrated.
2019-05-16 00:13:43 +02:00
Simone Mainardi
d068e817d1 Implements multiple companions per ZMQ interface 2019-05-14 16:41:52 +02:00
emanuele-f
6bbb828ead Implement Category Lists editor to manage ip/domain lists 2019-02-11 15:47:17 +01:00
emanuele-f
229c3b13c9 Implement initial InfluxDB rollup support
Currently disabled, enable with
  redis-cli set ntopng.prefs.beta_rollup 1
2019-01-31 12:02:40 +01:00
emanuele-f
1543526385 Initial support for multiple auth types 2018-11-30 21:21:28 +01:00
emanuele-f
6ca5e38587 Move services check at startup 2018-11-26 12:04:45 +01:00
emanuele-f
eac278a28d Implement remote assistance
- It enables a VPN via n2n
- Remote assistance will be automatically disabled after 1 day
- Optionally it's possible to give admin access to the support
2018-11-23 13:03:11 +01:00
Simone Mainardi
3f275417a3 Fixes race conditions with custom categories reload 2018-11-19 17:03:58 +01:00
Alfredo Cardigliano
7c51217844 moved select outside the presets module 2018-10-22 10:26:12 +02:00
emanuele-f
aa1ead94c4 Add Customized Categories editor
Also unify the blacklist category handler to use the nDPI API
2018-10-10 18:41:47 +02:00
emanuele-f
5e1daf470a Implement device presets reset to defaults 2018-10-02 15:00:55 +02:00
Alfredo Cardigliano
2ac9e5406c device policies initialization 2018-09-29 09:59:15 +02:00
emanuele-f
0004e08191 Add experimental support for 5sec granularity for host timeseries
To enable it (only on *InfluxDB* right now):

- uncomment HOST_NUM_TIMESERIES_POINTS in ntop_defines.h
- run `redis-cli set ntopng.prefs.30_sec_dump 1` and restart ntopng
2018-08-23 18:10:46 +02:00
emanuele-f
354dd697c0 Add max value checks for traffic and packets metrics 2018-08-20 16:19:01 +02:00
emanuele-f
6ba093872f Fix multiple alignment issues with timeseries 2018-08-16 17:06:38 +02:00
Simone Mainardi
d12a4d3009 Creates utility functions to handle restart after anomalous termination 2018-08-01 18:11:17 +02:00
emanuele-f
89d203883f Add support for custom categories lists
- Extend malware hosts from list
- Read web mining hosts from list and generate alerts
2018-05-10 17:12:53 +02:00
Luca Deri
00004494bf Reworked alarms
Added informative message at ntopng startup/shutdown
2018-04-13 17:19:58 +02:00
emanuele-f
23d7a2676a Rework alerts export to provide more endpoint control 2018-04-12 18:10:45 +02:00
Luca Deri
f0c936c368 Updated (C) to 2018 2018-03-22 21:59:42 +01:00
Simone Mainardi
54632361c4 Only loads bridge conf utils in nEDGE 2018-03-15 16:38:21 +01:00
Simone Mainardi
501192ff1f Adapts http bridge conf to the new nEDGE 2018-03-15 16:12:21 +01:00
emanuele-f
60f3753e12 Fix network discovery on nedge 2018-03-08 17:28:02 +01:00