Commit graph

67 commits

Author SHA1 Message Date
Matteo Biscosi
f992492445 Added order by in flow sankey 2025-08-11 11:28:08 +02:00
Luca Deri
11358965b0 Added ASN agrgegation table 2025-07-28 12:14:10 +02:00
Alfredo Cardigliano
ed1c0ae14b Change hourly schema: order by first seen first 2025-07-17 16:56:55 +02:00
GabrieleDeri
cd1d2340b2
Implement Peer (src/dst) ASN in Historical Flows #9337
* Added peer src dst asn

* Fixed asn typo
2025-07-03 12:34:01 +02:00
GabrieleDeri
e912af1b17
Added peer asn in clickhouse (#9328)
* Added peer asn in clickhouse

* Added peer asn to all versions

* Readded en string
2025-07-01 13:09:13 +02:00
Alfredo Cardigliano
4faddbb050 Add notes and macros 2025-06-11 11:42:50 +02:00
Alfredo Cardigliano
a13eb41e81 Replace NULL with default values (CH optimization) 2025-05-19 18:47:53 +02:00
Alfredo Cardigliano
821efd53d0 Cleanup schema (NOT NULL is not required - default) 2025-05-19 17:56:22 +02:00
Alfredo Cardigliano
5f1af930fb Change flows table schema (order by FIRST_SEEN first) 2025-05-16 18:12:40 +02:00
Matteo Biscosi
c0d42f2343 Fixes issues with npm 2025-05-16 10:13:21 +02:00
Matteo Biscosi
fcdc6b7a03 Added packets to hourly flows 2025-05-14 16:23:05 +02:00
Matteo Biscosi
5fbe4dff79 Fixes filters request in reports dashboard (#9205) 2025-05-13 16:22:29 +02:00
Luca Deri
cb03021f4e Updated DB asset schema
Fixed URL in host details
2025-03-27 19:36:56 +01:00
Alfredo Cardigliano
b246fe94b0 Cleanup old flow_alerts table schema 2025-03-19 16:00:13 +01:00
Alfredo Cardigliano
97ca40a349 Add ja4 client fingerprint and custom queries 2025-03-12 16:57:10 +01:00
Alfredo Cardigliano
bb9216ba7b Add QOE_SCORE column 2025-02-25 09:39:05 +01:00
Matteo Biscosi
5c4509c62e Removed unused tables 2025-01-14 17:59:48 +01:00
Alfredo Cardigliano
a4b7228a3a Cleanup CH schema 2024-12-31 10:23:23 +01:00
Matteo Biscosi
a63dec0dcc Reworked assets table 2024-12-30 12:37:54 +01:00
Alfredo Cardigliano
ae5128c620 Split protocol and alert info from ALERT_JSON: new PROTOCOL_INFO_JSON column 2024-12-05 15:13:16 +01:00
Alfredo Cardigliano
0447fe89a7 Fix asset_management schema 2024-11-19 13:05:47 +01:00
Alfredo Cardigliano
173e0aaca0 Add in-memory tables for all alert families. Add aggregated views for all families. 2024-11-12 09:57:02 +01:00
Alfredo Cardigliano
12407d6604 Add require_attention to all alert families on CH 2024-11-11 18:23:21 +01:00
Alfredo Cardigliano
6f9d0690c6 Add require_attention to all alert families on SQLite. Cleanup SQLite schema 2024-11-11 18:12:27 +01:00
Alfredo Cardigliano
2da5925181 Fix all alerts page. Fix require attention results. 2024-11-11 15:59:58 +01:00
Alfredo Cardigliano
f3963c9eb1 Split alert_status (engaged, historical, acknowledged) and require_attention flag 2024-11-11 12:46:25 +01:00
Alfredo Cardigliano
7dedfa1a8c Add schema for in-memory engaged_host_alerts table and host_alerts_view aggregated view on ClickHouse 2024-11-08 12:46:41 +01:00
Matteo Biscosi
679ef8edab Possible fix for asset management not working 2024-11-05 15:51:03 +01:00
Matteo Biscosi
20ed95fcb0 Added asset management table 2024-11-05 13:46:57 +01:00
Alfredo Cardigliano
89f59cde5a Migrate local networks type from 16 to 32 bit 2024-10-29 15:31:37 +01:00
Alfredo Cardigliano
fb30f7592f Fix schema. Add DOMAIN_NAME. 2024-10-28 11:22:36 +01:00
Alfredo Cardigliano
1eab4beac5 Restore SRC_NETWORK_ID DST_NETWORK_ID data type to UInt16 for the time being 2024-10-25 11:59:17 +02:00
Alfredo Cardigliano
d25e23a599 Remove SRC_NETWORK_ID DST_NETWORK_ID type change from init (to be moved to the startup script) 2024-10-25 11:55:17 +02:00
Alfredo Cardigliano
5fd9b1c1f6 Change SRC_NETWORK_ID DST_NETWORK_ID from UInt16 to UInt32 2024-10-25 11:05:41 +02:00
Matteo Biscosi
1fe009b9cc Fixes issue with ntopng report page (#8688) 2024-09-30 15:31:39 +02:00
Alfredo Cardigliano
d9057e8236 Add WLAN_SSID WTP_MAC_ADDRESS to hourly_flows 2024-09-19 12:39:22 +02:00
Alfredo Cardigliano
7b291f5fca Dump WLAN_SSID and WTP_MAC_ADDRESS in historical flows 2024-09-16 18:31:42 +02:00
DGabri
869fcbf626 Added useful columns in table, removed unnecessary columns 2024-08-19 18:11:40 +02:00
DGabri
35b1700620 Added documentation for clickhouse tables and added forgotten columns to flow_alerts_view 2024-08-19 18:05:14 +02:00
Alfredo Cardigliano
5768dd88d6 Add mitre table and flow/host alerts views on clickhouse cluster 2024-08-19 09:00:41 +02:00
Alfredo Cardigliano
d944725bbb Optimize selects for left join 2024-08-09 16:04:04 +02:00
Alfredo Cardigliano
1ddc1ab77a Fix left join for flow alerts view in case of no mitre id for the alert 2024-08-09 15:57:27 +02:00
DGabri
b13c3e3361 Removed old flow alert view 2024-08-05 16:18:43 +02:00
DGabri
7b6a12fbc3 Implemented mitre views. Ticket: #8592 2024-08-05 16:12:52 +02:00
Luca Ferretti
7cceb656c0
fixed typo (#8565)
* added netbox documentation

* Update asset_inventory.rst

* added ndpi-protocols ipv6 rules

* updated ipv6 check for custom rule

* fix typo

* implemented mitre_table_info inside database

* fixed typo

* changed tecnique to technique typo

* Update host_alert_scan_detected.lua
2024-07-24 18:23:47 +02:00
Matteo Biscosi
ba8027f103 Updated mitre table 2024-07-24 16:50:58 +02:00
Luca Ferretti
c2c33011b0
Implemented mitre_table_info inside database (#8554)
* added netbox documentation

* Update asset_inventory.rst

* added ndpi-protocols ipv6 rules

* updated ipv6 check for custom rule

* fix typo

* implemented mitre_table_info inside database
2024-07-24 15:50:07 +02:00
Matteo Biscosi
d795bf3474 Added NAT info in clickhouse (#8384) 2024-05-10 10:22:55 -04:00
Nicolò Maio
2d150103b7
Add TCP flow connection state (#8210)
* Add TCP flow connection state (#8140)

* Add Major and Minor connection states (#8140)

* Remove ZMQ connection state parsing. (#8140)

* Update doc with major and minor conn states. (#8140)
2024-02-28 14:45:49 +01:00
Nicolo Maio
c17db2e3b3 Add INTERFACE_ID in hourly_flows table. (#8197) 2024-02-01 12:38:06 +01:00