110 commits

Author	SHA1	Message	Date
Alfredo Cardigliano	18a5db3c52	Update CH schema to make room for ntopng_instance_name for all tables	2026-07-13 16:45:25 +02:00
Matteo Biscosi	705c14a431	Revert "Removed vulnerability scan (#10490)" ... This reverts commit 947019d8c7.	2026-06-28 10:52:21 +00:00
Manuel Ceroni	947019d8c7	Removed vulnerability scan (#10490) ... * Removed vulnerability scan * Removed other vs_utils references	2026-06-25 16:33:55 +02:00
Matteo Biscosi	615ffc4eb4	Moved Site page to navbar, also added statistics and configuration page. Added Parent Site	2026-06-18 14:26:17 +00:00
Alfredo Cardigliano	07e23d469a	Add AS information to the database from geoip/as.csv when available. Cache the information on redis. Use RIPE service as last resort.	2026-06-09 10:36:54 +02:00
Alfredo Cardigliano	08582589dc	Drop old columns (moved to json)	2026-06-05 09:55:56 +02:00
Alfredo Cardigliano	1472656ff5	Add PROBE_IP column if not exists on cluster schema. Cleanup syntax.	2026-06-05 09:49:12 +02:00
Alfredo Cardigliano	3f3c623847	Add PROBE_IP column if not exists	2026-06-05 09:44:34 +02:00
Alfredo Cardigliano	37ae82bec8	Add missing table and columns definitions. Cleanup schema.	2026-06-04 10:14:12 +02:00
Alfredo Cardigliano	07bcda0c6b	Remove IPv6NumToNormalizedIP (no longer required)	2026-06-03 09:08:56 +02:00
Luca Deri	0cea8c8eda	Changed table comments so they are proagated even to existing tables	2026-05-30 12:51:32 +02:00
GabrieleDeri	7a78416fa3	Added ch table defs for alerts mapping and pipeline (#10385)	2026-05-28 12:24:48 +02:00
Alfredo Cardigliano	63dd4c4932	replace function if already defined	2026-05-25 17:01:14 +02:00
Alfredo Cardigliano	d99b7a29e1	Define ClickHouse function IPv6NumToNormalizedIP to convert IPv6 mapped IPv4	2026-05-23 11:12:47 +02:00
Manuel Ceroni	d7f05f6b1a	Migrated some ClickHouse columns into the JSON field (#10369)	2026-05-21 15:11:58 +02:00
Alfredo Cardigliano	600d99f333	Add SRC/DST_SITE_ID to historical flows	2026-05-20 18:58:06 +02:00
Alfredo Cardigliano	79745c0c8c	Dump client and server tags to historical flows to allow queries like 'src TAGS contains Lab AND dst TAGS contains Production'	2026-05-20 11:58:20 +02:00
Alfredo Cardigliano	3dced6a58f	Create l7_protocols table for external queries (e.g. Grafana)	2026-05-19 12:27:12 +02:00
Alfredo Cardigliano	fb521c1752	Rename labels to tags to avoid confusion as labels was too common. (note: tag filters are now flowfilters)	2026-05-12 11:43:07 +02:00
Alfredo Cardigliano	3fb6a2203e	Handle IPv4/IPv6 PROBE_IP in historical data	2026-05-07 13:13:11 +02:00
Alfredo Cardigliano	1d18495f44	Add labels to alerts schema to allow filtering	2026-05-06 12:27:31 +02:00
GabrieleDeri	de94e7de5a	Added ai policy callbacks, added tool streaming steps (#10327)	2026-05-05 15:28:13 +02:00
Luca Deri	50825208a0	Added column for indetifying new flows in ClickHouse	2026-05-01 11:53:21 +02:00
Alfredo Cardigliano	f19dfe650b	Store labels in historical flows and show them in the flow list	2026-04-28 12:51:24 +02:00
Alfredo Cardigliano	e541c57bcd	Add HR counters to CH schema. Dump HR counters.	2026-04-27 11:48:30 +02:00
GabrieleDeri	55e4d70390	Added vue page for ai policy, flow ai formatter (#10293)	2026-04-22 20:56:20 +02:00
GabrieleDeri	3c875cd8d4	Added live flow chatbot panel (#10265) ... * Added live flow chatbot panel * Update dist	2026-04-09 23:13:39 +02:00
Alfredo Cardigliano	7fef317211	Add NEXT_ADJACENT_ASN to the flow table	2026-04-09 11:11:21 +02:00
GabrieleDeri	a150300609	Update dist (#10251)	2026-04-07 11:36:22 +02:00
GabrieleDeri	45237c68b5	Added ai usage table (#10241)	2026-04-02 10:14:14 +02:00
GabrieleDeri	65772d3545	Initial chatbot UI commit (#10232) ... * Initial chatbot UI commit * Update dist	2026-03-28 15:05:01 +01:00
Luca Deri	404c95a0c0	Improved SNMP interface roles	2026-03-16 22:22:59 +00:00
Luca Deri	374493e444	Commented Clickhouse files	2026-03-15 12:45:16 +01:00
Alfredo Cardigliano	034d6db866	Add INTERFACE_ROLE to table definition as well	2026-03-13 11:44:11 +01:00
Matteo Biscosi	d881e76473	Added support to Interface role filters	2026-03-12 12:10:14 +00:00
Alfredo Cardigliano	cb8d44dd5f	Store Exporter Site to historical data	2026-02-03 10:03:37 +01:00
Alfredo Cardigliano	52cfebc7a9	Remove leftover causing slow startup	2025-10-13 10:07:57 +02:00
Luca Deri	931903bd54	Removed pre-nat entries	2025-10-01 15:58:48 +02:00
Luca Deri	215aa1436b	Code cleanup ... Reworked MAC handling in flows	2025-09-26 21:15:01 +02:00
Manuel Ceroni	6d91ba2dd0	Added NDPI TCP fingerprint in historical flows (#9702)	2025-09-26 19:17:45 +02:00
Alfredo Cardigliano	673ad2797b	Fix 'all' alerts view to account also engaged alerts	2025-08-25 16:49:58 +02:00
Alfredo Cardigliano	ba382f7316	Add AS alert entity. Fix AS threshold crossed.	2025-08-25 14:45:22 +02:00
Luca Deri	6f3f273d39	Addded schema of in-memory database	2025-08-19 23:06:24 +02:00
Matteo Biscosi	f992492445	Added order by in flow sankey	2025-08-11 11:28:08 +02:00
Luca Deri	11358965b0	Added ASN agrgegation table	2025-07-28 12:14:10 +02:00
Alfredo Cardigliano	ed1c0ae14b	Change hourly schema: order by first seen first	2025-07-17 16:56:55 +02:00
GabrieleDeri	cd1d2340b2	Implement Peer (src/dst) ASN in Historical Flows #9337 ... * Added peer src dst asn * Fixed asn typo	2025-07-03 12:34:01 +02:00
GabrieleDeri	e912af1b17	Added peer asn in clickhouse (#9328) ... * Added peer asn in clickhouse * Added peer asn to all versions * Readded en string	2025-07-01 13:09:13 +02:00
Alfredo Cardigliano	4faddbb050	Add notes and macros	2025-06-11 11:42:50 +02:00
Alfredo Cardigliano	a13eb41e81	Replace NULL with default values (CH optimization)	2025-05-19 18:47:53 +02:00