Commit graph

140 commits

Author SHA1 Message Date
Luca Deri
3e2c3aee0c Database initializations fixes 2022-05-06 20:29:27 +02:00
Luca Deri
79309f35b5 Crash fix 2022-03-24 19:34:24 +01:00
Luca Deri
3bf891973c Fixed termination
Added check for avoding hanging during startup when Ctrl-C is pressed and startup is not yet complete
2022-02-23 10:23:12 +01:00
Luca Deri
0ecfc089b9 Warnign fix 2022-02-22 12:12:47 +01:00
Luca Deri
31c1ec534e Implemented method for DB initialization 2022-02-22 08:34:24 +01:00
Luca Deri
1f2ab6e3c0 Cleaned up MySQL code 2022-02-22 00:20:46 +01:00
Luca Deri
58d34605fe Cleaned up MySQL code 2022-02-18 19:30:29 +01:00
Luca Deri
4eed7623f2 Fixes #6329 2022-02-18 12:41:35 +01:00
Luca Deri
b472c4fa12
In ClickHouse mode DBs do not need to be created 2022-02-15 11:13:15 +01:00
Luca Deri
edfb31b4ec Warning fixes 2022-01-30 21:20:08 +01:00
Luca Deri
97eae029e5 Changed get Flow::getFlowInfo() method signature 2022-01-11 08:52:36 +01:00
Luca Deri
925301d20a Added comment 2022-01-04 11:50:35 +01:00
Alfredo Cardigliano
f2060f2488 Copyright update (C) 2022-01-03 09:35:09 +01:00
Luca Deri
a64ac34bcb Added check before disconnecting from DB 2022-01-02 15:23:48 +01:00
Luca Deri
529ae174f1 Removed trace message 2021-12-28 22:32:36 +01:00
Luca Deri
553084700e Fixed wrong MySQL initialization after a failure: ntopng was not trying to reconnect to the DB and thus it was reported DB down even if it was up again 2021-12-22 10:31:57 +01:00
Alfredo Cardigliano
3364ed383c Remove -F mysql-nprobe option 2021-12-16 10:29:38 +01:00
Luca Deri
b56aeebe6d Format change 2021-12-09 17:23:28 +01:00
Luca Deri
fc6612f1d9 Added call for performing a simple MySQL query 2021-12-06 12:16:32 +01:00
Luca Deri
4d5f3d3b67 Removed <table name> from -F mysql and clickhouse
Added alias -F clickhouse for -F "clickhouse;127.0.0.1;ntopng;default;"
2021-11-30 10:53:49 +01:00
Alfredo Cardigliano
cf68714a19 Disable debug traces 2021-11-22 10:02:21 +01:00
Luca Deri
4975cd9391 Added MySQL traces (will be hidden after troubleshooting) 2021-11-19 10:58:56 +01:00
Simone Mainardi
7b49e9b2fd Fixes MySQL 8.x attempting at altering invalid column types 2021-11-15 15:31:00 +00:00
Simone Mainardi
3e461393ed Fixes broken clickhouse flows DB creation
Invalid initialization was causing

09/Nov/2021 17:15:45 [MySQLDB.cpp:925] ERROR: MySQL error: [Code: 62. DB::Exception: Syntax error: failed at position 62 ('AUTO_INCREMENT'): AUTO_INCREMENT,`VLAN_ID` smallint(5) unsigned DEFAULT NULL,`L7_PROTO` smallint(5) unsigned DEFAULT NULL,`IP_SRC_ADDR` varchar(48) DEFAULT NULL,`L4_SRC_PORT` sma. Expected one of: CODEC, TTL, ClosingRoundBracket, Comma, COMMENT, token. (SYNTAX_ERROR) (version 21.10.2.15 (official build))][CREATE TABLE IF NOT EXISTS `flowsv6` (`idx` int(11) NOT NULL AUTO_INCREMENT,`VLAN_ID` smallint(5) unsigned DEFAULT NULL,`L7_PROTO` smallint(5) unsigned DEFAULT NULL,`IP_SRC_ADDR` varchar(48) DEFAULT NULL,`L4_SRC_PORT` smallint(5) unsigned DEFAULT NULL,`IP_DST_ADDR` varchar(48) DEFAULT NULL,`L4_DST_PORT` smallint(5) unsigned DEFAULT NULL,`PROTOCOL` tinyint(3) unsigned DEFAULT NULL,`IN_BYTES` bigint unsigned DEFAULT 0,`OUT_BYTES` bigint unsigned DEFAULT 0,`PACKETS` int unsigned DEFAULT 0,`FIRST_SWITCHED` int(10) unsigned DEFAULT NULL,`LAST_SWITCHED` int(10) unsigned DEFAULT NULL,`INFO` varchar(255) DEFAULT NULL,`JSON` blob,`PROFILE` varchar(255) DEFAULT NULL,`NTOPNG_INSTANCE_NAME` varchar(256) DEFAULT NULL,`INTERFACE` varchar(64) DEFAULT NULL,KEY `idx` (`idx`,`IP_SRC_ADDR`,`IP_DST_ADDR`,`FIRST_SWITCHED`,`LAST_SWITCHED`,`INFO`(200)),KEY `ix_flowsv6_4_profile` (`PROFILE`),KEY `ix_flowsv6_4_ntopng_instance_name` (`NTOPNG_INSTANCE_NAME`(255)),KEY `ix_flowsv6_4_ntopng_interface` (`INTERFACE`)) ENGINE=InnoDB AUTO_INCREMENT=7 DEFAULT CHARSET=utf8/*!50100 PARTITION BY HASH (`FIRST_SWITCHED`)PARTITIONS 32 */]

Fixed along with companion pro commit 216e0510127a7610ed09be2e6903409a72933dd4
2021-11-09 17:45:15 +01:00
Luca Deri
13407f6761 Fixes for dumping alerts into ClickHouse 2021-11-04 19:05:50 +01:00
Luca Deri
fb51c6e6fb Added check for replacing localhost with 127.0.0.1 when clickhouse is used 2021-11-04 09:39:40 +01:00
Luca Deri
98b36ec9ed Added shutdown check in MySQLDB 2021-10-27 19:07:45 +02:00
Simone Mainardi
d22c63e859 Fixes uninitialized MySQL connected variable 2021-10-22 10:06:00 +02:00
Luca Deri
4e18ba10ad Removed trace 2021-10-21 19:41:40 +02:00
Luca Deri
d141115b96 ClickHouse fixes 2021-10-21 14:08:04 +02:00
Luca Deri
f4c512d552 Code cleanup and stubs for supporting ClickHouse (via -F clickhouse) 2021-10-21 11:58:08 +02:00
Matteo Biscosi
e01594f52a Removed community id from MySQL flow
Implements #5071
2021-03-15 15:58:07 +01:00
Matteo Biscosi
2f15bd0723 Implements bind alerts to flows through communityId
Implements #5071
2021-03-10 12:24:56 +01:00
Luca Deri
65a9daa7cb Warning fix 2021-01-26 11:09:39 +01:00
Alfredo Cardigliano
fb0e738163 Fix size of IN/OUT BYTES columns in MySQL 2021-01-22 09:36:29 +01:00
Luca Deri
440f6e5892 Added IEC flow info
Changed getFlowInfo() method signature
2021-01-21 22:10:48 +01:00
Luca Deri
a1178a0791 Updated (C) 2021-01-02 12:08:23 +01:00
Luca Deri
9c16489912 FreeBSD compilation fixes
Various warning fixes
2020-12-31 18:05:44 +01:00
Luca Deri
57e6a93065 Improved scheduling algorithm to guarantee minimum service time when number of entries allow
Updated (C)
2020-01-06 23:36:36 +01:00
Simone Mainardi
9c448445ac Implements MySQL flow dump for view interfaces 2019-07-23 17:44:40 +02:00
emanuele-f
0ec286f3ba Fix missing http_prefix in refer
Fixes #2731
2019-07-18 17:26:14 +02:00
Alfredo Cardigliano
a855d1bff5 Checking db connection state before trying to insert to mysql (#2712) 2019-07-11 12:23:14 +02:00
emanuele-f
afaa0e041a Fix null idx column after schema migration 2019-05-13 11:40:57 +02:00
Simone Mainardi
aaf08d1cfa Fixes MySQL idx column migration to BIGINT 2019-03-21 18:10:04 +01:00
Jérôme Marteaux
09376c5e96 switch to bigint (#2441) 2019-03-12 17:55:19 +01:00
emanuele-f
6f94f7b132 Add thread names for debugging 2019-02-21 11:51:57 +01:00
Simone Mainardi
5110b1cadf Prevents certain races when no heap mem is avaiable 2019-01-29 12:31:06 +01:00
emanuele-f
9881358bf8 Cleanup db initialization code 2019-01-16 16:44:36 +01:00
emanuele-f
5a88ee91da Rework flow exporters API
Now ElasticSearch and LogStash are bind to a NetworkInterface instance

Closes #2312
2019-01-15 12:53:21 +01:00
emanuele-f
4feb75a152 Rework flow exporter counters
Fixes #2300
2019-01-14 14:09:33 +01:00