Commit graph

143 commits

Author SHA1 Message Date
Luca Deri
3dda9ba905 Added FLOW_VERDICT handling 2021-04-19 23:49:23 +02:00
Simone Mainardi
42d2e85243 Minor TCP flag check fix 2021-02-27 21:02:49 +01:00
Simone Mainardi
9d43be52c7 Reworks client/server heuristic for ZMQ interfaces 2021-02-27 21:01:19 +01:00
Luca Deri
8453fb6e6d Crash fix 2021-02-23 10:28:58 +01:00
Luca Deri
291407f7f4 Warnign fixes 2021-02-06 14:47:06 +01:00
Simone Mainardi
ce45bf0f9c Reworks throughput estimation for ZMQ interfaces 2021-01-25 17:27:13 +01:00
Alfredo Cardigliano
f1889790da Fix probe time drift reporting 2021-01-22 11:37:51 +01:00
Luca Deri
a1178a0791 Updated (C) 2021-01-02 12:08:23 +01:00
Alfredo Cardigliano
6a23f59bcf Add support for OBSERVATION_POINT_ID 2020-10-13 14:54:24 +02:00
Simone Mainardi
7320c8266c Adds throughput estimation via ZMQ
Implements #3508
2020-10-06 19:28:11 +02:00
Alfredo Cardigliano
eaa98e6002 Show counters for unhandled flows 2020-09-16 18:52:19 +02:00
Simone Mainardi
941da6819f Implements HTTP method using enum ndpi_http_method 2020-08-27 10:04:58 +02:00
Luca Deri
0bd6f1353a Added support for flow risk over ZMQ 2020-08-26 23:03:00 +02:00
Alfredo Cardigliano
97644d1477 Fix compilation warning 2020-08-26 12:24:38 +02:00
Luca Deri
192a1cf942 Fixed logic of flow purging with ZMQ interfaces 2020-08-07 23:31:43 +02:00
Luca Deri
da5e008cf2 Added check for invalid first/last seen 2020-08-07 21:40:11 +02:00
Luca Deri
75efc0ec0c Partial fix (community code is now clean) for #2533
Reworked inteface disaggregation
Moved to attic some unused classes
Added ability to disaggregate also for Probe IP + Ingress Interface
2020-08-07 17:20:26 +02:00
Luca Deri
3ba1cc622e Added checks on remote flow collection
- check clock drift and report it as alert
- fix flow time drift
2020-08-06 18:22:47 +02:00
Luca Deri
6b62b5ff90 Added support for ZMQ probe OS and version 2020-08-05 17:27:02 +02:00
Luca Deri
565f001f0e Added support for real flow lifetime computed on the nProbe side. This value could have been computed on the ntopng side too, however implementing it this way leaves room for improvement whenever nProbe aggregates (flow cache is active) or exports raw (no cache) flows 2020-08-05 16:03:28 +02:00
Simone Mainardi
3cafee5728 Fixes possible crash when collecting IPV4_NEXT_HOP 2020-07-31 17:06:18 +02:00
Simone Mainardi
21d151a404 Implements HTTP stats over ZMQ
Fixes #4152
2020-07-29 11:07:35 +02:00
Simone Mainardi
ec9d092423 Fixes DNS stats when collecting from ZMQ
Fixes #4148
2020-07-29 10:40:53 +02:00
Simone Mainardi
0d5d128cf8 Fixes parsing of %HTTP_RET_CODE
Partially addresses #4152
2020-07-29 08:44:52 +02:00
Simone Mainardi
a12f3afd15 Fixes IPv4/IPv6 errors using post-NAT addresses
Fixes #4018
2020-06-11 16:12:48 +02:00
Alfredo Cardigliano
e3b00bc64c Reduce the set of mandatory fields to handle collector-passthrough (fix #3992) 2020-06-01 11:56:25 +02:00
Simone Mainardi
ebbe0155e3 Several ZMQ traffic and throughput calc fixes
Addresses #3863
2020-05-07 17:28:44 +02:00
Alfredo Cardigliano
acb23221e2 Add support for SRC_AS DST_AS BGP_NEXT_ADJACENT_ASN BGP_PREV_ADJACENT_ASN information elements 2020-04-29 09:35:27 +00:00
emanuele-f
5f5a7abdb7 Add warning for missing fields in the ZMQ template
Closes #3514
2020-03-05 18:18:29 +01:00
Alfredo Cardigliano
21462270e2 Fix use after free in zmq_remote_stats (#3496) 2020-03-03 13:50:02 +00:00
emanuele-f
b4dbb88492 Fix invalid source_id_last_zmq_remote_stats map item delete
Also fixes:
 - Missing source_id_last_zmq_remote_stats cleanup on shutdown
 - Leak in Ntop::registerInterface when maximum interfaces number is reached
 - Concurrent access to Ntop::registerInterface from registerSubInterface

Fixes #3495
2020-03-03 13:00:54 +01:00
Alfredo Cardigliano
ef16436576 Support for EXPORTER_IPV6_ADDRESS parsing and disaggregation 2020-02-28 18:47:46 +01:00
Alfredo Cardigliano
765474fa70 Option -F nindex;{dump,load} to dump and load json flows (for debugging only) 2020-02-27 18:51:59 +01:00
Alfredo Cardigliano
731278448a Handle stats from multiple ZMQ producers in the same endpoint (fix #3409) 2020-02-18 12:26:50 +01:00
emanuele-f
a206dea517 Add safety checks to avoid ZMQParserInterface parse leaks
Leak trace:

Direct leak of 14 byte(s) in 1 object(s) allocated from:
    #0 0x564eb47ef589 in strdup (/home/emanuele/src/ntopng/ntopng+0x15a589)
    #1 0x564eb4ad5d85 in ZMQParserInterface::parsePENNtopField(ParsedFlow*, unsigned int, ParsedValue*) const /home/emanuele/src/ntopng/src/ZMQParserInterface.cpp:556:25
    #2 0x564eb4adae10 in ZMQParserInterface::parseSingleTLVFlow(ndpi_serializer*, unsigned char) /home/emanuele/src/ntopng/src/ZMQParserInterface.cpp:1237:14
    #3 0x564eb4adbd3e in ZMQParserInterface::parseTLVFlow(char const*, int, unsigned char, void*) /home/emanuele/src/ntopng/src/ZMQParserInterface.cpp:1423:8
    #4 0x564eb4ad06a1 in ZMQCollectorInterface::collect_flows() /home/emanuele/src/ntopng/src/ZMQCollectorInterface.cpp:421:38
    #5 0x564eb4ad105f in packetPollLoop(void*) /home/emanuele/src/ntopng/src/ZMQCollectorInterface.cpp:469:10
    #6 0x7fc0b4a0b46e in start_thread (/usr/lib/libpthread.so.0+0x946e)
2020-02-17 19:14:27 +01:00
Simone Mainardi
dd99966e78 Removes a debug print in parseTLVFlow 2020-02-05 11:58:34 +01:00
Luca Deri
e12f7b7fc3 Merge branch 'dev' of https://github.com/ntop/ntopng into dev 2020-02-04 22:58:16 +01:00
Luca Deri
3fcd016ace ZMQ debug code 2020-02-04 22:58:06 +01:00
Alfredo Cardigliano
af135d2909 Replace break with return in case of failures to avoid printing a misleading message 2020-02-04 17:56:34 +01:00
emanuele-f
9b45950c74 Add missing breaks causing case fallthrough 2020-02-04 17:52:19 +01:00
Luca Deri
57e6a93065 Improved scheduling algorithm to guarantee minimum service time when number of entries allow
Updated (C)
2020-01-06 23:36:36 +01:00
Alfredo Cardigliano
a8d7353a07 TLV string key decoding fix 2019-12-23 12:55:25 +01:00
Alfredo Cardigliano
6359bc9ab0 Fix displayed RTP MOS with TLV (this also fixes other fields formatting with JSON) 2019-12-02 12:09:37 +01:00
Alfredo Cardigliano
e38835a603 Rename SSL to TLS (fix #3013) 2019-11-15 12:40:01 +01:00
Simone Mainardi
1eba832869 Fixes flow aggregation after hash tables rework
Fixes #3018
2019-10-29 17:49:52 +01:00
Alfredo Cardigliano
3290bd803b Propagating additional fields to companion interface 2019-10-15 16:41:42 +02:00
Alfredo Cardigliano
a2e74e16a3 New Lua interface.processFlow API, moved processFlow from NetworkInterface to ParserInterface, code cleanup 2019-10-10 12:49:32 +02:00
Alfredo Cardigliano
c5e3d61205 Support for l7 proto name match in sub interfaces 2019-10-08 17:14:10 +02:00
Alfredo Cardigliano
0c2ffc1f94 Dynamic and custom sub-interfaces are now sharing the same data structure (registering through API to the master interface), bug fixes 2019-09-26 15:50:31 +02:00
Alfredo Cardigliano
d672d93750 Sub interfaces support (wip) (#2825) 2019-09-17 10:34:52 +02:00