Commit graph

30 commits

Author SHA1 Message Date
Toni Uhlig
d4633c1192
New flow event: 'analysis'.
* The goal was to provide a separate event for extracted feature that are not required
   and only useful for a few (e.g. someone who wants do ML).
 * Increased network buffer size to 32kB (8192 * 4).
 * Switched timestamp precision from ms to us for *ALL* timestamps.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-09-13 22:05:08 +02:00
Toni Uhlig
ac2e5ed796
CI: fix minimum supported libnDPI version
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-09-06 16:56:35 +02:00
lns
d646ec5ab4 nDPId: Fixed fcntl() issue; invalid fcntl() set after a blocking-write.
* nDPId: imrpvoed collector socket error messages on connect/write/etc failures
 * reverted `netcat` parts of the README

Signed-off-by: lns <matzeton@googlemail.com>
2022-08-29 15:29:07 +02:00
lns
dea30501a4 Add documentation about events and flow states.
Signed-off-by: lns <matzeton@googlemail.com>
2022-08-27 14:18:59 +02:00
Damiano Verzulli
96b9129918 Improve README
- slightly improve the README to better enhance the streaming
  capability of `nDPId`, regardless of `nDPIsrvd`
- add a screencast showing the install step and the
  `nDPId` usage, alone (with ncat as unix-socket listener)
- add "build" to .gitignore
2022-08-12 11:10:45 +02:00
Toni Uhlig
ef94b83a62
Replaced outdated nDPI version info with the correct one.
* add CI job to verify the lowest known-to-work-libnDPI-version

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-07-14 04:09:15 +02:00
Toni Uhlig
28602ca095
README update
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-07-12 16:03:51 +02:00
lns
3caf7727fd bump libnDPI to 0b3f8ed849cdf9971224c49a3958f0904a2bbbb5
* README/nDPId: fixed typ0

Signed-off-by: lns <matzeton@googlemail.com>
2022-06-06 00:34:13 +02:00
lns
f5b0021413 README update
Signed-off-by: lns <matzeton@googlemail.com>
2022-05-31 23:57:22 +02:00
Toni
73ca7fff3c
Updated CI badges. 2022-05-08 21:41:01 +02:00
Toni Uhlig
cb80c415d8
Improved py-flow-info to provide more optional information about received timestamps.
* py-flow-dashboard: Added color mapping for PieCharts/Graph that make more sense
 * nDPId: Renamed `flow_type' to a more precisely `flow_state'
 * nDPId: Changed the default setting to process only as much packets as libnDPI does

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-02-05 15:27:13 +01:00
Toni Uhlig
7022d0b1c5
nDPIsrvd: Fixed memory leak caused be not clearing buffer cache after a client disconnected.
* README.md: Fixed a typ0 and added a meh image from examples/py-flow-dashboard/flow-dash.py

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-01-26 15:38:43 +01:00
Toni Uhlig
9e07a57566
Major nDPId extension. Sorry for the huge commit.
- nDPId: fixed invalid IP4/IP6 tuple compare
 - nDPIsrvd: fixed caching issue (finally)
 - added tiny c example (can be used to check flow manager sanity)
 - c-captured: use flow_last_seen timestamp from `struct nDPIsrvd_flow`
 - README.md update: added example JSON sequence
 - nDPId: added new flow event `update` necessary for correct
   timeout handling (and other future use-cases)
 - nDPIsrvd.h and nDPIsrvd.py: switched to an instance
   (consists of an alias/source tuple) based flow manager
 - every flow related event **must** now serialize `alias`, `source`,
   `flow_id`, `flow_last_seen` and `flow_idle_time` to make the timeout
   handling and verification process work correctly
 - nDPIsrvd.h: ability to profile any dynamic memory (de-)allocation
 - nDPIsrvd.py: removed PcapPacket class (unused)
 - py-flow-dashboard and py-flow-multiprocess: fixed race condition
 - py-flow-info: print statusbar with probably useful information
 - nDPId/nDPIsrvd.h: switched from packet-flow only timestamps (`pkt_*sec`)
   to a generic flow event timestamp `ts_msec`
 - nDPId-test: added additional checks
 - nDPId: increased ICMP flow timeout
 - nDPId: using event based i/o if capturing packets from a device
 - nDPIsrvd: fixed memory leak on shutdown if remote descriptors
   were still connected

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-01-20 00:50:38 +01:00
Toni Uhlig
7829bfe4e6
CI extended and fixups
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-09-19 11:30:55 +02:00
Toni Uhlig
c152e41cfb
README.md ascii update
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-09-14 18:54:33 +02:00
Toni Uhlig
f4c8d96dd9
Gitlab-CI
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-08-03 13:06:12 +02:00
Toni Uhlig
9ffaeef24d
README.md update
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-05-14 00:16:47 +02:00
Toni Uhlig
182867a071
Reduced superfluous Travis-CI yaml content.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-05-12 15:17:07 +02:00
Toni Uhlig
fa079d2346
Git submodule libnDPI update.
* enable ctest to run integration tests (**only** if BUILD_NDPI=ON)

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-05-12 12:46:49 +02:00
Toni Uhlig
785603c276
Clone nDPI as submodule via CMake (if BUILD_NDPI=ON).
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-05-11 14:18:31 +02:00
Toni Uhlig
5b0a751159
README.md updated
* removed all those outdated Makefile.old references
 * added additional CMake build instructions

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-05-10 15:38:01 +02:00
Toni Uhlig
4e3dda70a3
Unified and improved dependency build/mgmt via CMake and travis-ci.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-04-22 17:37:55 +02:00
Toni Uhlig
ef4a22ffac
Updated README.md
* added examples/README.md and schema/README.md

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-03-24 14:44:27 +01:00
Toni Uhlig
1c3ef69faa
nDPIsrvd collectd-exec overhaul.
* Install targets updated.
 * Removed nDPIsrvd.h token validation function (done automatically by token_get).

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-03-15 14:39:43 +01:00
Toni Uhlig
257cce1dcc
Fixed braindead failure - Increase of NETWORK_BUFFER_MAX_SIZE > 9999 means to also increase NETWORK_BUFFER_LENGTH_DIGITS to 5.
* Fixed ARM32 xcompile warnings; Other GCC versions, other uint64_t's..
 * Replaced ridiculous nDPIsrvd_JSON_BYTES with NETWORK_BUFFER_LENGTH_DIGITS.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2021-01-27 18:05:13 +01:00
Toni Uhlig
9e4e41e5f6
Updated README.md ASCII architecture.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2020-09-29 17:43:36 +02:00
Toni Uhlig
3080fff9a3
yet another README.md update
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2020-08-15 13:08:57 +02:00
Toni Uhlig
9ab656dbe2
README.md update
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2020-08-15 13:02:54 +02:00
Toni Uhlig
9ae4aa7ce9
flow-info.py overhaul, terminal color support, ndpi protocol/category/flow-risk output
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2020-08-07 15:21:24 +02:00
Toni Uhlig
b3337c053d
added some random info's
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2020-08-06 18:26:32 +02:00