Commit graph

45 commits

Author SHA1 Message Date
Emanuele Faranda
2a843966da Add alias and device type columns to host pools (#953)
* Add alias and device type columns to host pools

* Add host pool members links when available

* Add host pool links

* Implement host pool members pagination

* Host Pools GUI fixes and improvements

* Remove hardcoded columns number

* Host Pools GUI fixes

* Remove debug print
2017-01-27 17:48:58 +01:00
Simone Mainardi
413e22e889 Implements CIDR search in flow explorer
partially implements #574
2016-12-20 15:32:52 +01:00
Simone Mainardi
758db35671 Implements MySQL open_files_limit check
ntopng checks MySQL for the value of open_files_limit and engages
and alert if the worst case number of open files is greater
than or equal to the 80% of open_files_limit
2016-12-09 17:14:25 +01:00
Simone Mainardi
926a57f658 Executes db explorer queires automatically on user click
Clicking on flow details (e.g., protocol or src or dst)
automatically redirects the user to the db explorer page
and preserves selection details (pro version).
2016-07-12 17:02:14 +02:00
Simone Mainardi
96e964b14e Adds IN_ and OUT_BYTES to historical flows tables 2016-06-15 15:57:37 +02:00
Simone Mainardi
e12c703464 Implements IN_BYTES / OUT_BYTES for historical protocols 2016-05-24 11:57:12 +02:00
Simone Mainardi
9953cc2328 Implements IN_BYTES/OUT_BYTES in historical data
MySQL schema change has been implemented together with
new historical talkers.
TODO: historical protocols.
2016-05-24 11:08:11 +02:00
Simone Mainardi
d46a5b8b5e Refactors historical labels and code to improve readability 2016-04-15 17:05:28 +02:00
Simone Mainardi
3c0022197e Adds a flow inspector to the historical top talkers 2016-04-14 15:24:38 +02:00
Simone Mainardi
66513dc093 fixes a MySQL query error on unknown field 2016-04-14 11:04:24 +02:00
Simone Mainardi
fdaf16a7ef Implements bi-directional HTTP reqs/resps rates 2016-04-08 15:52:56 +02:00
Simone Mainardi
90ffa1eb10 Removes a debug print 2016-04-04 19:40:55 +02:00
Simone Mainardi
870a08a568 Adds ports, l4 and l7 protocols to historical talkers drill-down 2016-04-04 19:38:57 +02:00
Simone Mainardi
ba5b7a08f7 Extendends direction breakdown for l7 protocols 2016-04-04 16:44:32 +02:00
Simone Mainardi
7f983c3b14 Adds direction breakdown for historical top talkers 2016-04-04 16:01:17 +02:00
Simone Mainardi
2754c2dfa1 Stores integer interface ids into MySQL
Interface flows are now stored using integer interface ids rather
than interface names. This speeds up queries.
A migration code has also been introduced so that old MySQL table
format is migrated and old data does not get lost.

This also fixes #460
2016-03-25 19:58:00 +01:00
Luca Deri
924939c8f2 Added fix for catching MySQL errors 2016-03-19 15:04:18 +01:00
Simone Mainardi
a8f19cc45a Adds and extra check for a nil value 2016-02-20 14:27:40 +01:00
Simone Mainardi
5ab74fda10 Adds Flows download buttons and paginations
Hisotrical flows can be downloaded via two buttons
available inthe IPv4 and IPv6 pages. They can also be
browsed with pagination.
2016-02-19 20:16:48 +01:00
Simone Mainardi
aa592508d3 Uniforms return values for Lua functions that query MySQL
Lua function that query MySQL return an empty lua table
not only in case of an empty record set, but also in case of error.
This prevents upstream iterations over nil values.
2016-02-15 21:48:50 +01:00
Simone Mainardi
5f4eee79a3 Implements L7 application statistics drill-down
L7 Statistics can be drilled-down starting at the interface
or at the host level.
2016-02-12 18:49:03 +01:00
Simone Mainardi
9979d72707 Adds Flow Duration Computation in MySQL queries 2016-02-09 21:12:09 +01:00
Simone Mainardi
08622e8f18 Implements MySQL Top Talkers Retrieval and Visualization
Overal Top Talkers are retrieved with just one single
MySQL query and include both ipv4 and ipv4. Top talkers
can be visualized on a per-interface and per-host basis,
and can be sliced and diced.
2016-02-08 21:35:27 +01:00
Simone Mainardi
e1e0e9cab0 Slices historical application data via MySQL
MySQL engine is leveraged to slice and order historical
data.
2016-02-07 14:32:46 +01:00
Simone Mainardi
25ee0d5c11 Implements Top Talkers and Top Applications In Time Range
Top Talkers and Top applications can be retrieved via MySQL
both interface-wide and per-host. A couple of tabs, namely
"Top Talkers" and "Top Applications" become available in the
historical page of interfaces and hosts. Upon focus of each
tab, an ajax request is triggered and data is fetched from MySQL.

TODO: interface wide top-talkers are retrieved from sqlite and
need to be moved to mysql.
2016-02-06 18:11:31 +01:00
Simone Mainardi
418f48e714 Adds JSON endpoints to retrieve top talkers data 2016-02-01 22:14:28 +01:00
Simone Mainardi
064be1b125 Adds Top L7 Protocols lua function
A Lua function that queries MySQL to retrieve
historical L7 protocols has been added.
2016-01-05 19:22:02 +01:00
Simone Mainardi
ec301ace49 Extends top peers to IPv6 2016-01-05 18:57:45 +01:00
Simone Mainardi
47668a0cac Adds Top Peers Lua function
A Lua function that queries MySQL
to retrieve top peers (given an host) has been added.
This function is used inside ntopng professional
database explorer
2016-01-05 18:40:27 +01:00
Simone Mainardi
2045df7053 Reworks MySQL queries according to the new schema 2015-12-07 18:39:35 +01:00
Simone Mainardi
0c92e286d4 Reworks MySQL structure and adds interface support to dumped flows
Existing MySQL naming convention makes two separate tables for each interface monitored. Table names are flows4_<ifid> and flows6_<ifid>. Ifid is a unique integer identifier chosen by ntopng.

Present commit simplifies this structure and make just two tables, namely flows4 and flows6, and add an extra column to store the interface names. I do not think that storing the integer interface id is good: it is just a number that only make sense inside ntopng. Using interface names would yield more (re)usable data.

Committed code transparently migrates old tables into the new ones. Old flows are migrated into the new tables, and old tables are dropped.
2015-12-07 17:20:12 +01:00
Simone Mainardi
2228a8529c Adds ntopng instance name (#283)
ntopng instance name can be specified using command line parameter
--instance-name. If no parameter is specified, instance name defaults
to the current host name.

this information is exported to MySQL and ES.
2015-12-07 15:32:00 +01:00
Simone Mainardi
1ba346fc46 Visualises traffic profile information on historical tables
Traffic profile is queried from the database and possibly
shown as an extra field in the INFO column for historical data
2015-11-26 17:10:35 +01:00
Simone Mainardi
71b390ec47 Adds MySQL support for traffic profiles
Traffic profile information is dumped to MySQL.
2015-11-10 11:36:55 +01:00
Luca Deri
b0e53d8191 Fixed bug in DB flow filtering 2015-10-10 11:15:35 +02:00
Luca Deri
29513c466b Removed unused StatsManager methods
Removed unused get_real_epochs.lua
2015-10-01 23:36:16 +02:00
Luca Deri
988085dd2a Removed debug messages 2015-09-26 10:17:42 +02:00
Luca Deri
2767caa991 Added in preferences the ability to specify the MySQL data retention 2015-09-22 23:32:39 +02:00
Luca Deri
a62344d45c Added field INFO to MySQL flows.
If you update the code, you need to drop or modify the MySQL database format.
2015-09-22 22:37:11 +02:00
Luca Deri
f954a6f2d0 Fixed SQL query 2015-09-15 10:06:15 +02:00
Luca Deri
4bf10f4fce Added user role in About page
Fixed SQL when exploring subnets
Modified preferences to specify that when nDPI RRDs are created, they do for both local hosts and networks
2015-09-14 14:16:11 +02:00
Luca Deri
dfe98e6a69 Improved flow search 2015-08-24 23:44:06 +02:00
Luca Deri
ee65e5f143 Historical flow enhancements for queries 2015-08-19 00:16:28 +02:00
Luca Deri
4945f5c902 Added ability to navigate IPv4 and IPv6 flows 2015-08-16 23:44:01 +02:00
Luca Deri
a16ca6600d Added DB utils 2015-08-16 19:36:45 +02:00