Performance Analysis of gNMI Streaming Telemetry-Based Monitoring Systems Using Containerlab Network Simulation
Abstract
The rapid growth of the Internet has impacted the digital service development. This surge in demand has created opportunities for digital service industry players. Despite its positive impact, the growth of the Internet also poses technical challenges. In managing the increasing data traffic, resource monitoring plays a vital role. One of the latest methods for monitoring these resources is the utilization of the Google’s Remote Procedure Call (gRPC) Network Management Interface (gNMI) streaming telemetry system. While it seems superior to current protocols, there is a need for further exploration into the implementation of streaming telemetry systems. This paper specifically investigates the trade-offs and performance of gNMI streaming telemetry. The design and simulation were conducted utilizing containerlab, a Docker-based networking lab tool. In the Docker-based simulation, integration between the monitoring system and network topology was implemented. The results from observing each protocol indicate that the monitoring system’s metric retrieval activity had minimal impact on network conditions. This is evident in the consistently low average network latency and nearly uniform throughput, except in instances of packet loss and congestion. Simulation observations indicate that the gNMI monitoring system utilized input/output (I/O) resources more intensively compared to other protocols. The research also examined the integration of gNMI streaming telemetry and log monitoring, revealing a 70 MB rise in memory usage and a 33% increase in Disk I/O resources. Furthermore, the study uncovered signs of a 50% increase in CPU utilization by the gNMI monitoring system compared to the average data recorded in the observations.
References
B. Aggarwal, Q. Xiong, and E. Schroeder-Butterfill, “Impact of the use of the internet on quality of life in older adults: Review of literature,” Prim. Health Care Res. Develop., vol. 21, pp. 1-6, Dec. 2020, doi: 10.1017/S1463423620000584.
J. Manyika, “Big data: The next frontier for innovation, competition, and productivity,” 2011. [Online]. Available: https://personal.utdallas.edu/~muratk/courses/cloud11f_files/MGI-full-report.pdf
E. Permadi (2020) “Industri cloud dan hosting di Indonesia, begini kondisi saat pandemi COVID-19,” [Online], https://sumatra.bisnis.com/read/20200819/534/1280826/industri-cloud-dan-hosting-di-indonesia-begini-kondisi-saat-pandemi-covid-19, access date: 25-Feb-2023.
E.B. Nadales (2023) “Impact of traffic growth on networks and investment needs,” [Online], https://www.telefonica.com/en/communication-room/blog/impact-of-traffic-growth-on-networks-and-investment-needs/, access date: 5-Jun-2023.
M.Y.B. Rasyiidin and F.A. Murad, “Monitoring server berbasis SNMP menggunakan Cacti pada server lokal,” J. Ilm. FIFO, vol. 13, no. 1, pp. 14–23, May 2021, doi: 10.22441/fifo.2021.v13i1.002.
A. Pradana, I.R. Widiasari, and R. Efendi, “Implementasi sistem monitoring jaringan menggunakan Zabbix berbasis SNMP,” AITI, vol. 19, no. 2, pp. 248–262, Nov. 2022, doi: 10.24246/aiti.v19i2.248-262.
A. Sgambelluri et al., “Reliable and scalable Kafka-based framework for optical network telemetry,” J. Opt. Commun. Netw., vol. 13, no. 10, pp. E42-E52, Oct. 2021, doi: 10.1364/JOCN.424639.
F. Paolucci, A. Sgambelluri, P. Castoldi, and F. Cugini, “Telemetry solutions in disaggregated optical networks: An experimental view,” Opt. Fiber Commun. Conf. (OFC) 2021, 2021, pp. 1–3, doi: 10.1364/OFC.2021.W1G.1.
R. Vilalta et al., “Telemetry-enabled cloud-native transport SDN controller for real-time monitoring of optical transponders using gNMI,” 2020 Eur. Conf. Opt. Commun. (ECOC), 2020, pp. 1-4, doi: 10.1109/ECOC48923.2020.9333143.
A. Sgambelluri et al., “Open source implementation of OpenConfig telemetry-enabled NETCONF agent,” 2019 21st Int. Conf. Transparent Opt. Netw. (ICTON), 2019, pp. 1–4, doi: 10.1109/ICTON.2019.8840320.
K.S. Mayer et al., “Machine-learning-based soft-failure localization with partial software-defined networking telemetry,” J. Opt. Commun. Netw., vol. 13, no. 10, pp. E122–131, Oct 2021, doi: 10.1364/JOCN.424654.
J.E. Simsarian et al., “Demonstration of cloud-based streaming telemetry processing for optical network monitoring,” 2021 Eur. Conf. Opt. Commun. (ECOC), 2021, pp. 1–4, doi: 10.1109/ECOC52684.2021.9605813.
X. Cheng et al., “IntStream: An intent-driven streaming network telemetry framework,” 2021 17th Int. Conf. Netw. Service Manag. (CNSM), 2021, pp. 473–481, doi: 10.23919/CNSM52442.2021.9615520.
R.A.K. Fezeu and Z.-L. Zhang, “Anomalous model-driven-telemetry network-stream BGP detection,” 2020 IEEE 28th Int. Conf. Netw. Protoc. (ICNP), 2020, pp. 1–6, doi: 10.1109/ICNP49622.2020.9259411.
A. Sadasivarao et al., “Demonstration of extensible threshold-based streaming telemetry for open DWDM analytics and verification,” Opt. Fiber Commun. Conf. (OFC) 2020, 2020, pp. 1–3, doi: 10.1364/OFC.2020.M3Z.5.
R.P. Pinto et al., “Packet-optical differentiated survivability implemented by P4 slices and gNMI telemetry,” 2023 Opt. Fiber Commun. Conf. Exhib. (OFC) 2023, 2023, pp. 1–3, doi: 10.1364/OFC.2023.M1G.3.
Ç. Kurt and O.A. Erdem, “Real-time anomaly detection and mitigation using streaming telemetry in SDN,” Turkish J. Elect. Eng. Comput. Sci., vol. 28, no. 5, pp. 2448–2466, Sep. 2020, doi: 10.3906/elk-1909-112.
I. Ivanov, “Comparing the performance of SNMP to network telemetry streaming with gRPC/GPB,” 53rd Int. Sci. Conf. Inf. Commun. Energy Syst. Technol., 2018, pp. 175–178.
E. Pettersson, “A comparison of pull-and push-based network monitoring solutions examining bandwidth and system resource usage,” Undergraduate thesis, KTH Royal Institute of Technology, Stockholm, Swedia, 2021.
B. Buresh et al. A Modern, Open, and Scalable Fabric VXLAN EVPN. (2016). Access date: 7-Mar-2023. [Online]. Available: https://www.cisco.com/c/dam/en/us/td/docs/switches/datacenter/nexus9000/sw/vxlan_evpn/VXLAN_EVPN.pdf
H. Song et al. (2022) “Network Telemetry Framework RFC 9232,” [Online], https://datatracker.ietf.org/doc/html/rfc9232, access date: 10-Mar-2023.
M. Korshunov. Streaming telemetry: Considerations & challenges [Online]. Available: https://ripe78.ripe.net/presentations/26-ripe78_Korshunov_Streaming_Telemetry_consideration_and_challenges_final.pdf
R. Dodin, B. Claeys, and M. Vahlenkamp, “Nokia SR Linux Streaming Telemetry Lab,” [Online], https://github.com/srl-labs/srl-telemetry-lab, access date: 10-Mar-2023.
© Jurnal Nasional Teknik Elektro dan Teknologi Informasi, under the terms of the Creative Commons Attribution-ShareAlike 4.0 International License.