[网络领域顶会追踪系列#19][NSDI'22]HeteroSketch:在异质和动态的网络中协调全网监控

本系列为个人论文阅读笔记,大多数应该是对顶会摘要的个人菜鸟翻译,旨在让感兴趣的朋友能快速浏览、获取信息。如有错误或心得,欢迎在评论区交流指正!

HeteroSketch: Coordinating Network-wide Monitoring in Heterogeneous and Dynamic Networks

背景

网络测量和监控是网络管理里非常重要的一环。sketch算法以及网络元素的可编程性越来越高,高精度、网络范围的遥测触手可及。

挑战

  • 可编程硬件的异构型
  • 可用资源和资源需求的动态变化

使得网络network-wide的监控不切实际。

工作

HeteroSketch,由两个主要组件组成的架构。

  • 一个预测工具,可通过预测sketch算法的性能,自动地量化任意硬件的能力
  • 一个优化框架,在考虑异构设备能力的情况下,决定测量任务的放置以及设备的资源分配,来满足监控目标

Hetero能够使用新型集群算法来优化大型网络(超过40,000个节点)的部署,并且能够令网络拓扑、流量、资源动态快速响应。

实验

实验表明HeteroSketch在维护监控性能、覆盖和准确性地情况下,能够减少20%~60%的开销。

原文摘要

Network monitoring and measurement have always been critical components of network management. Recent developments in sketch-based monitoring techniques and the deployment opportunities arising from the increasing programmability of network elements (e.g., programmable switches, SmartNICs, and software switches) have made the possibility of accurate, detailed, network-wide telemetry tantalizingly within reach. However, the wide heterogeneity of the programmable hardware and dynamic changes in both resources available and resources needed for monitoring over time make existing approaches to network-wide monitoring impractical.

We present HeteroSketch, a framework that consists of two main components: (1) a profiling tool that automatically quantifies the capabilities of arbitrary hardware by predicting their performance for sketching algorithms, and (2) an optimization framework that decides placement of measurement tasks and resource allocation for devices to meet monitoring goals while considering heterogeneous device capabilities. HeteroSketch enables optimized deployments for large networks (> 40,000 nodes) using a novel clustering approach and enables prompt responses to network topology, traffic, query, and resource dynamics. Our evaluation shows that HeteroSketch reduces resource overheads by 20-60% compared to prior art, while maintaining monitoring performance, coverage, and accuracy.