RDNet: An RDMA-aware Container Network Interface for Cloud Environments
Myoungsung You, Minjae Seo, Seungwon Shin, Jaehyun Nam
Abstract
Remote Direct Memory Access (RDMA) is increasingly adopted in container-based cloud environments for its ability to deliver high-performance communication, making it essential for distributed microservices and AI workloads. However, current container network interfaces (CNIs) face two critical limitations when supporting RDMA: (i) insufficient observability of RDMA operations and (ii) lack of transparent support for legacy TCP/IP containers. RDMA’s kernel bypass nature prevents CNIs from monitoring container-level RDMA activities, hindering efficient resource monitoring and exposing multi-tenant environments to security risks. In addition, enabling RDMA for TCP/IP containers requires substantial code modifications due to the differences between RDMA verbs and socket APIs. This paper presents RDNet, a novel RDMA-aware CNI that integrates seamlessly with existing container platforms. RDNet leverages a user-space eBPF runtime to provide fine-grained RDMA observability at the container level and in-line RDMA policy enforcement with minimal overhead. For TCP/IP containers, RDNet relays traffic through a transparent RDMA proxy with eBPF-based traffic redirection, avoiding code changes while improving communication performance. Experimental results show RDNet incurs less than 5% monitoring overhead, blocks unauthorized RDMA operations, and enhances TCP/IP container throughput by up to 2× for HTTP and gRPC workloads.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 19dadc19-c23c-42d2-97f2-b7d0cd127a6fBuilds on12
- Understanding host network stack overheadsQizhe Cai, Shubham Chaudhary, Midhul Vuppalapati, Jaehyun Hwang et al.SIGCOMM 2021 · 150 citations
- Understanding RDMA Microarchitecture Resources for Performance IsolationXinhao Kong, Jingrong Chen, Wei Bai, Yechen Xu et al.NSDI 2023 · 81 citations
- sRDMA - Efficient NIC-based Authentication and Encryption for Remote Direct Memory AccessKonstantin Taranov, Benjamin Rothenberger, Adrian Perrig, Torsten HoeflerUSENIX ATC 2020 · 59 citations
- ReDMArk: Bypassing RDMA Security MechanismsBenjamin Rothenberger, Konstantin Taranov, Adrian Perrig, Torsten HoeflerUSENIX Security 2021 · 56 citations
- BASTION: A Security Enforcement Network Stack for Container NetworksJaehyun Nam, Seungsoo Lee, Hyunmin Seo, Phil Porras et al.USENIX ATC 2020 · 55 citations
Related papers
- MigrOS: Transparent Live-Migration Support for Containerised RDMA ApplicationsMaksym Planeta, Jan Bierbaum, Leo Sahaya Daphne Antony, Torsten Hoefler et al.USENIX ATC 2021 · 27 citations
- INSERT: In-Network Stateful End-to-End RDMA TelemetryHyunseok Chang, Walid A. Hanafy, Sarit Mukherjee, Limin WangINFOCOM 2024 · 3 citations
- Software-based Live Migration for RDMAXiaoyu Li, Ran Shu, Yongqiang Xiong, Fengyuan RenSIGCOMM 2025 · 4 citations
- Maximizing the Benefit of RDMA at End HostsXiaoliang Wang, Hexiang Song, Cam-Tu Nguyen, Dongxu Cheng et al.INFOCOM 2021 · 8 citations
- PeRF: Preemption-enabled RDMA FrameworkSugi Lee, Mingyu Choi, Ikjun Yeom, Younghoon KimUSENIX ATC 2024 · 3 citations
