Lune

OOPSLA2024Top-tier venue

Semantics of Remote Direct Memory Access: Operational and Declarative Models of RDMA on TSO Architectures

Guillaume Ambal, Brijesh Dongol, Haggai Eran, Vasileios Klimis, Ori Lahav, Azalea Raad

Abstract

Remote direct memory access (RDMA) is a modern technology enabling networked machines to exchange information without involving the operating system of either side, and thus significantly speeding up data transfer in computer clusters. While RDMA is extensively used in practice and studied in various research papers, a formal underlying model specifying the allowed behaviours of concurrent RDMA programs running in modern multicore architectures is still missing. This paper aims to close this gap and provide semantic foundations of RDMA on x86-TSO machines. We propose three equivalent formal models, two operational models in different levels of abstraction and one declarative model, and prove that the three characterisations are equivalent. To gain confidence in the proposed semantics, the more concrete operational model has been reviewed by NVIDIA experts, a major vendor of RDMA systems, and we have empirically validated the declarative formalisation on various subtle litmus tests by extensive testing. We believe that this work is a necessary initial step for formally addressing RDMA-based systems by proposing language-level models, verifying their mapping to hardware, and developing reasoning techniques for concurrent RDMA programs.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Taming x86-TSO persistency cites Persistency semantics of the Intel-x86 architecture
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. TäKōFormal: Enabling Robust Software for Programmable Memory HierarchiesPranav Srinivasan, Manos Kapritsos, Yatin A. ManerkarISCA 2026
  2. On the Verification Problem of Remote Direct Memory Access ProgramsParosh Aziz Abdulla, Mohamed Faouzi Atig, Govind Rajanbabu, Stephan SpenglerCAV 2026

Builds on9

  1. Persistency semantics of the Intel-x86 architectureAzalea Raad, John Wickerson, Gil Neiger, Viktor VafeiadisPOPL 2020 · 61 citations
  2. Promising 2.0: global optimizations in relaxed memory concurrencySung-Hwan Lee, Minki Cho, Anton Podkopaev, Soham Chakraborty et al.PLDI 2020 · 48 citations
  3. Decidable verification under a causally consistent shared memoryOri Lahav, Udi BokerPLDI 2020 · 30 citations
  4. Taming x86-TSO persistencyArtem Khyzha, Ori LahavPOPL 2021 · 26 citations
  5. Revamping hardware persistency models: view-based and axiomatic persistency models for Intel-x86 and Armv8Kyeongmin Cho, Sung-Hwan Lee, Azalea Raad, Jeehoon KangPLDI 2021 · 24 citations

Related papers

  1. A Verified High-Performance Composable Object Library for Remote Direct Memory AccessGuillaume Ambal, George Hodgkins, Mark Madler, Gregory V. Chockler et al.POPL 2026 · 2 citations
  2. sRDMA - Efficient NIC-based Authentication and Encryption for Remote Direct Memory AccessKonstantin Taranov, Benjamin Rothenberger, Adrian Perrig, Torsten HoeflerUSENIX ATC 2020 · 59 citations
  3. PRISM: Rethinking the RDMA Interface for Distributed SystemsMatthew Burke, Sowmya Dharanipragada, Shannon Joyner, Adriana Szekeres et al.SOSP 2021 · 23 citations
  4. 1RMA: Re-envisioning Remote Memory Access for Multi-tenant DatacentersArjun Singhvi, Aditya Akella, Dan Gibson, Thomas F. Wenisch et al.SIGCOMM 2020 · 70 citations
  5. Efficient Remote Memory Ordering for Non-Coherent SystemsWei Siew Liew, Md Ashfaqur Rahaman, Adarsh Patil, Ryan Stutsman et al.ASPLOS 2026
Dusk over the sea between two cliffs drawn in fine vertical lines