Themis: Scheduling-Aware Buffer Management for HBM-Based Hybrid Buffers
Zhiyu Zhang, Minkun Xue, Kan Yu, Ruyi Yao, Shili Chen, Hao Mei, Zixuan Chen, Weiyi Chen, Yibo Fan, Yang Xu
Abstract
Packet buffers are critical for absorbing congestion and sustaining throughput in high-speed routers. As link rates escalate, on-chip SRAM alone can no longer provide sufficient capacity. To address this, modern routers widely adopt hybrid buffer architectures that augment limited onchip SRAM with large off-chip DRAM. Despite this architectural promise, existing hybrid Buffer Management (BM) schemes severely undermine router performance. They simply redirect packets that would otherwise be dropped into DRAM, which leads to priority inversion and head-of-line blocking: as packets buffered in DRAM age into the highestpriority packets, SRAM must stall until they are retrieved, wasting bandwidth and degrading throughput. Worse still, existing BM schemes ignore DRAM's access characteristics, further constraining its limited bandwidth and reducing overall performance dramatically.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 34aeb19e-f75b-4e33-b4de-e665126913ebBuilds on10
- ABM: active buffer management in datacentersVamsi Addanki, Maria Apostolaki, Manya Ghobadi, Stefan Schmid et al.SIGCOMM 2022 · 59 citations
- Reverie: Low Pass Filter-Based Switch Buffer Sharing for Datacenters with RDMA and TCP TrafficVamsi Addanki, Wei Bai, Stefan Schmid, Maria ApostolakiNSDI 2024 · 33 citations
- Credence: Augmenting Datacenter Switch Buffer Sharing with ML PredictionsVamsi Addanki, Maciej Pacut, Stefan SchmidNSDI 2024 · 22 citations
- Traffic-aware Buffer Management in Shared Memory SwitchesSijiang Huang, Mowei Wang, Yong CuiINFOCOM 2021 · 14 citations
- BMW Tree: Large-scale, High-throughput and Modular PIFO Implementation using Balanced Multi-Way Sorting TreeRuyi Yao, Zhiyu Zhang, Gaojian Fang, Peixuan Gao et al.SIGCOMM 2023 · 14 citations
Related papers
- Occamy: A Preemptive Buffer Management for On-chip Shared-memory SwitchesDanfeng Shan, Yunguang Li, Jinchao Ma, Zhenxing Zhang et al.EuroSys 2025 · 5 citations
- Hybrid2: Combining Caching and Migration in Hybrid Memory SystemsEvangelos Vasilakis, Vassilis Papaefstathiou, Pedro Trancoso, Ioannis SourdisHPCA 2020 · 37 citations
- Controlling Arbitrary Internet Queues with TitrateAnchengcheng Zhou, Joshua Lau, Philip Brighten Godfrey, Maria ApostolakiNSDI 2026
- Lark: A Buffer-aware Building Block for Programmable Packet Scheduling in DatacentersSong Zhang, Wenxin Li, Yulong Li, Yuan Liu et al.INFOCOM 2025
- OBM: Optimal Shared Packet Buffer Management in SwitchesDan Mani Binu, Jason Lei, Vishal ShrivastavSIGCOMM 2026
