SC2025Top-tier venue
Make Updates Faster: A Fast Multi-Stripe Updates Framework in Erasure-Coded Storage Clusters
Hai Zhou, Dan Feng
Abstract
Erasure coding is widely adopted to maintain data reliability, yet it introduces a significant update penalty. We analyze real-world traces and observe several challenges that are not addressed by existing studies, which thereby restricts the performance gains. We propose FastUpdate, an efficient multi-stripe updates framework that assists existing update schemes for fast updates. FastUpdate comprises three key designs: (i) it perceives the update locality and carefully merges multiple update requests accessing the same stripe to reduce the incurred network traffic; (ii) it abstracts the existing update schemes into collector selection and tree construction, greedily generates the update solution for each stripe to balance the transmission load across nodes; (iii) it dynamically schedules appropriate stripes to update in heterogeneous and dynamic networks to fully saturate the bandwidth resources. Comprehensive evaluations verify the effectiveness of FastUpdate on Alibaba ECS. It can increase the update throughput by 16.15%-88.71% for various update schemes.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 75b713ec-7c32-433d-bdad-d505fe2f3307Related papers
- Optimal Rack-Coordinated Updates in Erasure-Coded Data CentersGuowen Gong, Zhirong Shen, Suzhen Wu, Xiaolu Li et al.INFOCOM 2021 · 21 citations
- Exploiting Combined Locality for Wide-Stripe Erasure Coding in Distributed StorageYuchong Hu, Liangfeng Cheng, Qiaori Yao, Patrick P. C. Lee et al.FAST 2021 · 88 citations
- CoRD: Combining Raid and Delta for Fast Partial Updates in Erasure-Coded Storage ClustersHai Zhou, Dan Feng, Yuchong Hu, Wei Wang et al.SC 2024 · 3 citations
- Optimal Data Placement for Stripe Merging in Locally Repairable CodesSi Wu, Qingpeng Du, Patrick P. C. Lee, Yongkun Li et al.INFOCOM 2022 · 23 citations
- ChameleonEC: Exploiting Tunability of Erasure Coding for Low-Interference RepairYuhui Cai, Shiyao Lin, Zhirong Shen, Jiahui Yang et al.HPCA 2025 · 5 citations
