Make Updates Faster: A Fast Multi-Stripe Updates Framework in Erasure-Coded Storage Clusters
Hai Zhou, Dan Feng
摘要
Erasure coding is widely adopted to maintain data reliability, yet it introduces a significant update penalty. We analyze real-world traces and observe several challenges that are not addressed by existing studies, which thereby restricts the performance gains. We propose FastUpdate, an efficient multi-stripe updates framework that assists existing update schemes for fast updates. FastUpdate comprises three key designs: (i) it perceives the update locality and carefully merges multiple update requests accessing the same stripe to reduce the incurred network traffic; (ii) it abstracts the existing update schemes into collector selection and tree construction, greedily generates the update solution for each stripe to balance the transmission load across nodes; (iii) it dynamically schedules appropriate stripes to update in heterogeneous and dynamic networks to fully saturate the bandwidth resources. Comprehensive evaluations verify the effectiveness of FastUpdate on Alibaba ECS. It can increase the update throughput by 16.15%-88.71% for various update schemes.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Optimal Rack-Coordinated Updates in Erasure-Coded Data CentersGuowen Gong, Zhirong Shen, Suzhen Wu, Xiaolu Li 等INFOCOM 2021 · 被引用 21 次
- Exploiting Combined Locality for Wide-Stripe Erasure Coding in Distributed StorageYuchong Hu, Liangfeng Cheng, Qiaori Yao, Patrick P. C. Lee 等FAST 2021 · 被引用 88 次
- CoRD: Combining Raid and Delta for Fast Partial Updates in Erasure-Coded Storage ClustersHai Zhou, Dan Feng, Yuchong Hu, Wei Wang 等SC 2024 · 被引用 3 次
- Optimal Data Placement for Stripe Merging in Locally Repairable CodesSi Wu, Qingpeng Du, Patrick P. C. Lee, Yongkun Li 等INFOCOM 2022 · 被引用 23 次
- ChameleonEC: Exploiting Tunability of Erasure Coding for Low-Interference RepairYuhui Cai, Shiyao Lin, Zhirong Shen, Jiahui Yang 等HPCA 2025 · 被引用 5 次
