Shard Manager: A Generic Shard Management Framework for Geo-distributed Applications
Sangmin Lee, Zhenhua Guo, Omer Sunercan, Jun Ying, Thawan Kooburat, Suryadeep Biswal, Jun Chen, Kun Huang, Yatpang Cheung, Yiding Zhou, Kaushik Veeraraghavan, Biren Damani
2021年份
18被引次数
21顶会引用
摘要
Sharding is widely used to scale an application. Despite a decade of effort to build generic sharding frameworks that can be reused across different applications, the extent of their success remains unclear. We attempt to answer a fundamental question: what barriers prevent a sharding framework from getting adopted by the majority of sharded applications?
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
引用它的顶会 Paper21
- MAST: Global Scheduling of ML Training across Geo-Distributed Datacenters at HyperscaleArnab Choudhury, Yang Wang, Tuomas Pelkonen, Kutta Srinivasan 等OSDI 2024 · 被引用 39 次
- Ekko: A Large-Scale Deep Learning Recommender System with Low-Latency Model UpdateChijun Sima, Yao Fu, Man-Kit Sit, Liyi Guo 等OSDI 2022 · 被引用 31 次
- Replicating Persistent Memory Key-Value Stores with Efficient RDMA AbstractionQing Wang, Youyou Lu, Jing Wang, Jiwu ShuOSDI 2023 · 被引用 14 次
- ServiceLab: Preventing Tiny Performance Regressions at Hyperscale through Pre-Production TestingMike Chow, Yang Wang, William Wang, Ayichew Hailu 等OSDI 2024 · 被引用 11 次
- Parallelism-Optimizing Data Placement for Faster Data-Parallel ComputationsNirvik Baruah, Peter Kraft, Fiodar Kazhamiaka, Peter Bailis 等VLDB 2023 · 被引用 9 次
相关 Paper
- Areopagus: Asynchronous Sharding Blockchain Tolerating Corrupted Shards with Optimized OverheadYizhong Liu, Andi Liu, Yuxuan Hu, Jin Dong 等CCS 2026
- ByShard: Sharding in a Byzantine EnvironmentJelle Hellings, Mohammad SadoghiVLDB 2021 · 被引用 103 次
- Optimizing Resource Allocation in Hyperscale Datacenters: Scalability, Usability, and ExperiencesNeeraj Kumar, Pol Mauri Ruiz, Vijay Menon, Igor Kabiljo 等OSDI 2024 · 被引用 6 次
- Poros: Secure and Highly Parallel Sharding Blockchain with Optimized Cross-Shard Transaction ProcessingZhuocheng Pan, Jianwei Liu, Andi Liu, Yuxuan Hu 等CCS 2026
- Yield Not Thy CoreAchilles Benetopoulos, Peter Alvaro, Andi Quinn, Robert SouléEuroSys 2026
