Adaptive Workload-Balanced Scheduling Strategy for Global Ocean Data Assimilation on Massive GPUs
Junmin Xiao, Chaoyang Shui, Di Cai, Kangyu Wang, Yunfei Pang, Mingyi Li, Hui Ma, Guangming Tan
摘要
Global ocean data assimilation is a crucial technique to estimate the actual oceanic state by combining numerical model outcomes and observation data, which is widely used in climate research. Due to the imbalanced distribution of observation data in global ocean, the parallel efficiency of recent methods suffers from workload imbalance. When massive GPUs are applied for global ocean data assimilation, the workload imbalance becomes more severe, resulting in poor scalability. In this work, we propose a novel adaptive workload-balance scheduling strategy, Bassimilation, which successfully estimates the total workload prior to execution and ensures a balanced workload assignment. Further, we design a parallel dynamic programming approach to accelerate the schedule decision, and develop a factored dataflow to exploit the parallel potential of GPUs. Evaluation demonstrates that our algorithm outperforms the state-of-the-art method by up to 9.1× speedup. This work is the first to scale global ocean data assimilation to 4, 000 GPUs.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- PAGANI: a parallel adaptive GPU algorithm for numerical integrationIoannis Sakiotis, Kamesh Arumugam, Marc F. Paterno, Desh Ranjan 等SC 2021 · 被引用 4 次
- W-Cycle SVD: A Multilevel Algorithm for Batched SVD on GPUsJunmin Xiao, Yunfei Pang, Qing Xue, Chaoyang Shui 等SC 2022 · 被引用 4 次
- EasyScale: Elastic Training with Consistent Accuracy and Improved Utilization on GPUsMingzhen Li, Wencong Xiao, Hailong Yang, Biao Sun 等SC 2023 · 被引用 16 次
- MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU ClustersQizhen Weng, Wencong Xiao, Yinghao Yu, Wei Wang 等NSDI 2022
- Rocket: efficient and scalable all-pairs computations on heterogeneous platformsStijn Heldens, Pieter Hijma, Ben van Werkhoven, Jason Maassen 等SC 2020
