Demeter: Fine-grained Function Orchestration for Geo-distributed Serverless Analytics
Xiaofei Yue, Song Yang, Liehuang Zhu, Stojan Trajanovski, Xiaoming Fu
Abstract
In the era of global services, low-latency analytics on large-volume geo-distributed data has been a regular demand for application decision-making. Serverless computing facilitates fast function start-up and deployment, making it an attractive way for geo-distributed analytics. We argue that the serverless paradigm holds the potential to breach current performance bottlenecks via fine-grained function orchestration. However, how to configure it for geo-distributed analytics remains ambiguous. To fill this gap, we present Demeter, a scalable fine-grained function orchestrator for geo-distributed serverless analytics systems. Demeter aims to minimize the composite cost of co-existing jobs while meeting the user-specific Service Level Objectives (SLO). To handle the volatile environments and learn the diverse function demands, a Multi-Agent Reinforcement Learning (MARL) solution is used to co-optimize the per-function placement and resource allocation. The MARL extracts holistic and compact states via hierarchical graph neural networks, and then designs a novel actor network to shrink the huge decision space and model complexity. Finally, we implement Demeter and evaluate it using realistic workloads. The experimental results reveal that Demeter significantly saves costs by 23.3%∼32.7%, while reducing SLO violations by over 27.4%, surpassing state-of-the-art solutions.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on11
- Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud ProviderMohammad Shahrad, Rodrigo Fonseca, Iñigo Goiri, Gohar Irfan Chaudhry et al.USENIX ATC 2020 · 946 citations
- Directed Acyclic Graph Neural NetworksVeronika Thost, Jie ChenICLR 2021 · 134 citations
- AQUATOPE: QoS-and-Uncertainty-Aware Resource Management for Multi-stage Serverless WorkflowsZhuangzhuang Zhou, Yanqi Zhang, Christina DelimitrouASPLOS 2023 · 78 citations
- Caerus: NIMBLE Task Scheduling for Serverless AnalyticsHong Zhang, Yupeng Tang, Anurag Khandelwal, Jingrong Chen et al.NSDI 2021 · 75 citations
- StepConf: SLO-Aware Dynamic Resource Configuration for Serverless Function WorkflowsZhaojie Wen, Yishuo Wang, Fangming LiuINFOCOM 2022 · 72 citations
Related papers
- FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless WorkflowsYilun Wang, Pengfei Chen, Hui Dou, Yiwen Zhang et al.ASE 2024 · 3 citations
- A Mean-Field Game Approach to Cloud Resource Management with Function ApproximationWeichao Mao, Haoran Qiu, Chen Wang, Hubertus Franke et al.NeurIPS 2022 · 27 citations
- Krysha: Cost-Efficient Resource Orchestration for Geo-Distributed Serverless MicroservicesYuqiu Zhang, Hans-Arno JacobsenHPDC 2026
- Accelerating Serverless Computing by Harvesting Idle ResourcesHanfei Yu, Hao Wang, Jian Li, Xu Yuan et al.WWW 2022 · 44 citations
- Ditto: Efficient Serverless Analytics with Elastic ParallelismChao Jin, Zili Zhang, Xingyu Xiang, Songyun Zou et al.SIGCOMM 2023 · 27 citations
