Lune

INFOCOM2024Top-tier venue

Demeter: Fine-grained Function Orchestration for Geo-distributed Serverless Analytics

Xiaofei Yue, Song Yang, Liehuang Zhu, Stojan Trajanovski, Xiaoming Fu

Abstract

In the era of global services, low-latency analytics on large-volume geo-distributed data has been a regular demand for application decision-making. Serverless computing facilitates fast function start-up and deployment, making it an attractive way for geo-distributed analytics. We argue that the serverless paradigm holds the potential to breach current performance bottlenecks via fine-grained function orchestration. However, how to configure it for geo-distributed analytics remains ambiguous. To fill this gap, we present Demeter, a scalable fine-grained function orchestrator for geo-distributed serverless analytics systems. Demeter aims to minimize the composite cost of co-existing jobs while meeting the user-specific Service Level Objectives (SLO). To handle the volatile environments and learn the diverse function demands, a Multi-Agent Reinforcement Learning (MARL) solution is used to co-optimize the per-function placement and resource allocation. The MARL extracts holistic and compact states via hierarchical graph neural networks, and then designs a novel actor network to shrink the huge decision space and model complexity. Finally, we implement Demeter and evaluate it using realistic workloads. The experimental results reveal that Demeter significantly saves costs by 23.3%∼32.7%, while reducing SLO violations by over 27.4%, surpassing state-of-the-art solutions.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • AQUATOPE: QoS-and-Uncertainty-Aware Resource Management for Multi-stage Serverless Workflows cites Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on11

  1. Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud ProviderMohammad Shahrad, Rodrigo Fonseca, Iñigo Goiri, Gohar Irfan Chaudhry et al.USENIX ATC 2020 · 946 citations
  2. Directed Acyclic Graph Neural NetworksVeronika Thost, Jie ChenICLR 2021 · 134 citations
  3. AQUATOPE: QoS-and-Uncertainty-Aware Resource Management for Multi-stage Serverless WorkflowsZhuangzhuang Zhou, Yanqi Zhang, Christina DelimitrouASPLOS 2023 · 78 citations
  4. Caerus: NIMBLE Task Scheduling for Serverless AnalyticsHong Zhang, Yupeng Tang, Anurag Khandelwal, Jingrong Chen et al.NSDI 2021 · 75 citations
  5. StepConf: SLO-Aware Dynamic Resource Configuration for Serverless Function WorkflowsZhaojie Wen, Yishuo Wang, Fangming LiuINFOCOM 2022 · 72 citations

Related papers

  1. FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless WorkflowsYilun Wang, Pengfei Chen, Hui Dou, Yiwen Zhang et al.ASE 2024 · 3 citations
  2. A Mean-Field Game Approach to Cloud Resource Management with Function ApproximationWeichao Mao, Haoran Qiu, Chen Wang, Hubertus Franke et al.NeurIPS 2022 · 27 citations
  3. Krysha: Cost-Efficient Resource Orchestration for Geo-Distributed Serverless MicroservicesYuqiu Zhang, Hans-Arno JacobsenHPDC 2026
  4. Accelerating Serverless Computing by Harvesting Idle ResourcesHanfei Yu, Hao Wang, Jian Li, Xu Yuan et al.WWW 2022 · 44 citations
  5. Ditto: Efficient Serverless Analytics with Elastic ParallelismChao Jin, Zili Zhang, Xingyu Xiang, Songyun Zou et al.SIGCOMM 2023 · 27 citations
Dusk over the sea between two cliffs drawn in fine vertical lines