StepConf: SLO-Aware Dynamic Resource Configuration for Serverless Function Workflows
Zhaojie Wen, Yishuo Wang, Fangming Liu
Abstract
Function-as-a-Service (FaaS) offers a fine-grained resource provision model, enabling developers to build highly elastic cloud applications. User requests are handled by a series of serverless functions step by step, which forms a function-based workflow. The developers are required to set proper resource configuration for functions, so as to meet service level objectives (SLOs) and save cost. However, developing the resource configuration strategy is challenging. It is mainly because execution of cloud functions often suffers from cold start and performance fluctuation, which requires a dynamic configuration strategy to guarantee the SLOs. In this paper, we present StepConf, a framework that automates the resource configuration for functions as the workflow runs. StepConf optimizes memory size for each function step in the workflow and takes inter and intra-function parallelism into consideration. We evaluate StepConf on AWS Lambda. Compared with baselines, the experimental results show that StepConf can save cost up to 40.9% while ensuring the SLOs.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 831d04c3-189e-4dbb-ad42-e9880cf2e1adCited by top-tier papers11
- A Mean-Field Game Approach to Cloud Resource Management with Function ApproximationWeichao Mao, Haoran Qiu, Chen Wang, Hubertus Franke et al.NeurIPS 2022 · 27 citations
- λGrapher: A Resource-Efficient Serverless System for GNN Serving through Graph SharingHaichuan Hu, Fangming Liu, Qiangyu Pei, Yongjie Yuan et al.WWW 2024 · 23 citations
- Jolteon: Unleashing the Promise of Serverless for Serverless WorkflowsZili Zhang, Chao Jin, Xin JinNSDI 2024 · 15 citations
- Demeter: Fine-grained Function Orchestration for Geo-distributed Serverless AnalyticsXiaofei Yue, Song Yang, Liehuang Zhu, Stojan Trajanovski et al.INFOCOM 2024 · 13 citations
- X-Stream: A Flexible, Adaptive Video Transformer for Privacy-Preserving Video Stream AnalyticsDou Feng, Lin Wang, Shutong Chen, Lingching Tung et al.INFOCOM 2024 · 8 citations
Related papers
- FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless WorkflowsYilun Wang, Pengfei Chen, Hui Dou, Yiwen Zhang et al.ASE 2024 · 3 citations
- With Great Freedom Comes Great Opportunity: Rethinking Resource Allocation for Serverless FunctionsMuhammad Bilal, Marco Canini, Rodrigo Fonseca, Rodrigo RodriguesEuroSys 2023 · 51 citations
- Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud ProviderMohammad Shahrad, Rodrigo Fonseca, Iñigo Goiri, Gohar Irfan Chaudhry et al.USENIX ATC 2020 · 946 citations
- SPES: Towards Optimizing Performance-Resource Trade-Off for Serverless FunctionsCheryl Lee, Zhouruixin Zhu, Tianyi Yang, Yintong Huo et al.ICDE 2024 · 13 citations
- COSE: Configuring Serverless Functions using Statistical LearningNabeel Akhtar, Ali Raza, Vatche Ishakian, Ibrahim MattaINFOCOM 2020 · 97 citations
