DirectFaaS: A Clean-Slate Network Architecture for Efficient Serverless Chain Communications
Qingyang Zeng, Kaiyu Hou, Xue Leng, Yan Chen
Abstract
Serverless computing, also known as Function-as-a-Service (FaaS), triggers web applications in the form of function chains. It uses a central orchestrator to route all requests from end-users and internal functions. Such architecture simplifies application deployment for developers. However, the convenient centralized network architecture compromises the efficiency of function chain communications. Specifically, (i) a centralized API gateway assists in routing requests between functions. This indirect routing scheme raises invocation latency. (ii) The control flow for invoking functions and the data flow for passing function data packets are both forwarded by the API gateway. This results in the API gateway consuming a significant amount of resources. (iii) All data packets of internal function communications go through the same API gateway. This expands the additional attack surface in multi-tenant scenarios. In this paper, we propose DirectFaaS, a clean-slate network architecture to improve the function chain communication performance. By separating coupled control flow and data flow, Direct-FaaS releases the API gateway from heavy traffic forwarding, reducing its resource consumption. For this goal, DirectFaaS exploits the network control capabilities of Software-Defined Networking (SDN) to establish direct data forwarding channels to accelerate function chain invocations. In addition, the data flow constrained by fine-grained network policies consolidates multi-tenant traffic security. We implement the DirectFaaS prototype on the popular OpenFaaS platform. Evaluations under real-world serverless applications show that DirectFaaS achieves a reduction in application execution time by up to 30.9% and CPU consumption by up to 30.1% compared to the current architecture.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0888051f-e36e-4f49-9635-81a7bd458049Builds on8
- Nightcore: efficient and scalable serverless computing for latency-sensitive, interactive microservicesZhipeng Jia, Emmett WitchelASPLOS 2021 · 218 citations
- Help Rather Than Recycle: Alleviating Cold Startup in Serverless Computing Through Inter-Function Container SharingZijun Li, Linsong Guo, Quan Chen, Jiagan Cheng et al.USENIX ATC 2022 · 135 citations
- Lambada: Interactive Data Analytics on Cold Data Using Serverless Cloud InfrastructureIngo Müller, Renato Marroquín, Gustavo AlonsoSIGMOD 2020 · 135 citations
- Orion: Google's Software-Defined Networking Control PlaneAndrew D. Ferguson, Steve D. Gribble, Chi-Yao Hong, Charles Killian et al.NSDI 2021 · 95 citations
- SPRIGHT: extracting the server from serverless computing! high-performance eBPF-based event-driven, shared-memory processingShixiong Qi, Leslie Monis, Ziteng Zeng, Ian-Chin Wang et al.SIGCOMM 2022 · 85 citations
Related papers
- FSD-Inference: Fully Serverless Distributed Inference with Scalable Cloud CommunicationJoe Oakley, Hakan FerhatosmanogluICDE 2024 · 6 citations
- MXFaaS: Resource Sharing in Serverless Environments for Parallelism and EfficiencyJovan Stojkovic, Tianyin Xu, Hubertus Franke, Josep TorrellasISCA 2023 · 39 citations
- SEUSS: skip redundant paths to make serverless fastJames Cadden, Thomas Unger, Yara Awad, Han Dong et al.EuroSys 2020 · 156 citations
- SpecFaaS: Accelerating Serverless Applications with Speculative Function ExecutionJovan Stojkovic, Tianyin Xu, Hubertus Franke, Josep TorrellasHPCA 2023 · 16 citations
- Dirigent: Lightweight Serverless OrchestrationLazar Cvetkovic, François Costa, Mihajlo Djokic, Michal Friedman et al.SOSP 2024 · 6 citations
