CLITE: Efficient and QoS-Aware Co-Location of Multiple Latency-Critical Jobs for Warehouse Scale Computers
Tirthak Patel, Devesh Tiwari
Abstract
Large-scale data centers run latency-critical jobs with quality-of-service (QoS) requirements, and throughput-oriented background jobs, which need to achieve high perfor-mance. Previous works have proposed methods which cannot co-locate multiple latency-critical jobs with multiple back-grounds jobs while: (1) meeting the QoS requirements of all latency-critical jobs, and (2) maximizing the performance of the background jobs. This paper proposes CLITE, a Bayesian Optimization-based, multi-resource partitioning technique which achieves these goals. CLITE is publicly available at https://github.com/GoodwillComputingLab/CLITE.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get a8c0d815-89db-42bd-8017-24e31e68320fCited by top-tier papers24
- DynamoLLM: Designing LLM Inference Clusters for Performance and Energy EfficiencyJovan Stojkovic, Chaojie Zhang, Íñigo Goiri, Josep Torrellas et al.HPCA 2025 · 106 citations
- Mind mappings: enabling efficient algorithm-accelerator mapping space searchKartik Hegde, Po-An Tsai, Sitao Huang, Vikas Chandra et al.ASPLOS 2021 · 95 citations
- AQUATOPE: QoS-and-Uncertainty-Aware Resource Management for Multi-stage Serverless WorkflowsZhuangzhuang Zhou, Yanqi Zhang, Christina DelimitrouASPLOS 2023 · 78 citations
- Enable simultaneous DNN services based on deterministic operator overlap and precise latency predictionWeihao Cui, Han Zhao, Quan Chen, Ningxin Zheng et al.SC 2021 · 62 citations
- Harmonizing Efficiency and Practicability: Optimizing Resource Utilization in Serverless Computing with JiaguQingyuan Liu, Yanning Yang, Dong Du, Yubin Xia et al.USENIX ATC 2024 · 39 citations
Related papers
- OLPart: Online Learning based Resource Partitioning for Colocating Multiple Latency-Critical Jobs on Commodity ComputersRuobing Chen, Haosen Shi, Yusen Li, Xiaoguang Liu et al.EuroSys 2023 · 27 citations
- Rhythm: component-distinguishable workload deployment in datacentersLaiping Zhao, Yanan Yang, Kaixuan Zhang, Xiaobo Zhou et al.EuroSys 2020 · 49 citations
- SATORI: Efficient and Fair Resource Partitioning by Sacrificing Short-Term Benefits for Long-Term Gains*Rohan Basu Roy, Tirthak Patel, Devesh TiwariISCA 2021 · 34 citations
- DRLPart: A Deep Reinforcement Learning Framework for Optimally Efficient and Robust Resource Partitioning on Commodity ServersRuobing Chen, Jinping Wu, Haosen Shi, Yusen Li et al.HPDC 2021 · 22 citations
- Criticality-Aware Instruction-Centric Bandwidth Partitioning for Data Center ApplicationsLiren Zhu, Liujia Li, Jianyu Wu, Yiming Yao et al.HPCA 2025 · 4 citations
