Laser: Unlocking Layer-Level Scheduling for Efficient Multi-SLO LLM Serving

Jianxiong Liao; Quanxing Dong; Yunkai Liang; Zhi Zhou; Xu Chen

doi:10.1145/3774934.3786413

PPoPP2026顶会

Laser: Unlocking Layer-Level Scheduling for Efficient Multi-SLO LLM Serving

Jianxiong Liao, Quanxing Dong, Yunkai Liang, Zhi Zhou, Xu Chen

DOI 出版方

2026年份

1被引次数

摘要

Engaging applications with diverse SLO requirements has become indispensable for production-scale LLM serving systems. However, existing systems rely on iteration-level scheduling, which enforces inflexible, unified execution across multi-SLO workloads, significantly constraining the serving efficiency.

问问这篇 Paper

问问你的智能体。

Lune 读过与它相关的顶会 Paper，每个回答都会注明依据哪几篇。

核心论断
横向对比
局限

你的问题

智能体调用

Lunesearch_papers

在 Lune 里问

免费开始，无需绑卡

摘要

问问这篇 Paper

问问你的智能体。

相关 Paper