Optimal Caching for Dynamic Content Through Strategic Information Sharing
Guocong Quan, Xiaojun Lin, Xing Wang
摘要
We study how to update cache content to efficiently serve demands for dynamic data items that are frequently refreshed at backend servers. A significant challenge for optimizing this new type of cache systems with dynamic content is the following "information barrier". Because the precise data refresh events happening at the backend are not known to the cache, it is difficult for the cache to decide how to update cache content effectively. To overcome this information barrier, we introduce a new model that allows caches to observe data-item freshness at backend servers occasionally by paying an observation cost. A caching optimization problem is then formulated, aiming at strategically utilizing the observation option to balance the trade-off between providing fresh content and reducing data traffic to the backend. Although this optimization problem can be cast as a multi-action Restless Multi-Armed Bandit (RMAB) problem, it unfortunately does not satisfy the standard notion of multi-action indexability, preventing the use of standard Whittle index policies. We address this difficulty by introducing two new concepts of super-action indexability and sub-action indexability. These new notions of indexability significantly generalize the classical notion of multi-action indexability, and they enable us to develop low-complexity and asymptotically-optimal index-like policies for this otherwise intractable problem. Extensive numerical simulations verify that the proposed new policies benefit from more informed decision-making through strategic observation and significantly outperform existing benchmarks that do not exploit observation opportunities.
问问这篇 Paper
问问你的智能体。
Lune 读过与它相关的顶会 Paper,每个回答都会注明依据哪几篇。
相关 Paper
- Reinforcement Learning for Dynamic Dimensioning of Cloud Caches: A Restless Bandit ApproachGuojun Xiong, Shufan Wang, Gang Yan, Jian LiINFOCOM 2022 · 被引用 9 次
- An Easier-to-Verify Sufficient Condition for Whittle Indexability and Application to AoI MinimizationSixiang Zhou, Xiaojun LinINFOCOM 2024 · 被引用 4 次
- Optimistic Whittle Index Policy: Online Learning for Restless BanditsKai Wang, Lily Xu, Aparna Taneja, Milind TambeAAAI 2023 · 被引用 31 次
- Reinforcement Learning Augmented Asymptotically Optimal Index Policy for Finite-Horizon Restless BanditsGuojun Xiong, Jian Li, Rahul SinghAAAI 2022 · 被引用 23 次
- Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child HealthKai Wang, Shresth Verma, Aditya Mate, Sanket Shah 等AAAI 2023 · 被引用 19 次
