Optimal Caching for Dynamic Content Through Strategic Information Sharing
Guocong Quan, Xiaojun Lin, Xing Wang
Abstract
We study how to update cache content to efficiently serve demands for dynamic data items that are frequently refreshed at backend servers. A significant challenge for optimizing this new type of cache systems with dynamic content is the following "information barrier". Because the precise data refresh events happening at the backend are not known to the cache, it is difficult for the cache to decide how to update cache content effectively. To overcome this information barrier, we introduce a new model that allows caches to observe data-item freshness at backend servers occasionally by paying an observation cost. A caching optimization problem is then formulated, aiming at strategically utilizing the observation option to balance the trade-off between providing fresh content and reducing data traffic to the backend. Although this optimization problem can be cast as a multi-action Restless Multi-Armed Bandit (RMAB) problem, it unfortunately does not satisfy the standard notion of multi-action indexability, preventing the use of standard Whittle index policies. We address this difficulty by introducing two new concepts of super-action indexability and sub-action indexability. These new notions of indexability significantly generalize the classical notion of multi-action indexability, and they enable us to develop low-complexity and asymptotically-optimal index-like policies for this otherwise intractable problem. Extensive numerical simulations verify that the proposed new policies benefit from more informed decision-making through strategic observation and significantly outperform existing benchmarks that do not exploit observation opportunities.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get fdfb5333-aeec-4cf5-a152-3bf30928e17bRelated papers
- Reinforcement Learning for Dynamic Dimensioning of Cloud Caches: A Restless Bandit ApproachGuojun Xiong, Shufan Wang, Gang Yan, Jian LiINFOCOM 2022 · 9 citations
- An Easier-to-Verify Sufficient Condition for Whittle Indexability and Application to AoI MinimizationSixiang Zhou, Xiaojun LinINFOCOM 2024 · 4 citations
- Optimistic Whittle Index Policy: Online Learning for Restless BanditsKai Wang, Lily Xu, Aparna Taneja, Milind TambeAAAI 2023 · 31 citations
- Reinforcement Learning Augmented Asymptotically Optimal Index Policy for Finite-Horizon Restless BanditsGuojun Xiong, Jian Li, Rahul SinghAAAI 2022 · 23 citations
- Scalable Decision-Focused Learning in Restless Multi-Armed Bandits with Application to Maternal and Child HealthKai Wang, Shresth Verma, Aditya Mate, Sanket Shah et al.AAAI 2023 · 19 citations
