Chameleon: Adaptive and Scalable Stream Processing Over Sensor Sources
Dimitrios Giouroukis, Varun Pandey, Steffen Zeuch, Volker Markl
Abstract
Internet of Things (IoT) applications make use of live data from numerous sensors that reside outside cloud datacenters. As a result, it is imperative for IoT data management systems to reduce their network footprint while simultaneously scaling to larger numbers of sensors. One way of achieving this is to adapt data generation to the rate of changes in the real world. In this systems paper, we propose Chameleon, a sensor-driven protocol for network-efficient data management that treats sensors as first-class components of a stream processing system. Chameleon combines local knowledge from the sensors with global knowledge from the cloud to improve data acquisition. Our empirical evaluation shows that systems employing Chameleon outperform baselines for aggregate queries by up to one order of magnitude in terms of network utilization while keeping query re-sults similar with negligible difference (down to 0.8%) from base-lines. Chameleon enables data management systems to handle up to 80% more sensors without needing extra network resources.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 03322b1b-8cc9-42bc-8fea-b44f240526f3Builds on12
- A variegated look at 5G in the wild: performance, power, and QoE implicationsArvind Narayanan, Xumiao Zhang, Ruiyang Zhu, Ahmad Hassan et al.SIGCOMM 2021 · 259 citations
- Scabbard: Single-Node Fault-Tolerant Stream ProcessingGeorgios Theodorakis, Fotios Kounelis, Peter R. Pietzuch, Holger PirkVLDB 2022 · 21 citations
- CompressStreamDB: Fine-Grained Adaptive Stream Processing without DecompressionYu Zhang, Feng Zhang, Hourun Li, Shuhao Zhang et al.ICDE 2023 · 18 citations
- Efficient Placement of Decomposable Aggregation Functions for Stream Processing over Large Geo-Distributed TopologiesXenofon Chatziliadis, Eleni Tzirita Zacharatou, Alphan Eracar, Steffen Zeuch et al.VLDB 2024 · 16 citations
- Declarative Data Serving: The Future of Machine Learning Inference on the EdgeTed Shaowang, Nilesh Jain, Dennis Matthews, Sanjay KrishnanVLDB 2021 · 15 citations
Related papers
- DART: A Scalable and Adaptive Edge Stream Processing EnginePinchao Liu, Dilma Da Silva, Liting HuUSENIX ATC 2021 · 36 citations
- Chameleon: Adaptive Caching and Scheduling for Many-Adapter LLM Inference EnvironmentsNikoleta Iliakopoulou, Jovan Stojkovic, Chloe Alverti, Tianyin Xu et al.MICRO 2025 · 3 citations
- SciStream: Architecture and Toolkit for Data Streaming between Federated Science InstrumentsJoaquin Chung, Wojciech Zacherek, A. J. Wisniewski, Zhengchun Liu et al.HPDC 2022 · 17 citations
- Lessons Learned from the Chameleon TestbedKate Keahey, Jason Anderson, Zhuo Zhen, Pierre Riteau et al.USENIX ATC 2020 · 398 citations
- Fograph: Enabling Real-Time Deep Graph Inference with Fog ComputingLiekang Zeng, Peng Huang, Ke Luo, Xiaoxi Zhang et al.WWW 2022 · 22 citations
