Locality Sensitive Teaching
Zhaozhuo Xu, Beidi Chen, Chaojian Li, Weiyang Liu, Le Song, Yingyan Lin, Anshumali Shrivastava
摘要
The emergence of the Internet-of-Things (IoT) sheds light on applying the machine teaching (MT) algorithms for online personalized education on home devices. This direction becomes more promising during the COVID-19 pandemic when in-person education becomes infeasible. However, as one of the most influential and practical MT paradigms, iterative machine teaching (IMT) is prohibited on IoT devices due to its inefficient and unscalable algorithms. IMT is a paradigm where a teacher feeds examples iteratively and intelligently based on the learner's status. In each iteration, current IMT algorithms greedily traverse the whole training set to find an example for the learner, which is computationally expensive in practice. We propose a novel teaching framework, Locality Sensitive Teaching (LST), based on locality sensitive sampling, to overcome these challenges. LST has provable near-constant time complexity, which is exponentially better than the existing baseline. With at most 425.12× speedups and 99.76% energy savings over IMT, LST is the first algorithm that enables energy and time efficient machine teaching on IoT devices. Owing to LST's substantial efficiency and scalability, it is readily applicable in real-world education scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper8
- Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structuresZhaozhuo Xu, Zhao Song, Anshumali ShrivastavaNeurIPS 2021 · 被引用 32 次
- Iterative Teaching by Label SynthesisWeiyang Liu, Zhen Liu, Hanchen Wang, Liam Paull 等NeurIPS 2021 · 被引用 18 次
- Nonparametric Iterative Machine TeachingChen Zhang, Xiaofeng Cao, Weiyang Liu, Ivor W. Tsang 等ICML 2023 · 被引用 13 次
- Nonparametric Teaching for Multiple LearnersChen Zhang, Xiaofeng Cao, Weiyang Liu, Ivor W. Tsang 等NeurIPS 2023 · 被引用 8 次
- SignRFF: Sign Random Fourier FeaturesXiaoyun Li, Ping LiNeurIPS 2022 · 被引用 6 次
它引用的顶会 Paper7
- Learning Space Partitions for Nearest Neighbor SearchYihe Dong, Piotr Indyk, Ilya P. Razenshteyn, Tal WagnerICLR 2020 · 被引用 104 次
- Sub-linear RACE Sketches for Approximate Kernel Density Estimation on Streaming DataBenjamin Coleman, Anshumali ShrivastavaWWW 2020 · 被引用 39 次
- Rejection Sampling for Weighted Jaccard Similarity RevisitedXiaoyun Li, Ping LiAAAI 2021 · 被引用 27 次
- Iterative Teaching by Label SynthesisWeiyang Liu, Zhen Liu, Hanchen Wang, Liam Paull 等NeurIPS 2021 · 被引用 18 次
- Generic Outlier Detection in Multi-Armed BanditYikun Ban, Jingrui HeKDD 2020 · 被引用 17 次
相关 Paper
- Revisiting HyperDimensional Learning for FPGA and Low-Power ArchitecturesMohsen Imani, Zhuowen Zou, Samuel Bosch, Sanjay Anantha Rao 等HPCA 2021 · 被引用 90 次
- Scalable edge-based hyperdimensional learning system with brain-like neural adaptationZhuowen Zou, Yeseong Kim, Farhad Imani, Haleh Alimohamadi 等SC 2021 · 被引用 70 次
- SMORE: Similarity-Based Hyperdimensional Domain Adaptation for Multi-Sensor Time Series ClassificationJunyao Wang, Mohammad Abdullah Al FaruqueDAC 2024 · 被引用 2 次
- Context-Aware Compilation of DNN Training Pipelines across Edge and CloudDixi Yao, Liyao Xiang, Zifan Wang, Jiayu Xu 等UbiComp 2022 · 被引用 25 次
- Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning BetterSameer Bibikar, Haris Vikalo, Zhangyang Wang, Xiaohan ChenAAAI 2022 · 被引用 133 次
