Goal-Driven Sequential Data Abstraction
Umar Riaz Muhammad, Yongxin Yang, Timothy M. Hospedales, Tao Xiang, Yi-Zhe Song
Abstract
Automatic data abstraction is an important capability for both benchmarking machine intelligence and supporting summarization applications. In the former one asks whether a machine can 'understand' enough about the meaning of input data to produce a meaningful but more compact abstraction. In the latter this capability is exploited for saving space or human time by summarizing the essence of input data. In this paper we study a general reinforcement learning based framework for learning to abstract sequential data in a goal-driven way. The ability to define different abstraction goals uniquely allows different aspects of the input data to be preserved according to the ultimate purpose of the abstraction. Our reinforcement learning objective does not require human-defined examples of ideal abstraction. Importantly our model processes the input sequence holistically without being constrained by the original input order. Our framework is also domain agnostic -we demonstrate applications to sketch, video and text data and achieve promising results in all domains. AU AU AU AU AU AU I love that the inside is set up like shelves. My son loves to organize his trains in it. I don't like how thin the metal is. It dents as easy as a cola can. If it were made better, it would be worth the money. Save your money on this.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b6c0bb2f-ab91-4c46-b366-24f5d637f6cbCited by top-tier papers8
- Sketch3T: Test-Time Training for Zero-Shot SBIRAneeshan Sain, Ayan Kumar Bhunia, Vaishnav Potlapalli, Pinaki Nath Chowdhury et al.CVPR 2022 · 55 citations
- Sketching without Worrying: Noise-Tolerant Sketch-Based Image RetrievalAyan Kumar Bhunia, Subhadeep Koley, Abdullah Faiz Ur Rahman Khilji, Aneeshan Sain et al.CVPR 2022 · 53 citations
- ChiroDiff: Modelling chirographic data with Diffusion ModelsAyan Das, Yongxin Yang, Timothy M. Hospedales, Tao Xiang et al.ICLR 2023 · 3 citations
- StyleMeUp: Towards Style-Agnostic Sketch-Based Image RetrievalAneeshan Sain, Ayan Kumar Bhunia, Yongxin Yang, Tao Xiang et al.CVPR 2021
- More Photos Are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image RetrievalAyan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Yongxin Yang et al.CVPR 2021
Related papers
- Do LLMs Build World Representations? Probing Through the Lens of State AbstractionZichao Li, Yanshuai Cao, Jackie CK CheungNeurIPS 2024 · 22 citations
- Keyword-aware Abstractive Summarization by Extracting Set-level Intermediate SummariesYizhu Liu, Qi Jia, Kenny Q. ZhuWWW 2021 · 14 citations
- Learning Planning Abstractions from LanguageWeiyu Liu, Geng Chen, Joy Hsu, Jiayuan Mao et al.ICLR 2024 · 6 citations
- Abstraction Refinement-Guided Program Synthesis for Robot Learning from DemonstrationsGuofeng Cui, Yuning Wang, Wensen Mao, Yuanlin Duan et al.OOPSLA 2025 · 1 citation
- Learning with Language-Guided State AbstractionsAndi Peng, Ilia Sucholutsky, Belinda Z. Li, Theodore R. Sumers et al.ICLR 2024 · 20 citations
