Single-Pass, Depth-Selective Reading for Multi-Aspect Sentiment Analysis
Yan Xia, Zhuangzhuang Pan, Amirrudin Kamsin, Chee Seng Chan
Abstract
Aspect-Term Sentiment Analysis (ATSA) in multi-aspect sentences faces a fundamental tradeoff between efficiency and expressiveness. Existing models either re-encode the sentence for each aspect or rely on static use of deep representations, leading to redundant computation and limited adaptivity. We argue that Transformer depth is a costly, queryable resource, and propose DABS, a single-pass inference framework that encodes each sentence once to construct a reusable, depth-ordered substrate. Each aspect then queries this shared representation to selectively read relevant tokens and abstraction levels, without re-encoding. This decouples shared sentence encoding from lightweight, aspect-conditioned readout. Experiments on four ATSA benchmarks show that DABS achieves competitive performance while reducing end-to-end computation by up to 60% in multi-aspect settings (M ≥ 2). Further analyses indicate that adaptive depth querying is most beneficial for linguistically complex cases such as negation and contrast. Code is publicly available at https://github.com/panzhzh/ acl-dabs .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 70e97c4e-9f3c-481a-8a3f-2c206603b85cBuilds on9
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu ChenICLR 2023 · 394 citations
- MvP: Multi-view Prompting Improves Aspect Sentiment Tuple PredictionZhibin Gou, Qingyan Guo, Yujiu YangACL 2023 · 48 citations
- TextGT: A Double-View Graph Transformer on Text for Aspect-Based Sentiment AnalysisShuo Yin, Guoqiang ZhongAAAI 2024 · 46 citations
- AMR-based Network for Aspect-based Sentiment AnalysisFukun Ma, Xuming Hu, Aiwei Liu, Yawen Yang et al.ACL 2023 · 23 citations
- LayerSkip: Enabling Early Exit Inference and Self-Speculative DecodingMostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer et al.ACL 2024 · 22 citations
Related papers
- You Only Read Once: Constituency-Oriented Relational Graph Convolutional Network for Multi-Aspect Multi-Sentiment ClassificationYongqiang Zheng, Xia LiAAAI 2024 · 8 citations
- Span-Pair Interaction and Tagging for Dialogue-Level Aspect-Based Sentiment Quadruple AnalysisChangzhi Zhou, Zhijing Wu, Dandan Song, Linmei Hu et al.WWW 2024 · 8 citations
- Inter-sentence Context Modeling and Structure-aware Representation Enhancement for Conversational Sentiment Quadruple ExtractionYu Zhang, Zhaoman Zhong, Huihui LvEMNLP 2025 · 2 citations
- Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis ModelHongjiang Jing, Zuchao Li, Hai Zhao, Shu JiangEMNLP 2021 · 20 citations
- MSMO-ABSA: Multi-Scale and Multi-Objective Optimization for Cross-Lingual Aspect-Based Sentiment AnalysisChengyan Wu, Bolei Ma, Ningyuan Deng, Yanqing He et al.ACL 2026
