C: Leaf-Centric Continuous Codes for Natural Language-Driven Table Discovery
Qiyuan Zhang, Ruochun Jin, Jixin Zhang, Yuhua Tang, Xiangyu Zhao, Shixuan Liu
Abstract
Natural language (NL)-driven table discovery aims to retrieve relevant tables from massive repositories using intuitive user queries. While recent approaches leverage dense vector retrieval or discrete identifier generation, they either suffer from limited semantic expressiveness or rigid hierarchical constraints that hinder fine-grained discrimination among structurally similar tables. In this work, we propose (Leaf-Centric Continuous Code), a novel differentiable indexing framework that represents each table as a continuous vector anchored to its semantic cluster center with a learnable local offset. Unlike prior methods that rely on fixed embeddings or autoregressive discrete IDs, decouples global semantic organization from local table uniqueness: a hierarchical clustering tree over multiview table representations defines leaf-level semantic neighborhoods, while each table learns a residual offset that captures its distinctive content within that neighborhood. During training, an encoder-decoder model learns to map NL queries directly to these continuous codes, enabling end-to-end optimization of both indexing structure and query-table alignment. At inference time, the model generates a continuous code that is efficiently matched against precomputed table codes via approximate nearest neighbor search-combining the flexibility of dense retrieval with the semantic coherence of hierarchical indexing. To support dynamic table ingestion, we further introduce a memory-efficient continual learning strategy that freezes base representations and only adapts local offsets for new tables, effectively mitigating catastrophic forgetting. Extensive experiments on three benchmarks show that outperforms state-of-the-art methods by up to 6.5 points in P@1, while maintaining scalable inference and robustness under continual updates.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get b5ada55d-81b7-4484-bbe4-b6ce323fb07bRelated papers
- BIRDIE: Natural Language-Driven Table Discovery Using Differentiable Search IndexYuxiang Guo, Zhonghao Hu, Yuren Mao, Baihua Zheng et al.VLDB 2025 · 6 citations
- Table Search Using a Deep Contextualized Language ModelZhiyu Chen, Mohamed Trabelsi, Jeff Heflin, Yinan Xu et al.SIGIR 2020 · 48 citations
- DeepJoin: Joinable Table Discovery with Pre-trained Language ModelsYuyang Dong, Chuan Xiao, Takuma Nozawa, Masafumi Enomoto et al.VLDB 2023 · 53 citations
- Language Models as Semantic IndexersBowen Jin, Hansi Zeng, Guoyin Wang, Xiusi Chen et al.ICML 2024 · 31 citations
- Revisiting Single-Table Retrieval: An Open Problem Under 360° Stress TestsChenyu Yang, Ziyu Jiang, Junhao Li, Yuyu Luo et al.ICDE 2026
