MixedSAND: Semantic Annotation of Mixed-unit Numeric Data
Amir Behrad Khorram Nazari, Davood Rafiei, Mario A. Nascimento
Abstract
Quantitative information about entities constitutes a significant portion of tabular data in open sources and data lakes. Such tables often lack consistent labeling and proper schema, posing significant challenges for querying and integration. This paper studies the problem of numerical column annotation in scenarios where quantitative data may be gathered from different sources and unit consistency is a concern. For instance, weight measurements may vary between entities, expressed in kilograms for some and pounds for others, with no accompanying unit information. We investigate the conditions for effectively annotating mixed-unit numeric data, introduce a benchmark for such an annotation task, and propose an algorithm that reliably detects semantic types (e.g., height) and links them to the corresponding types present in a knowledge graph. Our evaluation on a diverse set of columns with mixed units and varying levels of annotation difficulty shows that our method significantly outperforms strong baselines such as GPT-4o-mini and SAND in terms of accuracy, excelling in both detecting mixed units and annotating them with appropriate semantic labels. (All our code and data will be publicly released upon acceptance of the paper.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8df8dc57-31fd-422f-b365-dcb1a014772eBuilds on4
- DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionMohammadreza Pourreza, Davood RafieiNeurIPS 2023 · 909 citations
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang et al.ICLR 2020 · 674 citations
- SANTOS: Relationship-based Semantic Table Union SearchAamod Khatiwada, Grace Fan, Roee Shraga, Zixuan Chen et al.SIGMOD 2023 · 61 citations
- Sato: Contextual Semantic Type Detection in TablesDan Zhang, Yoshihiko Suhara, Jinfeng Li, Madelon Hulsebos et al.VLDB 2020
Related papers
- KGLink: A Column Type Annotation Method that Combines Knowledge Graph and Pre-Trained Language ModelYubo Wang, Hao Xin, Lei ChenICDE 2024 · 7 citations
- Linking Surface Facts to Large-Scale Knowledge GraphsGorjan Radevski, Kiril Gashteovski, Chia-Chien Hung, Carolin Lawrence et al.EMNLP 2023 · 2 citations
- RECA: Related Tables Enhanced Column Semantic Type Annotation FrameworkYushi Sun, Hao Xin, Lei ChenVLDB 2023 · 26 citations
- An End-To-End Re-Evaluation of Table Entity-LinkersMartin Pekár Christensen, Matteo Lissandrini, Katja HoseICDE 2026
- Extracting Contextualized Quantity Facts from Web TablesVinh Thinh Ho, Koninika Pal, Simon Razniewski, Klaus Berberich et al.WWW 2021 · 13 citations
