MixedSAND: Semantic Annotation of Mixed-unit Numeric Data
Amir Behrad Khorram Nazari, Davood Rafiei, Mario A. Nascimento
摘要
Quantitative information about entities constitutes a significant portion of tabular data in open sources and data lakes. Such tables often lack consistent labeling and proper schema, posing significant challenges for querying and integration. This paper studies the problem of numerical column annotation in scenarios where quantitative data may be gathered from different sources and unit consistency is a concern. For instance, weight measurements may vary between entities, expressed in kilograms for some and pounds for others, with no accompanying unit information. We investigate the conditions for effectively annotating mixed-unit numeric data, introduce a benchmark for such an annotation task, and propose an algorithm that reliably detects semantic types (e.g., height) and links them to the corresponding types present in a knowledge graph. Our evaluation on a diverse set of columns with mixed units and varying levels of annotation difficulty shows that our method significantly outperforms strong baselines such as GPT-4o-mini and SAND in terms of accuracy, excelling in both detecting mixed units and annotating them with appropriate semantic labels. (All our code and data will be publicly released upon acceptance of the paper.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionMohammadreza Pourreza, Davood RafieiNeurIPS 2023 · 被引用 909 次
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang 等ICLR 2020 · 被引用 674 次
- SANTOS: Relationship-based Semantic Table Union SearchAamod Khatiwada, Grace Fan, Roee Shraga, Zixuan Chen 等SIGMOD 2023 · 被引用 61 次
- Sato: Contextual Semantic Type Detection in TablesDan Zhang, Yoshihiko Suhara, Jinfeng Li, Madelon Hulsebos 等VLDB 2020
相关 Paper
- KGLink: A Column Type Annotation Method that Combines Knowledge Graph and Pre-Trained Language ModelYubo Wang, Hao Xin, Lei ChenICDE 2024 · 被引用 7 次
- Linking Surface Facts to Large-Scale Knowledge GraphsGorjan Radevski, Kiril Gashteovski, Chia-Chien Hung, Carolin Lawrence 等EMNLP 2023 · 被引用 2 次
- RECA: Related Tables Enhanced Column Semantic Type Annotation FrameworkYushi Sun, Hao Xin, Lei ChenVLDB 2023 · 被引用 26 次
- An End-To-End Re-Evaluation of Table Entity-LinkersMartin Pekár Christensen, Matteo Lissandrini, Katja HoseICDE 2026
- Extracting Contextualized Quantity Facts from Web TablesVinh Thinh Ho, Koninika Pal, Simon Razniewski, Klaus Berberich 等WWW 2021 · 被引用 13 次
