Designing Ground Truth and the Social Life of Labels

Michael J. Muller; Christine T. Wolf; Josh Andres; Michael Desmond; Narendra Nath Joshi; Zahra Ashktorab; Aabhas Sharma; Kristina Brimijoin; Qian Pan; Evelyn Duesterwald; Casey Dugan

doi:10.1145/3411764.3445402

CHI2021顶会

Designing Ground Truth and the Social Life of Labels

Michael J. Muller, Christine T. Wolf, Josh Andres, Michael Desmond, Narendra Nath Joshi, Zahra Ashktorab, Aabhas Sharma, Kristina Brimijoin, Qian Pan, Evelyn Duesterwald, Casey Dugan

DOI 出版方

2021年份

80被引次数

23顶会引用

摘要

Ground-truth labeling is an important activity in machine learning. Many studies have examined how crowdworkers apply labels to records in machine learning datasets. However, there have been few studies that have examined the work of domain experts when their knowledge and expertise are needed to apply labels.

问问这篇 Paper

问问你的智能体。

Lune 读过与它相关的顶会 Paper，每个回答都会注明依据哪几篇。

核心论断
谁在沿用
横向对比
局限

你的问题

智能体调用

Lunesearch_papers

在 Lune 里问

免费开始，无需绑卡

引用它的顶会 Paper23

Jury Learning: Integrating Dissenting Voices into Machine Learning ModelsMitchell L. Gordon, Michelle S. Lam, Joon Sung Park, Kayur Patel 等CHI 2022 · 被引用 134 次
The Data-Production DispositifMilagros Miceli, Julian PosadaCSCW 2022 · 被引用 117 次
The Disagreement Deconvolution: Bringing Machine Learning Performance Metrics In Line With RealityMitchell L. Gordon, Kaitlyn Zhou, Kayur Patel, Tatsunori Hashimoto 等CHI 2021 · 被引用 100 次
Whose AI Dream? In search of the aspiration in data annotationDing Wang, Shantanu Prabhat, Nithya SambasivanCHI 2022 · 被引用 66 次
Towards Transparency in Dermatology Image Datasets with Skin Tone Annotations by Experts, Crowds, and an AlgorithmMatthew Groh, Caleb Harris, Roxana Daneshjou, Omar Badri 等CSCW 2022 · 被引用 62 次

问问它们各自怎么用它

摘要

问问这篇 Paper

问问你的智能体。

引用它的顶会 Paper23

相关 Paper