Lune

ACL Findings2025

Improving Occupational ISCO Classification of Multilingual Swiss Job Postings with LLM-Refined Training Data

Ann-Sophie Gnehm, Simon Clematide

摘要

Classifying occupations in multilingual job postings is challenging due to noisy labels, language variation, and domain-specific terminology. We present a method that refines silverstandard ISCO labels by consolidating them with predictions from pre-fine-tuned models, using large language model (LLM) evaluations to resolve discrepancies. The refined labels are used in Multiple Negatives Ranking (MNR) training for SentenceBERT-based classification. This approach substantially improves performance, raising Top-1 accuracy on silver data from 37.2% to 58.3% and reaching up to 80% precision on held-out data-an over 30-point gain validated by both GPT and human raters. The model benefits from cross-lingual transfer, with particularly strong gains in French and Italian. These results demonstrate hat LLMguided label refinement can substantially improve multilingual occupation classification in fine-grained taxonomies such as CH-ISCO with 670 classes.

问 Lune

几分钟读透这篇 Paper,不用再花一下午。

Lune 能读完全文,也能读引用它的顶会 Paper,讲清它的结论、证据和局限,每一点都注明出自哪篇 Paper。不用硬啃,也不靠猜。

可以从这些问题问起

Lune 可以查阅

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

脉络

  • Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation 引用了 Unsupervised Cross-lingual Representation Learning at Scale
它引用的引用它的从左到右按年份排列,引用越多,位置越高。

它引用的 Paper4

  1. Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary 等ACL 2020 · 539 次引用
  2. A Survey on In-context LearningQingxiu Dong, Lei Li, Damai Dai, Ce Zheng 等EMNLP 2024 · 479 次引用
  3. Don't Stop Pretraining: Adapt Language Models to Domains and TasksSuchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo 等ACL 2020 · 93 次引用
  4. Making Monolingual Sentence Embeddings Multilingual using Knowledge DistillationNils Reimers, Iryna GurevychEMNLP 2020 · 54 次引用

相关 Paper

  1. ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market DomainMike Zhang, Rob van der Goot, Barbara PlankACL 2023 · 14 次引用
  2. Multilingual Detection of Personal Employment Status on TwitterManuel Tonneau, Dhaval Adjodah, João Palotti, Nir Grinberg 等ACL 2022 · 16 次引用
  3. Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual TransformersFélix Gaschi, Patricio Cerda, Parisa Rastin, Yannick ToussaintACL Findings 2023 · 2 次引用
  4. Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan 等ACL 2022
  5. HMCL: Task-Optimal Text Representation Adaptation through Hierarchical Contrastive LearningZhenyi Wang, Yapeng Jia, Haiyan Ning, Peng Wang 等EMNLP Findings 2025
黄昏的海面,两侧是细线勾勒的悬崖