ACL Findings2025
Improving Occupational ISCO Classification of Multilingual Swiss Job Postings with LLM-Refined Training Data
摘要
Classifying occupations in multilingual job postings is challenging due to noisy labels, language variation, and domain-specific terminology. We present a method that refines silverstandard ISCO labels by consolidating them with predictions from pre-fine-tuned models, using large language model (LLM) evaluations to resolve discrepancies. The refined labels are used in Multiple Negatives Ranking (MNR) training for SentenceBERT-based classification. This approach substantially improves performance, raising Top-1 accuracy on silver data from 37.2% to 58.3% and reaching up to 80% precision on held-out data-an over 30-point gain validated by both GPT and human raters. The model benefits from cross-lingual transfer, with particularly strong gains in French and Italian. These results demonstrate hat LLMguided label refinement can substantially improve multilingual occupation classification in fine-grained taxonomies such as CH-ISCO with 670 classes.
问 Lune
几分钟读透这篇 Paper,不用再花一下午。
Lune 能读完全文,也能读引用它的顶会 Paper,讲清它的结论、证据和局限,每一点都注明出自哪篇 Paper。不用硬啃,也不靠猜。
脉络
它引用的 Paper4
- Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary 等ACL 2020 · 539 次引用
- A Survey on In-context LearningQingxiu Dong, Lei Li, Damai Dai, Ce Zheng 等EMNLP 2024 · 479 次引用
- Don't Stop Pretraining: Adapt Language Models to Domains and TasksSuchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo 等ACL 2020 · 93 次引用
- Making Monolingual Sentence Embeddings Multilingual using Knowledge DistillationNils Reimers, Iryna GurevychEMNLP 2020 · 54 次引用
相关 Paper
- ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market DomainMike Zhang, Rob van der Goot, Barbara PlankACL 2023 · 14 次引用
- Multilingual Detection of Personal Employment Status on TwitterManuel Tonneau, Dhaval Adjodah, João Palotti, Nir Grinberg 等ACL 2022 · 16 次引用
- Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual TransformersFélix Gaschi, Patricio Cerda, Parisa Rastin, Yannick ToussaintACL Findings 2023 · 2 次引用
- Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan 等ACL 2022
- HMCL: Task-Optimal Text Representation Adaptation through Hierarchical Contrastive LearningZhenyi Wang, Yapeng Jia, Haiyan Ning, Peng Wang 等EMNLP Findings 2025
