Lune

ACL Findings2025

Improving Occupational ISCO Classification of Multilingual Swiss Job Postings with LLM-Refined Training Data

Ann-Sophie Gnehm, Simon Clematide

Abstract

Classifying occupations in multilingual job postings is challenging due to noisy labels, language variation, and domain-specific terminology. We present a method that refines silverstandard ISCO labels by consolidating them with predictions from pre-fine-tuned models, using large language model (LLM) evaluations to resolve discrepancies. The refined labels are used in Multiple Negatives Ranking (MNR) training for SentenceBERT-based classification. This approach substantially improves performance, raising Top-1 accuracy on silver data from 37.2% to 58.3% and reaching up to 80% precision on held-out data-an over 30-point gain validated by both GPT and human raters. The model benefits from cross-lingual transfer, with particularly strong gains in French and Italian. These results demonstrate hat LLMguided label refinement can substantially improve multilingual occupation classification in fine-grained taxonomies such as CH-ISCO with 670 classes.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation cites Unsupervised Cross-lingual Representation Learning at Scale
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on4

  1. Unsupervised Cross-lingual Representation Learning at ScaleAlexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary et al.ACL 2020 · 539 citations
  2. A Survey on In-context LearningQingxiu Dong, Lei Li, Damai Dai, Ce Zheng et al.EMNLP 2024 · 479 citations
  3. Don't Stop Pretraining: Adapt Language Models to Domains and TasksSuchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo et al.ACL 2020 · 93 citations
  4. Making Monolingual Sentence Embeddings Multilingual using Knowledge DistillationNils Reimers, Iryna GurevychEMNLP 2020 · 54 citations

Related papers

  1. ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market DomainMike Zhang, Rob van der Goot, Barbara PlankACL 2023 · 14 citations
  2. Multilingual Detection of Personal Employment Status on TwitterManuel Tonneau, Dhaval Adjodah, João Palotti, Nir Grinberg et al.ACL 2022 · 16 citations
  3. Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual TransformersFélix Gaschi, Patricio Cerda, Parisa Rastin, Yannick ToussaintACL Findings 2023 · 2 citations
  4. Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, Naveen Arivazhagan et al.ACL 2022
  5. HMCL: Task-Optimal Text Representation Adaptation through Hierarchical Contrastive LearningZhenyi Wang, Yapeng Jia, Haiyan Ning, Peng Wang et al.EMNLP Findings 2025
Dusk over the sea between two cliffs drawn in fine vertical lines