Lune

EMNLP2024Top-tier venue

PALM: Few-Shot Prompt Learning for Audio Language Models

Asif Hanif, Maha Tufail Agro, Mohammad Areeb Qazi, Hanan Aldarmaki

Abstract

Audio-Language Models (ALMs) have recently achieved success in zero-shot audio recognition tasks, which match features of audio waveforms with class-specific text prompt features, inspired by advancements in Vision-Language Models (VLMs). Given the sensitivity of zeroshot performance to the choice of hand-crafted text prompts, many prompt learning techniques have been developed for VLMs. We explore the efficacy of these approaches in ALMs and propose a novel method, Prompt Learning in Audio Language Models (PALM), which optimizes the feature space of the ALM text encoder. Unlike existing methods that work in the input space, our approach results in greater training efficiency. We demonstrate the effectiveness of our approach on 11 audio recognition datasets, encompassing a variety of speech-processing tasks, and compare the results with three baselines in a few-shot learning setup. Our results show that PALM performs on a par with or outperforms the baselines while being more computationally efficient. Our code is publicly available at Github † .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Pengi: An Audio Language Model for Audio Tasks cites Learning Transferable Visual Models From Natural Language Supervision
  • Pengi: An Audio Language Model for Audio Tasks cites Flamingo: a Visual Language Model for Few-Shot Learning
  • TAPE: Task-Adaptive Prototype Evolution in Audio-Language Models for Fully Few-shot Class-incremental Audio Classification cites Pengi: An Audio Language Model for Audio Tasks
  • TrojanWave: Exploiting Prompt Learning for Stealthy Backdoor Attacks on Large Audio-Language Models cites Pengi: An Audio Language Model for Audio Tasks
  • Flamingo: a Visual Language Model for Few-Shot Learning cites Learning Transferable Visual Models From Natural Language Supervision
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. TAPE: Task-Adaptive Prototype Evolution in Audio-Language Models for Fully Few-shot Class-incremental Audio ClassificationYunlong Gao, Wenxin Liang, Guanglu Wang, Senqi Guan et al.CVPR 2026
  2. TrojanWave: Exploiting Prompt Learning for Stealthy Backdoor Attacks on Large Audio-Language ModelsAsif Hanif, Maha Tufail Agro, Fahad Shamshad, Karthik NandakumarEMNLP 2025

Builds on3

  1. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
  2. Flamingo: a Visual Language Model for Few-Shot LearningJean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech et al.NeurIPS 2022 · 6,707 citations
  3. Pengi: An Audio Language Model for Audio TasksSoham Deshmukh, Benjamin Elizalde, Rita Singh, Huaming WangNeurIPS 2023 · 352 citations

Related papers

  1. EZ-HOI: VLM Adaptation via Guided Prompt Learning for Zero-Shot HOI DetectionQinqian Lei, Bo Wang, Robby T. TanNeurIPS 2024 · 42 citations
  2. UPRE: Zero-Shot Domain Adaptation for Object Detection via Unified Prompt and Representation EnhancementXiao Zhang, Fei Wei, Yong Wang, Wenda Zhao et al.ICCV 2025 · 1 citation
  3. Parameter-free Automatically Prompting: A Latent Pseudo Label Mapping Model for Prompt-based LearningJirui Qi, Richong Zhang, Junfan Chen, Jaein Kim et al.EMNLP Findings 2022
  4. Surrogate Prompt Learning: Towards Efficient and Diverse Prompt Learning for Vision-Language ModelsLiangchen Liu, Nannan Wang, Xi Yang, Xinbo Gao et al.ICML 2025
  5. Prompt Distribution LearningYuning Lu, Jianzhuang Liu, Yonggang Zhang, Yajing Liu et al.CVPR 2022 · 212 citations
Dusk over the sea between two cliffs drawn in fine vertical lines