Multimodal Multi-Speaker Merger & Acquisition Financial Modeling: A New Task, Dataset, and Neural Baselines
Ramit Sawhney, Mihir Goyal, Prakhar Goel, Puneet Mathur, Rajiv Ratn Shah
Abstract
Risk prediction is an essential task in financial markets. Merger and Acquisition (M&A) calls provide key insights into the claims made by company executives about the restructuring of the financial firms. Extracting vocal and textual cues from M&A calls can help model the risk associated with such financial activities. To aid the analysis of M&A calls, we curate a dataset of conference call transcripts and their corresponding audio recordings for the time period ranging from 2016 to 2020. We introduce M3ANet, a baseline architecture that takes advantage of the multimodal multispeaker input to forecast the financial risk associated with the M&A calls. Empirical results prove that the task is challenging, with the proposed architecture performing marginally better than strong BERT-based baselines. We release the M3A dataset and benchmark models to motivate future research on this challenging problem domain.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 96423551-696b-408b-8d30-e4d6dbbc9182Cited by top-tier papers2
- Measuring Consistency in Text-based Financial Forecasting ModelsLinyi Yang, Yingpeng Ma, Yue ZhangACL 2023 · 1 citation
- Incorporating Stock Market Signals for Twitter Stance DetectionCostanza Conforti, Jakob Berndt, Mohammad Taher Pilehvar, Chryssi Giannitsarou et al.ACL 2022
Builds on4
- HTML: Hierarchical Transformer-based Multi-task Learning for Volatility PredictionLinyi Yang, Tin Lok James Ng, Barry Smyth, Ruihai DongWWW 2020 · 127 citations
- Deep Attentive Learning for Stock Movement Prediction From Social Media Text and Company CorrelationsRamit Sawhney, Shivam Agarwal, Arnav Wadhwa, Rajiv Ratn ShahEMNLP 2020 · 124 citations
- Multimodal Multi-Task Financial Risk ForecastingRamit Sawhney, Puneet Mathur, Ayush Mangal, Piyush Khanna et al.ACM MM 2020 · 61 citations
- VolTAGE: Volatility Forecasting via Text Audio Fusion with Graph Convolution Networks for Earnings CallsRamit Sawhney, Piyush Khanna, Arshiya Aggarwal, Taru Jain et al.EMNLP 2020 · 33 citations
Related papers
- MONOPOLY: Financial Prediction from MONetary POLicY Conference Videos Using Multimodal CuesPuneet Mathur, Atula Tejaswi Neerkaje, Malika Chhibber, Ramit Sawhney et al.ACM MM 2022 · 9 citations
- FinCall-Surprise: A Large Scale Multi-modal Benchmark for Earning Surprise PredictionDong Shu, Yanguang Liu, Huopu Zhang, Mengnan DuACL 2026 · 1 citation
- NumHTML: Numeric-Oriented Hierarchical Transformer Model for Multi-Task Financial ForecastingLinyi Yang, Jiazheng Li, Ruihai Dong, Yue Zhang et al.AAAI 2022 · 54 citations
- Global Merger-Arbitrage Forecasting with Language ModelsHinal Jajal, Michał Mucha, Charles Sweat, Chris Pulman et al.ICML 2026
- MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial ApplicationXueqing Peng, Lingfei Qian, Yan Wang, Ruoyu Xiang et al.ACL 2026 · 6 citations
