Lune

ACL Findings2026

FinMaster: A Holistic Benchmark for Full-Pipeline Financial Management with Large Language Models

Junzhe Jiang, Chang Yang, Aixin Cui, Sihan Jin, Yujing Zhang, Yilin Xiao, Ruiyu Wang, Bo Li, Xiao Huang, Danny Dongning Sun, Xinrun Wang

摘要

Financial management is high-stakes, where small errors can propagate into reporting deviations and costly downstream decisions, yet realworld workflows remain labor-intensive and fragmented, and existing automation supports only isolated steps rather than complete workflows. Large language models (LLMs) show promise in automating financial workflows, but current benchmarks lack domain-specific data, realistic workflow-level task design, and standardized workflow-level evaluation. To address these gaps, we present FinMaster, a benchmark for evaluating large language models on full financial management workflows spanning financial literacy, accounting, auditing, and consulting. FinMaster comprises three modules: FinSim generates synthetic datasets compliant with real-world accounting standards for diverse company types, enabling realistic evaluation without relying on proprietary financial records. FinSuite offers 183 tasks across core financial domains. FinEval provides a unified evaluation framework. Extensive experiments on state-of-the-art models including GPT-4omini, Claude-3.7-Sonnet, and DeepSeek-V3 reveal critical capability gaps in financial reasoning, with accuracy dropping from over 90% on basic tasks to 40% on complex scenarios requiring multi-step reasoning. This degradation reflects error propagation, where accuracy reaches 58% for single-metric calculations but decreases to 37% in multi-metric settings. FinMaster provides scalable and reproducible benchmarking for realistic end-to-end financial workflows, helping advance reliable deployment of LLMs in financial practice.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 相关的 Paper

获取答案

免费开始,无需绑卡

它引用的 Paper2

  1. BizBench: A Quantitative Reasoning Benchmark for Business and FinanceMichael Krumdick, Rik Koncel-Kedziorski, Viet Dac Lai, Varshini Reddy 等ACL 2024 · 10 次引用
  2. Hierarchical Retrieval with Evidence Curation for Open-Domain Financial Question Answering on Standardized DocumentsJaeyoung Choe, Jihoon Kim, Woohwan JungACL Findings 2025 · 6 次引用

相关 Paper

  1. Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial DocumentsYing He, Zhouhong Gu, Zhecheng Hu, Yubo Zhou 等ACL Findings 2026
  2. Is ChatGPT a Financial Expert? Evaluating Language Models on Financial Natural Language ProcessingYue Guo, Zian Xu, Yi YangEMNLP Findings 2023 · 16 次引用
  3. FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and ChallengingZichen Tang, Haihong E, Ziyan Ma, Haoyang He 等ACL 2025 · 17 次引用
  4. FinMathBench: A Formula-Driven Benchmark for Evaluating LLMs' Math Reasoning Capabilities in FinanceYi He, Ping Wang, Shiqiang Xiong, Chao Chen 等AAAI 2026
  5. Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise WorkflowsHaoyu Dong, Pengkun Zhang, Yan Gao, Xuanyu Dong 等ACL Findings 2026 · 1 次引用
黄昏的海面,两侧是细线勾勒的悬崖