MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale

Figure 1: Scaling effects of MAmmoTH-VL-8B on four multimodal evaluation datasets. A simple rewriting approach using open models improves the quality of visual instruction data by eliciting chain-of-thought (CoT) reasoning. Training on this rewritten data demonstrates significant performance gains through increased model scale. Llava-OneVision-7B&72B (Li et al., 2024b) and Llava-CoT (Xu et al., 2024a) are included as references.