Image and video benchmarks: these tests check how well a model understands visual content. Results stay very close to the original on CharXiv reasoning, which tests reasoning over scientific charts (72.90 vs 73.70), MathVision, visual mathematical reasoning (69.34 vs 70.20), OCRBench v2, text recognition in images (66.28 vs 67.30), MMLongBench-Doc, understanding of long documents (58.51 vs 60.00), MMMU-Pro, multidisciplinary image-based reasoning (66.88 vs 70.35) and Video-MME, video understanding (72.44 vs 74.80).
Image and video benchmarks: these tests check how well a model understands visual content. Results stay very close to the original on CharXiv reasoning, which tests reasoning over scientific charts (72.90 vs 73.70), MathVision, visual mathematical reasoning (69.34 vs 70.20), OCRBench v2, text recognition in images (66.28 vs 67.30), MMLongBench-Doc, understanding of long documents (58.51 vs 60.00), MMMU-Pro, multidisciplinary image-based reasoning (66.88 vs 70.35) and Video-MME, video understanding (72.44 vs 74.80).