Model Capability Dominates: Inference-Time Optimization Lessons from AIMO 3

View PDF HTML (experimental)

Abstract:Majority voting over multiple LLM attempts improves mathematical reasoning, but correlated errors limit the effective sample size. A natural fix: assign structurally different reasoning strategies to different voters to decorrelate errors. We test this Diverse Prompt Mixer in the AIMO~3 competition: 3 models, 23+ experiments, and 50 IMO-level problems on a single H100 80 GB with a 5-hour limit. Every intervention fails. High-temperature sampling already decorrelates errors sufficiently; weaker prompt strategies reduce per-attempt accuracy more than they reduce correlation. Across a 17-point model capability gap and every inference-time optimization we tried, model capability dominates by an order of magnitude.

Subjects:

Computation and Language (cs.CL)

Cite as: arXiv:2603.27844 [cs.CL]

(or arXiv:2603.27844v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2603.27844

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Natapong Nitarach [view email] [v1] Sun, 29 Mar 2026 20:05:18 UTC (180 KB)