An Update on Gurobi’s Participation in the Mittelmann Benchmarks

Gurobi has made the decision to discontinue its participation in the Mittelmann benchmarks. While these benchmarks have historically served as a valuable tool for demonstrating advancements in computational mathematical programming, the sizes of many of the test sets no longer align with today’s best practices for benchmarking. Additionally, the rigorous validation of solutions and efforts to detect solver over-tuning—particularly in light of machine learning techniques being used to tune solvers—demand more time and resources than are currently available to the benchmark administrators. For these reasons, we believe that the benchmarks no longer offer the utility they once did for users and practitioners.