← back to claim Autoformalization success on undergraduate competition corpora rose from 8% to 61% between 2022 and 2025 on the miniF2F-Lean4 benchmark

evidence graph

depth 1 2 3 both pro con
this claim: Autoformalization success on undergraduate competition corpora rose from 8% to 61% between 2022 and 2025 on the miniF2F-Lean4 benchmark
[+0] validity 0.0 centrality 17.6 consensus 0 depth 0.0
formal-verification machine-learning virtues Accurate unrated · Falsifiable unrated · Clear unrated · Novel unrated · Important unrated
supports (2)
supports: [+0] Proof length distribution on solved miniF2F problems is bounded above by 40 tactic steps, with a 96th-percentile of 22 centre graph here [i]inspect this link formal-verification virtues: Accurate unrated · Falsifiable unrated · Clear unrated · Novel unrated · Important unrated
supports: [+0] Held-out contamination audit found miniF2F-Lean4 gains persist at 54% on 300 freshly authored problems never posted online centre graph here [i]inspect this link formal-verification machine-learning virtues: Accurate unrated · Falsifiable unrated · Clear unrated · Novel unrated · Important unrated
loading 1 more…
opposes (0)
no opposing evidence yet
inspector

Select a link’s inspect marker to see who asserted it, why, and what it cites.