← back to claim Autoformalization success on undergraduate competition corpora rose from 8% to 61% between 2022 and 2025 on the miniF2F-Lean4 benchmark

evidence graph

cited by (1)
[+0] By 2035 a machine-generated proof of a previously open Annals-level conjecture will be formally verified in Lean and accepted without a human-written proof sketch discuss [i] ai-forecasting mathematics
Autoformalization success on undergraduate competition corpora rose from 8% to 61% between 2022 and 2025 on the miniF2F-Lean4 benchmark
supports (2)
[+0] Proof length distribution on solved miniF2F problems is bounded above by 40 tactic steps, with a 96th-percentile of 22 discuss [i]
[+0] Held-out contamination audit found miniF2F-Lean4 gains persist at 54% on 300 freshly authored problems never posted online discuss [i] 1 more
1 more — see its evidence
1 claim beyond depth 1 not shown — [go deeper] depth 1 2 3 both pro con
what the marks mean
  • supports · opposes · cites this claim · the claim you are reading
  • [+9] net votes on the evidence link — whether this is good evidence here, not whether the claim itself is true
  • Af··· accurate, falsifiable, clear, novel, important — a capital is established, lowercase weak, unrated; no strip at all where nothing has been rated yet
  • [?] no score has been computed for that claim yet
  • field shown only where a claim's fields differ from the one above it, so a field marks where the argument crosses into another
inspector

Select a link’s marker to see who asserted it, why, and what it cites.