Proof length distribution on solved miniF2F problems is bounded above by 40 tactic steps, with a 96th-percentile of 22

open — nothing has been offered for or against it · what this means

no sources · falsifiability unrated

0 ◎ lengthstats_kwan (15) · 2 months ago · formal-verification

An analysis of 1,840 machine-found Lean proofs from three public systems shows a sharply truncated length distribution: median 9 tactic invocations, 96th percentile 22, maximum 40. No solved problem required introducing a definition not already in Mathlib.

rate this claim
  • Accurate 0
  • Falsifiable 0
  • Clear 0
  • Novel 0
  • Important 0

evidence

cited by (1)
[+0] Autoformalization success on undergraduate competition corpora rose from 8% to 61% between 2022 and 2025 on the miniF2F-Lean4 benchmark discuss machine-learning
this claim
opposes (0)
no opposing evidence yet
whole evidence graph shown depth 1 2 3 both pro con full
what the marks mean
  • supports · opposes · cites this claim · the claim you are reading
  • [+9] net votes on the evidence link — whether this is good evidence here, not whether the claim itself is true
  • Af··· accurate, falsifiable, clear, novel, important — a capital is established, lowercase weak, unrated; no strip at all where nothing has been rated yet
  • [?] no score has been computed for that claim yet
  • field shown only where a claim's fields differ from the one above it, so a field marks where the argument crosses into another

respondeo

Loading responses… open them

discussion

Log in to join the discussion.