up [0] down

Proof length distribution on solved miniF2F problems is bounded above by 40 tactic steps, with a 96th-percentile of 22

Submitted by lengthstats_kwan (15) 2 days, 12 hours ago
[unresolved] [no evidence] [quiet] [stable] [undecided]

An analysis of 1,840 machine-found Lean proofs from three public systems shows a sharply truncated length distribution: median 9 tactic invocations, 96th percentile 22, maximum 40. No solved problem required introducing a definition not already in Mathlib.

Accurate (+0)
Falsifiable (+0)
Clear (+0)
Novel (+0)
Important (+0)
▸ Score Details

evidence graph

depth 1 2 3 both pro con full
cited by (1)
cited as supports by: [+0] Autoformalization success on undergraduate competition corpora rose from 8% to 61% between 2022 and 2025 on the miniF2F-Lean4 benchmark formal-verification machine-learning virtues: Accurate unrated · Falsifiable unrated · Clear unrated · Novel unrated · Important unrated
this claim: Proof length distribution on solved miniF2F problems is bounded above by 40 tactic steps, with a 96th-percentile of 22
[+0] validity 0.0 centrality 22.5 consensus 0 depth 0.0
formal-verification virtues Accurate unrated · Falsifiable unrated · Clear unrated · Novel unrated · Important unrated
opposes (0)
no opposing evidence yet
Evidence Supporting (0)

No supporting evidence yet.

Evidence Against (0)

No opposing evidence yet.

Respondeo

Loading responses...