Skip to content

gc-ratchet baseline has mixed provenance after #7650's surgical re-pin, and the schema cannot express it #7652

Description

@proggeramlug

benchmarks/gc_ratchet/baseline/gc-ratchet-v1.json now has mixed provenance: 143 of its 144 cells were measured at 26b9c9d59 (0.5.1346), and 01_nursery_churn.heap_used_bytes was surgically re-pinned at c8394bfdb+#7650 (0.5.1370). Same host both times, verified against the artifact's own host block.

That was the right call for #7650 — the alternative was spending probe_overrides' one-way gating: false on a deterministic cell, whose premise (genuine sample-dependence, per 12_large_live_set's rationale) does not hold here. And it is recorded: the artifact's notes says which cell came from where, and the top-level commit is described as covering 143 of 144.

The problem is what a future reader assumes. A baseline artifact carrying a single top-level commit field reads as uniform provenance, and the note that says otherwise is 4,000 characters into a prose block. The next person to attribute a moved cell will reason against the wrong commit for one row in twelve probes.

Two things worth doing, in order:

  1. A full re-pin at a current commit, on the same pinned host (perry-macos, Mac mini M1). Note the artifact was already 24 commits behind before perf(gc): stop traversing the young graph twice — skip the copying minor's eligibility preflight when its answer is already known (#7645) #7650 — 50 of 144 cells differ from what main measures today, all inside their bands, so check is green and nothing is broken. But a baseline that far behind makes every future attribution harder than it needs to be, and gc-ratchet has measured nothing since 2026-08-05: harness validation fails before the probes run (12_large_live_set spread 6768) #7554 already wants a bisect over 0.5.1280..0.5.1346 for the unexplained 12_large_live_set.wall_ms +13.58%.
  2. Make mixed provenance structurally visible rather than prose-visible — a per-cell or per-probe commit field that validate understands, so a surgical re-pin records its own provenance where the reader is already looking. Today the schema cannot express what was actually done.

Until (1), treat 26b9c9d59 as the provenance for every cell except 01_nursery_churn.heap_used_bytes.

Context: #7645, #7650, #7554, #7558.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions