Corgi-DDIR work#795

Draft

frankmcsherry wants to merge 72 commits into

TimelyDataflow:master-nextfrom

frankmcsherry:corgi-on-mn

Commits on Jul 3, 2026

Integer-proxy chunks: backend-agnostic join and reduce over (key_hash, value_id)

frankmcsherry
and
claude
committed
int_proxy: state the minimal value_id contract — hashing is one scheme, not a requirement

frankmcsherry
and
claude
committed
int_proxy: delta-proportional presents, checked — not asymptotically worse than the cursor tactics

frankmcsherry
and
claude
committed
int_proxy: the self-contained assessment — identity backend, grid-oracle fuzz

frankmcsherry
and
claude
committed
int_proxy: wall-clock bench; fix a capacity leak the bench found

frankmcsherry
and
claude
committed
int_proxy: batch the reduce value callback per wave (reduce_many)

frankmcsherry
and
claude
committed
int_proxy: one value-callback crossing per retire, not per wave

frankmcsherry
and
claude
committed
int_proxy: port the history-replay machinery — the scaling shapes go linear

frankmcsherry
and
claude
committed
int_proxy: materialize in TARGET-sized chunks — the last scaling term

frankmcsherry
and
claude
committed
interactive: CorgiChunk arrangement backend (cursor-less Route B on the #778 Chunk split)

frankmcsherry
and
claude
committed
interactive: operator scorecard — per-operator corgi-vs-vec perf triage

frankmcsherry
and
claude
committed
interactive: remove arrange/join transcode boundaries — both now beat vec

frankmcsherry
and
claude
committed
interactive: columnar consolidate building block (proven, unit-tested)

frankmcsherry
and
claude
committed
interactive: Count reduce fast-path — skip the unnecessary per-value consolidation

frankmcsherry
and
claude
committed
interactive: columnar Distinct consolidate building block (two-level, tested)

frankmcsherry
and
claude
committed
interactive: group_offsets — the integers-only Rust<->corgi boundary primitive

frankmcsherry
and
claude
committed
SPIKE.md: 2026-07-02 checkpoint — Chunk backend, transcode removal, boundary model

frankmcsherry
and
claude
committed
SPIKE.md: corgi-backend hand-off — int_proxy framework (PR #781) consumption plan

frankmcsherry
and
claude
committed
corgi ProxyReduceBackend: columnar reduce over int proxies

frankmcsherry
and
claude
committed
corgi reduce: burn the transcode — fully columnar id resolution

frankmcsherry
and
claude
committed
corgi reduce: Min/Collect order via corgi sort_blocks — zero transcode

frankmcsherry
and
claude
committed
corgi reduce: identity hasher for the u64 id-index maps

frankmcsherry
and
claude
committed
int_proxy: MSD-bucket sort in ProxyChunk::from_unsorted

frankmcsherry
and
claude
committed
int_proxy reduce: reuse per-key scratch across the retire

frankmcsherry
and
claude
committed
int_proxy reduce: reuse the per-moment delta map (BTreeMap -> reused IdMap)

frankmcsherry
and
claude
committed
corgi_perf: add end-to-end SCC case (corgi vs vec)

frankmcsherry
and
claude
committed
Isolate SCC bug to corgi (not the int_proxy tactic)

frankmcsherry
and
claude
committed
Narrow corgi SCC bug to the outer recursion (not scopes/reduce structure)

frankmcsherry
and
claude
committed
Pin corgi SCC bug to the reduce via update-stream diff

frankmcsherry
and
claude
committed
Pin corgi SCC bug: reduce-input present/arrange LOSES a record

frankmcsherry
and
claude
committed
Complete SCC diagnosis: compaction cancels a novel retraction, erasing an interesting time

frankmcsherry
and
claude
committed
Adopt int_proxy seed fix (fm/int-proxy 960a6ec4) + implement present_novel in corgi

frankmcsherry
and
claude
committed
Adopt seed_times refinement (fm/int-proxy 34cc815) + implement it for corgi

frankmcsherry
and
claude
committed
corgi_perf: add native DD SCC (three-way native vs DDIR-vec vs DDIR-corgi)

frankmcsherry
and
claude
committed
corgi_scc_prof: loopable SCC profiling target + attribution

frankmcsherry
and
claude
committed
corgi join: delta-proportional restriction of the accumulated side

frankmcsherry
and
claude
committed

Commits on Jul 4, 2026

Make corgi-chunk shareable: git-dep corgi + field report + large-N SCC harness

frankmcsherry
and
claude
committed

Commits on Jul 5, 2026

Collect dead generations: drop pre-Chunk arrange + pre-int_proxy reduce

frankmcsherry
and
claude
committed

Commits on Jul 10, 2026

Commits on Jul 11, 2026

Commits on Jul 12, 2026

Commits on Jul 13, 2026

Commits on Jul 14, 2026

Commits on Jul 15, 2026

Commits on Jul 16, 2026

Merge remote-tracking branch 'origin/master-next' into corgi-on-mn-pr
frankmcsherry
committed