feat: first-class dynamic tensor dimensions for streaming KV-cache decode - #891

Merged

michalharakal merged 6 commits into

feat/emitter-dynamic-shapes

Jul 30, 2026

Commits on Jul 27, 2026

feat(compile-hlo): dynamic-shape-safe StableHLO for streaming KV-cache decode

michalharakal
and
claude
committed
feat(lang-core,compile-hlo): trace + emit real dynamic KV-cache seq dims

michalharakal
and
claude
committed
feat(lang-core): first-class dynamic dimensions (Dim), distinct from reshape-infer

michalharakal
and
claude
committed
fix(compile-dag): don't probe volume of a dynamic-shaped tensor in trace finalize

michalharakal
and
claude
committed
test(lang-core,compile-hlo): dynamic-shape coverage for concat/slice/reshape

michalharakal
and
claude
committed
fix(lang-core): keep static void tensors readable; only dynamic is allocation-free

michalharakal
and
claude
committed