The FunctionGemma KV/int8 decode graphs are DSL/DAG-authored, but the graph post-processing in
FunctionGemmaExport.kt is done by regex rewrites of the emitted StableHLO text, not graph passes.
Convert each to the SKaiNET way (a StableHLO/DAG transform):
Context: PR #245. Tracker: SKaiNET-embedded sl2610-function-calling/docs/GEMMA-KV-INT8.md.
The FunctionGemma KV/int8 decode graphs are DSL/DAG-authored, but the graph post-processing in
FunctionGemmaExport.ktis done by regex rewrites of the emitted StableHLO text, not graph passes.Convert each to the SKaiNET way (a StableHLO/DAG transform):
rewriteGlobalsToBf16) → a DAG/StableHLO dtype transform (leverageDtypeForwardPropagationPass).rewriteGlobalsToInt8injecting dequant as text) → a real graph quantization pass; keep the host per-row quant writer, emiti8→f32 × scaleas graph nodes.7919→x?xstring relax (most fragile: a magic prime that must not collide with a real dim/SSA id) → proper dynamic-shape tracing.GemmaModel.forwardWithPastattnWithPast(hand-wired single-token attention) → an MHA-with-past module forward.refsForpositional sub-module resolution → typedHybridTransformerBlockfield access.Context: PR #245. Tracker: SKaiNET-embedded
sl2610-function-calling/docs/GEMMA-KV-INT8.md.