Skip to content

[TRTLLM-15264][fix] Fail only the affected requests on disagg peer-layout mismatch - #17482

Open
brnguyen2 wants to merge 3 commits into
NVIDIA:mainfrom
brnguyen2:k3/15264-peer-error-path
Open

[TRTLLM-15264][fix] Fail only the affected requests on disagg peer-layout mismatch#17482
brnguyen2 wants to merge 3 commits into
NVIDIA:mainfrom
brnguyen2:k3/15264-peer-error-path