Skip to content

[TRTLLM-12499][perf] Bounded block-ID retrieval for pipelined KV transfer chunks - #17526

Open
athena-nv wants to merge 3 commits into
NVIDIA:mainfrom
athena-nv:trtllm-12499-pipelined-kvcache-transfer-fetch-slice_opt
Open

[TRTLLM-12499][perf] Bounded block-ID retrieval for pipelined KV transfer chunks#17526
athena-nv wants to merge 3 commits into
NVIDIA:mainfrom
athena-nv:trtllm-12499-pipelined-kvcache-transfer-fetch-slice_opt

Add bounded tail block-ID retrieval for chunked KV transfer

456afe2
Select commit
Loading
Failed to load commit list.