From 3e9df882f645b09e19fa3e6f4cceeda5cf2ab73a Mon Sep 17 00:00:00 2001 From: Brian Nguyen Date: Wed, 12 Aug 2026 14:26:11 -0500 Subject: [PATCH] [https://nvbugs/6600098][test] Waive flaky TestKVCacheV2Llama scheduler tests on DGX_B200 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The KV-cache-v2 scheduler integration tests test_overlap_scheduler[overlap] (5.3%), test_token_budget_limited (5.2%), test_overlap_scheduler[non_overlap] (4.9%), and test_eviction[cuda_graph] (2.1%) fail intermittently in the pre-merge L0 DGX_B200 stage, independent of the PR under test — flake rates measured over 30 days across ~590 distinct MRs and 8-13 distinct users each (infra stability report). Error modes are a mix of terminated / CUDA OOM / assertion, i.e. a shared B200-side instability. Two siblings in the same class are already waived (test_chunked_prefill nvbugs/6428002, test_eviction_with_block_reuse nvbugs/6462303). SKIP-waive the high-flake variants pre-merge under umbrella bug nvbugs/6600098; they keep running post-merge, so coverage is retained. test_eviction[no_cuda_graph] (1.7%) is left pre-merge for now. Signed-off-by: Brian Nguyen --- tests/integration/test_lists/waives.txt | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/tests/integration/test_lists/waives.txt b/tests/integration/test_lists/waives.txt index 86d6b1ed2602..526c5649b5de 100644 --- a/tests/integration/test_lists/waives.txt +++ b/tests/integration/test_lists/waives.txt @@ -283,7 +283,11 @@ full:RTX_PRO_6000_Blackwell_Server_Edition/accuracy/test_llm_api_pytorch.py::Tes full:RTX_PRO_6000_Blackwell_Server_Edition/accuracy/test_llm_api_pytorch.py::TestQwen3_5_4B::test_fp8 SKIP (https://nvbugs/6273850) full:sm100/unittest/bindings SKIP (Disable for Blackwell) kv_cache/test_kv_cache_v2_scheduler.py::TestKVCacheV2Llama::test_chunked_prefill SKIP (https://nvbugs/6428002) +kv_cache/test_kv_cache_v2_scheduler.py::TestKVCacheV2Llama::test_eviction[cuda_graph] SKIP (https://nvbugs/6600098) kv_cache/test_kv_cache_v2_scheduler.py::TestKVCacheV2Llama::test_eviction_with_block_reuse SKIP (https://nvbugs/6462303) +kv_cache/test_kv_cache_v2_scheduler.py::TestKVCacheV2Llama::test_overlap_scheduler[non_overlap] SKIP (https://nvbugs/6600098) +kv_cache/test_kv_cache_v2_scheduler.py::TestKVCacheV2Llama::test_overlap_scheduler[overlap] SKIP (https://nvbugs/6600098) +kv_cache/test_kv_cache_v2_scheduler.py::TestKVCacheV2Llama::test_token_budget_limited SKIP (https://nvbugs/6600098) llmapi/test_llm_api_pytorch_bart.py::test_bart_pytorch_generate_encoder_decoder_end_to_end[bf16-kv-v1-cuda-graph-on-greedy-tp2-bart-large-cnn] SKIP (https://nvbugs/6463812) llmapi/test_llm_api_pytorch_moe_lora.py::test_mixtral_moe_routed_expert_fp8_multi_lora_varying_ranks[cudagraph] SKIP (https://nvbugs/6463829) llmapi/test_llm_api_pytorch_moe_lora.py::test_mixtral_moe_routed_expert_fp8_multi_lora_varying_ranks[eager] SKIP (https://nvbugs/6463829)