[TRTLLM-12714][fix] Suspend CUDA-graph padding dummies before pool rebalance adjust() - #16157

[TRTLLM-12714][fix] Suspend CUDA-graph padding dummies before pool rebalance adjust()#16157

thorjohnsen merged 3 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

thorjohnsen:fix/kv-rebalance-cuda-graph-padding-dummythorjohnsen/TensorRT-LLM:fix/kv-rebalance-cuda-graph-padding-dummyCopy head branch name to clipboard