[https://nvbugs/6480110][fix] Fall back to FP8 KV cache when NVFP4 KV cache is requested on SM107 - #18674

[https://nvbugs/6480110][fix] Fall back to FP8 KV cache when NVFP4 KV cache is requested on SM107#18674

farazkh80 merged 2 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

farazkh80:rubin_feat/sm107_nvfp4_kv_downgradefarazkh80/TensorRT-LLM:rubin_feat/sm107_nvfp4_kv_downgradeCopy head branch name to clipboard