Add Experts4bit for 4-bit quantization of fused MoE experts#1965
Open
pjordanandrsn wants to merge 9 commits into
Open
Add Experts4bit for 4-bit quantization of fused MoE experts#1965pjordanandrsn wants to merge 9 commits into
pjordanandrsn wants to merge 9 commits into