글
- WarpQuant: Dual-Domain Low-Bit LLM QuantizationEnglish
A post-training quantization method that reaches INT2/INT3 SOTA accuracy and runs the compressed weights directly through a C++/CUDA llama.cpp kernel — 7.36× faster decoding than GPTQ W3.
검색 결과가 없습니다.