Quantize/dequantize, CUDA dequantize. PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m. |
||
|---|---|---|
| .. | ||
| iqk_mul_mat.cpp | ||
| iqk_mul_mat.h | ||
| iqk_quantize.cpp | ||
| iqk_quantize.h | ||
Quantize/dequantize, CUDA dequantize. PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m. |
||
|---|---|---|
| .. | ||
| iqk_mul_mat.cpp | ||
| iqk_mul_mat.h | ||
| iqk_quantize.cpp | ||
| iqk_quantize.h | ||
Powered by TurnKey Linux.