Quantize/dequantize, CUDA dequantize. PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m. |
||
|---|---|---|
| .. | ||
| llama.h | ||
Quantize/dequantize, CUDA dequantize. PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m. |
||
|---|---|---|
| .. | ||
| llama.h | ||
Powered by TurnKey Linux.