Kawrakow 4fda827258 iq6_k: CUDA dequantize ... We get a slightly better PPL for LLaMA-3.1-8B compared to q6_K (0.14% vs 0.26% quantization error).		2024-08-09 16:00:31 +02:00
..
cmake	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
include	iq6_k: WIP (nothing works)	2024-08-09 16:00:31 +02:00
src	iq6_k: CUDA dequantize	2024-08-09 16:00:31 +02:00
.gitignore	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
CMakeLists.txt	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00