ik_llama_opt/src
Kawrakow fb4cff3458 iq3_k: Basics
Quantize/dequantize, CUDA dequantize.
PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m.
2024-08-01 09:38:06 +02:00
..
CMakeLists.txt Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-grammar.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-grammar.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-impl.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-sampling.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-sampling.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-vocab.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama-vocab.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llama.cpp iq3_k: Basics 2024-08-01 09:38:06 +02:00
unicode-data.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode-data.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode.cpp Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
unicode.h Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00