Kawrakow 6b26cb05f5 Q8_0_R4 (#120) ... * Adding q8_0_r4 We get PP-512(LLaMA-3.1-8B) = 268 t/s on a Ryzen-7950X compared to 175.6 t/s for Q8_0. * q8_0_r4: NEON We get PP-512(LLaMA-3.1-8B) = 112.6 t/s on M2-Max. * q8_0_r4: Zen4 matrix-vector specialization --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>		2024-12-03 06:15:29 +01:00
..
ggml-alloc.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml-backend.h	Bitnet changes (#106)	2024-10-25 13:08:43 +02:00
ggml-blas.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml-cann.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml-cuda.h	Merge mainline - Aug 12 2024 (#17)	2024-08-12 15:14:32 +02:00
ggml-kompute.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml-metal.h	Merge mainline - Aug 12 2024 (#17)	2024-08-12 15:14:32 +02:00
ggml-rpc.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml-sycl.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml-vulkan.h	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
ggml.h	Q8_0_R4 (#120)	2024-12-03 06:15:29 +01:00