ik_llama_opt/ggml
Kawrakow a09de6eaef iq4_ks: faster dot product on Metal (#90)
TG-128(LLaMA-3.1-8B) goes to 52.5 t/s up from 48.4 t/s.

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-10-16 14:13:03 +03:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include IQ2_KS: 2.1875 bpw non-linear quantization (#85) 2024-10-13 13:34:30 +03:00
src iq4_ks: faster dot product on Metal (#90) 2024-10-16 14:13:03 +03:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt Move to c++17 projectwide (#80) 2024-10-04 14:43:26 +03:00