nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ik_llama_opt/ggml
History
Kawrakow a4371b7842 iq3_k: faster CUDA dot product 
138 t/s for LLaMA-3.1-8B, which is almost on par with iq3_s.
 		2024-08-01 09:38:06 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include iq3_k: Basics 2024-08-01 09:38:06 +02:00
src iq3_k: faster CUDA dot product 2024-08-01 09:38:06 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00