ik_llama_opt/ggml
Kawrakow 3b5fa426f1 Improve Bitnet PP on Metal (#108)
iq1_bn goes from 702 t/s to 716 t/s
iq2_bn goes from 714 t/s to 743 t/s

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-10-26 15:13:45 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include Remove forgotten IQ1_TN, IQ2_TN enum values 2024-10-25 14:14:56 +03:00
src Improve Bitnet PP on Metal (#108) 2024-10-26 15:13:45 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt Move to c++17 projectwide (#80) 2024-10-04 14:43:26 +03:00