Kawrakow 8ccd9bc7e5 Bitnet CUDA improvements (#109) ... * iq1_bn: improve CUDA TG On RTX-3080 TG-128(Bitnet-1.58b-3B) goes from 318 t/s to 340 t/s. I see I have on the front page 301 t/s, so pretty nice improvement since then. * iq2_bn(CUDA): quants are not 4-byte aligned --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>		2024-10-26 16:26:04 +02:00
..
cmake	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
include	Remove forgotten IQ1_TN, IQ2_TN enum values	2024-10-25 14:14:56 +03:00
src	Bitnet CUDA improvements (#109)	2024-10-26 16:26:04 +02:00
.gitignore	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
CMakeLists.txt	Move to c++17 projectwide (#80)	2024-10-04 14:43:26 +03:00