2 Commits

Author	SHA1	Message	Date
Kawrakow	a648191c2c	Be able to repack tensors at run time (#147) ... * Be able to repack tensors at run time * Repack: also add bf16 as repackable type * Repack: make sure number of rows is a multiple of the packing --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>	2024-12-17 14:16:34 +01:00
Kawrakow	0ceeb11721	Merge mainline llama.cpp (#3) ... * Merging mainline - WIP * Merging mainline - WIP AVX2 and CUDA appear to work. CUDA performance seems slightly (~1-2%) lower as it is so often the case with llama.cpp/ggml after some "improvements" have been made. * Merging mainline - fix Metal * Remove check --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>	2024-07-27 07:55:01 +02:00