ik_llama_opt/ggml
Kawrakow 85c6152e85 Give the user the option to override where model weights are stored (#232)
* Give the user the option to override where model weights are stored

* Fix ggml_nbytes() problem and cleanup

For a tensor with zero elements ggml_nbytes() was returning
uint64_t::max, and this was causing graph allocation failure.

* Add timing info to CUDA graph evaluation

* Add more timing info

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-02-25 17:55:58 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include Fused MoE ffn_up and ffn_gate (#229) 2025-02-23 14:31:11 +02:00
src Give the user the option to override where model weights are stored (#232) 2025-02-25 17:55:58 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt FA: Add option to build all FA kernels (#197) 2025-02-09 18:59:33 +02:00