ik_llama_opt/ggml
firecoperana c03ee1a4d2 server: improve speed of speculative decoding (#1119)
* server: improve speed of speculative decoding

change logs

rpc: add recompute

spec dec fix

* Fix n_batch_size not set to context size for draft model

---------

Co-authored-by: firecoperana <firecoperana>
2026-01-10 08:01:22 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include server: improve speed of speculative decoding (#1119) 2026-01-10 08:01:22 +02:00
src server: improve speed of speculative decoding (#1119) 2026-01-10 08:01:22 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt CUDA: compress-mode size (#1110) 2026-01-07 18:33:17 +02:00