ik_llama_opt/ggml
Kawrakow 709e1a5375
Fixing split mode graph with many GPUs (#1152)
* Attempt to fix the many GPU issue in split mode graph

* WIP: this seems more stable

Still hanging after a while if I try to use all 7 GPUs

* Reenable OpenMP in scheduler async

Seems solid up to 4 GPUs. It did hang with --max-gpu 6.

* printf cleanup
2026-01-17 08:05:24 +02:00
..
cmake Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
include server: improve speed of speculative decoding (#1119) 2026-01-10 08:01:22 +02:00
src Fixing split mode graph with many GPUs (#1152) 2026-01-17 08:05:24 +02:00
.gitignore Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
CMakeLists.txt CUDA: compress-mode size (#1110) 2026-01-07 18:33:17 +02:00