nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

DSpark: gather BF16 Markov rows (#2304) 

* DSpark: gather BF16 Markov rows

* DSpark: gather Markov rows by type
This commit is contained in:
Samuel Oliveira Alves 2026-08-13 13:02:46 -03:00 committed by GitHub
parent cf711918e2
commit 981e5ea0d7
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
src/graphs/build_dflash.cpp
View File

@ -26,7 +26,8 @@ ggml_tensor * llm_build_context::build_dspark_logits(
ggml_tensor * draft_tokens = nullptr;
for (int64_t i = 0; i < n_tokens; ++i) {
ggml_tensor * markov_w1 = ggml_get_rows(ctx0, model.dspark_markov_w1, previous);
ggml_tensor * markov_w1 = ggml_get_rows_ext(
ctx0, model.dspark_markov_w1, previous, true, false);
ggml_tensor * markov_bias = ggml_mul_mat(ctx0, model.dspark_markov_w2, markov_w1);
ggml_tensor * base_row = ggml_view_2d(
ctx0,