ik_llama_opt/docs
mattafaak c2206b80da
docs: --cache-ram-similarity is a minimum, not a maximum (#2395)
Both the `-crs` help text and docs/parameters.md describe the parameter as a
"max of similarity ... that triggers prompt cache". It is the opposite: a
candidate cache entry is REJECTED when it falls below the value.

server_prompt_cache::load() takes it as `min_reusable_fraction` and applies it as

    const float f_keep_cur = float(lcp_cur.first) / tokens.size();
    if (f_keep_cur < min_reusable_fraction) {
        continue;
    }

so raising the value makes reuse stricter, while the current wording reads as
though raising it would admit more. The parameter name in the function signature
already says "min"; only the user-facing strings disagree.

Also states what the fraction is OF, which neither string did: the matched
prefix over the length of the CACHED entry, not over the new prompt.

Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-02 18:44:32 +02:00
..
backend Merge mainline - Aug 12 2024 (#17) 2024-08-12 15:14:32 +02:00
development hotswap: keep load-time-derived and transformed tensors coherent after reloads (follow-up to #2131) (#2163) 2026-07-22 17:34:43 +03:00
android.md Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
autoparser.md common: handle Laguna chat delimiters (#1943) 2026-06-10 07:46:19 +02:00
build.md Update repository clone instructions in build.md (#1753) 2026-05-07 12:57:06 +03:00
docker.md Update Docker documentation with important notice 2026-03-15 12:35:04 +01:00
function-calling.md common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369) 2026-03-09 11:03:33 +01:00
install.md Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
llguidance.md Tool calls support from mainline (#723) 2025-09-01 08:38:49 +03:00
parameters.md docs: --cache-ram-similarity is a minimum, not a maximum (#2395) 2026-09-02 18:44:32 +02:00
speculative.md model: add openPangu-2.0-Flash (92B-A6B) with MLA-latent cache, DSA/SWA, mHC, and multi-head MTP (#2065) 2026-07-11 12:29:20 +03:00