ik_llama_opt/examples
Thireus ☠ 6d78a87c4c
perplexity: signal-driven hot-swap mode for persistent per-tensor PPL/KLD benchmarking (extends #1989) (#2131)
* perplexity: add signal-driven hot-swap mode for persistent KLD/PPL benchmarking

llama-perplexity can now stay resident and be driven through control/status files (reload/compute/exit): it reloads only the tensors that changed on disk and recomputes PPL/KLD without ever reloading the full model. File-based signalling works on Windows, macOS and Linux. The reload returning-to-original path now refreshes tensor data from disk instead of
reattaching stale weights.

* Not Cygwin specific
2026-07-14 12:56:03 +03:00
..
baby-llama
batched
batched-bench
batched.swift
benchmark Quantization options (#1677) 2026-04-23 09:05:39 +02:00
convert-llama2c-to-ggml
cvector-generator Split mode graph for dense Gemma4 assistant (#2022) 2026-06-24 18:29:32 +02:00
deprecation-warning
embedding
eval-callback eval-callback : sum over the full tensor, not just the printed slice (#2019) 2026-06-24 08:57:19 +02:00
export-lora
gbnf-validator common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369) 2026-03-09 11:03:33 +01:00
gguf
gguf-hash
gguf-split gguf-split: fix the split output files naming (#1336) 2026-03-02 08:43:47 +01:00
gritlm
imatrix Fix DFlash oerformance with split mode graph (#1980) 2026-06-17 18:40:02 +02:00
infill
jeopardy
llama-bench Remove deprecated Kompute (Vulkan compute) backend (#2097) 2026-07-08 10:01:01 +02:00
llama.android
llama.swiftui
lookahead
lookup
main feat: allow dflash to work with spec auto tune (#2112) 2026-07-12 07:49:03 +03:00
main-cmake-pkg
mtmd mtmd: add MiniMax M3 vision support (#2086) 2026-07-12 07:19:14 +03:00
parallel
parser Autoparser - complete refactoring of parser architecture (#1376) 2026-04-22 10:04:13 +02:00
passkey
perplexity perplexity: signal-driven hot-swap mode for persistent per-tensor PPL/KLD benchmarking (extends #1989) (#2131) 2026-07-14 12:56:03 +03:00
quantize Fix per_layer_token_embedding (#2117) 2026-07-12 11:58:09 +03:00
quantize-stats Update autofix and presets (#1867) 2026-05-24 07:30:44 +03:00
retrieval
rpc fix(rpc): update ggml_backend_cuda_init to 3-arg signature (#2084) 2026-07-06 09:26:45 +02:00
save-load-state server: enable checkpoint for recurrent models (#1310) 2026-02-26 06:51:18 +01:00
server feat: allow dflash to work with spec auto tune (#2112) 2026-07-12 07:49:03 +03:00
simple
speculative Fix two speculative-decoding crashes that prevent any usage (#1760) 2026-05-09 08:36:38 +03:00
sweep-bench Cleaner log for adjusted splits (#1494) 2026-03-24 07:49:40 +01:00
sycl
tokenize
CMakeLists.txt
Miku.sh
base-translate.sh
chat-13B.bat
chat-13B.sh
chat-persistent.sh
chat-vicuna.sh
chat.sh
convert_legacy_llama.py
json_schema_pydantic_example.py
json_schema_to_grammar.py Autoparser - complete refactoring of parser architecture (#1376) 2026-04-22 10:04:13 +02:00
llama.vim
llm.vim
pydantic_models_to_grammar.py
pydantic_models_to_grammar_examples.py
reason-act.sh
regex_to_grammar.py
server-llama2-13B.sh
server_embd.py
ts-type-to-grammar.sh