73ad16269b
* rpc: disable unsafe memcmp graph cache Same-shape prefill micro-batches compared equal and took the GRAPH_RECOMPUTE path, re-running a stored graph against a grown KV context; the GLM-5.2 DSA indexer then read past its buffers and crashed the server. Always send the full graph. Upstream retired this cache design in ggml-org/llama.cpp#22701. * rpc: use 64-bit ne/nb in rpc_tensor wire struct ggml_tensor holds int64 ne and size_t nb; the wire struct stored them as uint32, truncating any stride >= 4 GiB. The GLM-5.2 DSA indexer query stride crosses that at ~26k tokens. Bump RPC_PROTO_MAJOR (wire-format change). * ggml: use 64-bit locals in ggml_permute Permuted strides were built in int locals, truncating any stride > 2 GiB before it reached result->nb (size_t). Affects any permuted tensor over ~2 GiB. |
||
|---|---|---|
| .. | ||
| ggml-alloc.h | ||
| ggml-backend.h | ||
| ggml-cann.h | ||
| ggml-cpp.h | ||
| ggml-cuda.h | ||
| ggml-metal.h | ||
| ggml-rpc.h | ||
| ggml-sycl.h | ||
| ggml-vulkan.h | ||
| ggml.h | ||