agray3 d336410509 Avoid rebuild of GGML graph for each token (#98) ... Introduces caching of GGML graph to avoid unnecessary full rebuild between each token. KV cache parameters, which change with each token, are updated directly in cached GGML graph. Can be disabled with GGML_DISABLE_GRAPH_CACHING environment variable.		2024-10-20 08:36:16 +02:00
..
cmake	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
include	Avoid rebuild of GGML graph for each token (#98)	2024-10-20 08:36:16 +02:00
src	Avoid rebuild of GGML graph for each token (#98)	2024-10-20 08:36:16 +02:00
.gitignore	Merge mainline llama.cpp (#3)	2024-07-27 07:55:01 +02:00
CMakeLists.txt	Move to c++17 projectwide (#80)	2024-10-04 14:43:26 +03:00