nicolas
/
ik_llama_opt
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

fix(server): reset chat parser on slot reuse to prevent crash (#1763) (#1794) 

If a slot is reused for a standard completion (`/v1/completions`) after
being used for a chat completion (`/v1/chat/completions`), the previous
chat's PEG parser would remain active in the slot's parameters. This
caused standard text completions to throw on the raw text.
This commit is contained in:
gapeleon 2026-05-18 01:26:45 +10:00 committed by GitHub
parent 0ab9bdf793
commit c35189d83c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
examples/server/server-context.cpp
View File

@ -1624,6 +1624,9 @@ bool server_context::launch_slot_with_task(server_slot& slot, server_task& task)
slot.params.chat_parser_params.parse_tool_calls = json_value(data, "parse_tool_calls", false);
if (data.contains("chat_parser")) {
slot.params.chat_parser_params.parser.load(data.at("chat_parser").get<std::string>());
} else {
// Reset to default; otherwise a reused slot would apply the previous chat's PEG parser to non-chat outputs (e.g., /v1/completions).
slot.params.chat_parser_params.parser = defaults.chat_parser_params.parser;
}
}
{