ik_llama_opt

Commit Graph

Author	SHA1	Message	Date
Wu Jian Ping	8e02435659	server : embeddings compatibility for OpenAI (#5190 )	2024-01-29 15:48:10 +02:00
Xuan Son Nguyen	88bd8be65e	server : refactored the task processing logic (#5065 ) * server: add llama_server_queue struct * server: add llama_server_response_event * server: add comments * server: move all mutexes away from server.cpp * server: correct multitask response * server: only add back deferred tasks when one slot is available * server: fix a race condition cause by "request_completion"	2024-01-26 14:42:20 +02:00

Author

SHA1

Message

Date

Wu Jian Ping

8e02435659

server : embeddings compatibility for OpenAI (#5190 )

2024-01-29 15:48:10 +02:00

Xuan Son Nguyen

88bd8be65e

server : refactored the task processing logic (#5065 )

* server: add llama_server_queue struct

* server: add llama_server_response_event

* server: add comments

* server: move all mutexes away from server.cpp

* server: correct multitask response

* server: only add back deferred tasks when one slot is available

* server: fix a race condition cause by "request_completion"

2024-01-26 14:42:20 +02:00

2 Commits