llm : add llm_build_context (#3881)

* llm : add llm_build_context

* llm : deduce norm eps based on type + explict max_alibi_bias, clamp_kqv

* llm : restore the non-graph llm_build_ functional API

ggml-ci

* llm : cleanup + comments
This commit is contained in:
Georgi Gerganov 2023-11-01 20:11:02 +02:00 committed by GitHub
parent 3523709a39
commit ee877f3a65
1 changed files with 1042 additions and 1296 deletions

2338
llama.cpp

File diff suppressed because it is too large Load Diff