ik_llama_opt/examples
maor-ps 68c2749a8a If first token generated from the server is the stop word the server will crash (#7038)
This will reproduce the issue in llama13b
{
'prompt': 'Q: hello world \nA: ',
 'stop': ['\n'],
 'temperature': 0.0,
 'n_predict': 10,
 'cache_prompt': True,
 'n_probs': 10
}
2024-05-04 11:06:40 +02:00
..
baby-llama
batched
batched-bench
batched.swift
beam-search
benchmark
convert-llama2c-to-ggml
embedding BERT tokenizer fixes (#6498) 2024-04-09 13:44:08 -04:00
eval-callback model: support arch `DbrxForCausalLM` (#6515) 2024-04-13 11:33:52 +02:00
export-lora
finetune
gbnf-validator
gguf
gguf-split
gritlm
imatrix
infill
jeopardy
llama-bench
llama.android
llama.swiftui
llava
lookahead
lookup
main
main-cmake-pkg
parallel
passkey
perplexity
quantize quantize: add imatrix and dataset metadata in GGUF (#6658) 2024-04-26 20:06:33 +02:00
quantize-stats
retrieval
save-load-state
server If first token generated from the server is the stop word the server will crash (#7038) 2024-05-04 11:06:40 +02:00
simple
speculative
sycl
tokenize
train-text-from-scratch
CMakeLists.txt
Miku.sh
alpaca.sh
base-translate.sh
chat-13B.bat
chat-13B.sh
chat-persistent.sh
chat-vicuna.sh
chat.sh
gpt4all.sh
json-schema-pydantic-example.py
json_schema_to_grammar.py
llama.vim
llama2-13b.sh
llama2.sh
llm.vim
make-ggml.py
pydantic-models-to-grammar-examples.py
pydantic_models_to_grammar.py
reason-act.sh
regex-to-grammar.py
server-embd.py
server-llama2-13B.sh
ts-type-to-grammar.sh