* Option to use re-quantized output tensor for MTP * Remove quantize extra output option * Handle interleaved types |
||
|---|---|---|
| .. | ||
| llama.h | ||
* Option to use re-quantized output tensor for MTP * Remove quantize extra output option * Handle interleaved types |
||
|---|---|---|
| .. | ||
| llama.h | ||
Powered by TurnKey Linux.