ik_llama_opt

Commit Graph

Author	SHA1	Message	Date
unbounded	c9ffd853d5	Add quantize-stats command for testing quantization (#728 ) Command that calculates some statistics over the errors introduced by quantization, like mean square error, max error and some percentile errors for layer weights. Should be useful for testing quantization improvements. Exposes some internal state from ggml and llama for testing	2023-04-08 00:09:18 +02:00
Georgi Gerganov	84db7c0b8f	Overhaul the examples structure - main -> examples - utils -> examples (renamed to "common") - quantize -> examples - separate tools for "perplexity" and "embedding" Hope I didn't break something !	2023-03-25 20:26:40 +02:00

Author

SHA1

Message

Date

unbounded

c9ffd853d5

Add quantize-stats command for testing quantization (#728 )

Command that calculates some statistics over the errors introduced by
quantization, like mean square error, max error and some percentile errors for layer
weights. Should be useful for testing quantization improvements.

Exposes some internal state from ggml and llama for testing

2023-04-08 00:09:18 +02:00

Georgi Gerganov

84db7c0b8f

Overhaul the examples structure

- main -> examples
- utils -> examples (renamed to "common")
- quantize -> examples
- separate tools for "perplexity" and "embedding"

Hope I didn't break something !

2023-03-25 20:26:40 +02:00

2 Commits