Files
gguf-tools/README.md

9 lines
357 B
Markdown
Raw Normal View History

2023-12-24 23:46:46 +01:00
# GGUF tools
Todo... still not clear what this is going to be.
## Specification documents
* [Official GGUF specification](https://github.com/ggerganov/ggml/blob/master/docs/gguf.md), where the file layout and meta-data is described.
* [Quantization formats](https://github.com/ggerganov/ggml/blob/master/src/ggml-quants.h) used in quantized GGUF models.