Awni Hannun 3cf436b529 Quantize example (#162) ...

* testing quantization

* conversion + quantization working

* one config processor

* quantization in mistral / nits in llama

* args for quantization

* llama / mistral conversion in good shape

* phi2 quantized

* mixtral

* qwen conversion

2023-12-21 12:59:37 -08:00

2.3 KiB

Raw Blame History

View Raw