zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-10-04 00:08:09 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
3cf436b529ea58d6c0c0a29c0dd799908cd4497d
mlx-examples/llms
History
Awni Hannun 3cf436b529 Quantize example (#162) 
* testing quantization

* conversion + quantization working

* one config processor

* quantization in mistral / nits in llama

* args for quantization

* llama / mistral conversion in good shape

* phi2 quantized

* mixtral

* qwen conversion
2023-12-21 12:59:37 -08:00
..
llama
Quantize example (#162)
2023-12-21 12:59:37 -08:00
mistral
Quantize example (#162)
2023-12-21 12:59:37 -08:00
mixtral
Quantize example (#162)
2023-12-21 12:59:37 -08:00
phi2
Quantize example (#162)
2023-12-21 12:59:37 -08:00
qwen
Quantize example (#162)
2023-12-21 12:59:37 -08:00