3 and 6 bit quantization (#1613)

* Support 3 and 6 bit quantization
2025-09-05 07:34:42 +08:00 · 2024-11-22 10:22:13 -08:00
parent 0c5eea226b
commit c79f6a4a8c
12 changed files with 633 additions and 419 deletions
--- a/docs/src/python/fast.rst
+++ b/docs/src/python/fast.rst
@@ -12,5 +12,4 @@ Fast
  layer_norm
  rope
  scaled_dot_product_attention
-  affine_quantize
  metal_kernel