zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-24 09:21:18 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update mixed_2_6 and mixed_3_6 quant predicates to explicitly pass high_bits parameter

Browse Source
This commit is contained in:
sealad886 2025-03-16 08:31:47 +00:00
parent 2fce02acd8
commit 8680bb614e
No known key found for this signature in database
GPG Key ID: 1D7E0A927313D20E
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
llms/mlx_lm/utils.py
View File

@ -1052,8 +1052,8 @@ def mixed_quant_predicate_builder(
return mixed_quant_predicate
mixed_3_6 = mixed_quant_predicate_builder(low_bits=3)
mixed_2_6 = mixed_quant_predicate_builder(low_bits=2)
mixed_3_6 = mixed_quant_predicate_builder(low_bits=3, high_bits=6)
mixed_2_6 = mixed_quant_predicate_builder(low_bits=2, high_bits=6)
def convert(