Angelos Katharopoulos
c02e14c264
Add the 3bit packed qmm_t
2024-12-17 22:16:30 -08:00
Angelos Katharopoulos
d75a509234
Add 3bit packed quants
2024-12-17 10:49:13 -08:00
Angelos Katharopoulos
14420949d2
Fix the optional in gather_qmm python binding
2024-12-16 22:14:19 -08:00
Angelos Katharopoulos
4847199ec6
Add the quantization type option to quantizable layers
2024-12-16 22:11:23 -08:00
Angelos Katharopoulos
fb7be036af
Add packed_affine_qmm_t
2024-12-16 21:49:14 -08:00
Angelos Katharopoulos
410ccdbed5
Change the argument name to quantization_type
2024-12-16 13:32:20 -08:00
Angelos Katharopoulos
f5da489a3c
Add some error reporting
2024-12-16 13:22:05 -08:00
Angelos Katharopoulos
c2e6d58441
Revert the change in packing order
2024-12-16 13:20:01 -08:00
Angelos Katharopoulos
17a1fa2f0b
Improve the benchmark
2024-12-14 23:04:29 -08:00
Angelos Katharopoulos
fd161aa31f
Change order in weight packing
2024-12-14 22:51:41 -08:00
Angelos Katharopoulos
bf6dc54110
Add the 2 bit vectorized reads
2024-12-14 21:19:02 -08:00
Angelos Katharopoulos
d7ed624502
Vectorized reads
2024-12-14 15:36:34 -08:00
Angelos Katharopoulos
05cb54ae3f
Another packing
2024-12-13 23:48:25 -08:00
Angelos Katharopoulos
cb358dbdda
Revert "Attempt different packing"
...
This reverts commit e4b587819c
2024-12-13 23:23:41 -08:00
Angelos Katharopoulos
e4b587819c
Attempt different packing
2024-12-13 18:36:36 -08:00
Angelos Katharopoulos
a06c968f4d
Add a small benchmark
2024-12-13 16:29:11 -08:00
Angelos Katharopoulos
651c510940
Working packed qmv
2024-12-13 16:29:11 -08:00
Angelos Katharopoulos
11ec07ff9d
Initial python binding
2024-12-13 16:29:11 -08:00
Angelos Katharopoulos
bdd68bd893
Add a quantization type in the ops
2024-12-13 16:29:11 -08:00
Awni Hannun
50f3535693
Use expand_dims / unflatten / etc in more places ( #1696 )
...
* use expand_dims / unflatten in a couple more places
* few more
* few more
* fix
2024-12-12 17:00:44 -08:00
Awni Hannun
9111999af3
Fix small sort with metal validation ( #1695 )
2024-12-12 09:21:45 -08:00
Awni Hannun
6bd28d246e
Allow no copy negative strides in as_strided and slice ( #1688 )
...
* allow no copy negative strides in as_strided and slice
* fix jit
* fix jit
2024-12-12 08:59:45 -08:00
Cheng
4d595a2a39
Make compiled preamble work in MSVC ( #1675 )
...
* Make compiled preamble work in MSVC
* Remove logging
* Only use powershell for MSVC
2024-12-12 08:55:49 -08:00
Awni Hannun
3a21f61772
Fix build ( #1693 )
2024-12-11 23:56:25 -08:00
Awni Hannun
4e1e9520e1
Flatten and unflatten ( #1692 )
...
* flatten and unflatten
* fix grad
* fix shape infer
* use squeeze + unsqueeze in get_item
2024-12-11 21:51:37 -08:00
Cheng
0bf19037ca
Remove "using namespace mlx::core" in python/src ( #1689 )
2024-12-11 15:45:39 -08:00
Awni Hannun
f3dfa36a3a
Fix x86 tests ( #1691 )
...
* fix x86 tests
* comment
2024-12-11 07:47:18 -08:00
Cheng
4f9b60dd53
Remove "using namespace mlx::core" in benchmarks/examples ( #1685 )
...
* Remove "using namespace mlx::core" in benchmarks/examples
* Fix building example extension
* A missing one in comment
* Fix building on M chips
2024-12-11 07:08:29 -08:00
Awni Hannun
f76a49e555
ExpandDims primitive (#1687 )
...
* add squeeze primitive
* simplify squeeze, use in gather
* fix
* fix
* fix
* fix
* fix no cpu
* use squeeze in matmul and friends
* expand dims primitive
* comment
2024-12-10 16:39:07 -08:00
Cheng
310ad8d9db
Build OpenBLAS from source code for MSVC ( #1674 )
...
* Download OpenBLAS binaries when building with MSVC
* Download dlfcn-win32
* Link with dlfcn-win32 correctly
* Build OpenBLAS from source code
* Link with openblas statically
* Link with BLAS privately
2024-12-10 16:14:44 -08:00
Cheng
56db268f47
Provide a pread implementation for MSVC ( #1666 )
2024-12-10 15:55:53 -08:00
Cheng
92ab6bdeb8
Fix shared library not exporting symbols on Windows ( #1684 )
...
* Fix shared library not exporting symbols on Windows
* Function name style
2024-12-10 13:59:14 -08:00
Cheng
0070e360a1
Disable MSVC warnings ( #1680 )
2024-12-09 19:41:14 -08:00
Amethyst Shen
9df8fed046
Metal-cpp version bump ( #1668 )
...
* Metal-cpp version bump
Apple has released the stable version of Metal-cpp for macOS 15 and iOS 18. CMakeLists.txt is updated to build with it instead of the beta one.
* Fix style with cmake-format
2024-12-09 19:40:35 -08:00
Cheng
a59fae040f
Fix library output directory for MSVC ( #1681 )
2024-12-09 19:07:50 -08:00
Awni Hannun
29a620cab2
No reshapes in quantized embedding ( #1682 )
...
* no reshapes in quantized embedding
* fix inadvertant cast
* add tol
2024-12-09 18:57:38 -08:00
Cheng
87d7a2520e
Use Py_ssize_t in python bindings ( #1678 )
...
* Use Py_ssize_t in python bindings
* Args passed to std::max must be same type
2024-12-09 12:59:19 -08:00
Awni Hannun
40c62c1321
Use int64 stride everywhere ( #1671 )
...
* use int64 stride everywhere
* fix ext
* fix ext
* more shape + cleanup
* one more
* few more
2024-12-09 11:09:02 -08:00
Awni Hannun
35b412c099
Fix compile hasher for string constants. ( #1677 )
...
* fix hash
* add test
* nit
2024-12-09 09:26:18 -08:00
Cheng
d0f471cff7
Using math defines requires switch in MSVC ( #1665 )
...
* Using math defines requires switch in MSVC
* Fix more math macros
* Fix type
* Remove _MSC_VER guard for math defines
2024-12-08 08:16:28 -08:00
Cheng
6f316b8bf5
Use int64_t instead of ssize_t ( #1673 )
2024-12-07 20:10:44 -08:00
Cheng
7c10c93a1f
Convert filesystem path to std::string explicitly ( #1672 )
2024-12-07 20:10:06 -08:00
Cheng
d92ea094f1
Use && instead of and ( #1663 )
...
* Use && instead of and
* Remove "and" in ops.cpp
2024-12-07 18:26:39 -08:00
Cheng
6ae5423b4a
Do not pass integers to isnan ( #1664 )
2024-12-07 18:26:23 -08:00
Cheng
9635cffdc8
Include io.h in MSVC for IO functions ( #1661 )
2024-12-07 18:26:06 -08:00
Cheng
96986fb362
Use auto* for pointers ( #1662 )
2024-12-07 18:25:40 -08:00
Cheng
3ceb341a75
Use correct complex type for MSVC ( #1660 )
2024-12-07 18:25:22 -08:00
Awni Hannun
50fa705125
patch bump ( #1656 )
2024-12-06 13:16:19 -08:00
Awni Hannun
69a2991614
allow compiling lambdas in C++ ( #1650 )
...
* allow compiling lambdas in C++
* fix test
* more tests
* auto detect capture-less lambda
2024-12-06 13:13:21 -08:00
mt_caret
fd3377dd1f
Support bias correction in Adam and AdamW optimizers ( #1640 )
2024-12-06 12:13:34 -08:00
