mirror of
https://github.com/ml-explore/mlx-examples.git
synced 2025-06-24 01:17:28 +08:00
40 lines
971 B
Markdown
40 lines
971 B
Markdown
|
# Segment Anything
|
||
|
|
|
||
|
|
An implementation of the Segment Anything Model (SAM) in MLX. See the original
|
||
|
|
repo by Meta AI for more details.[^1]
|
||
|
|
|
||
|
|
## Installation
|
||
|
|
|
||
|
|
```bash
|
||
|
|
pip install -r requirements.txt
|
||
|
|
```
|
||
|
|
|
||
|
|
## Convert
|
||
|
|
|
||
|
|
```bash
|
||
|
|
python convert.py --hf-path facebook/sam-vit-base --mlx-path sam-vit-base
|
||
|
|
```
|
||
|
|
|
||
|
|
The `safetensors` weight file and configs are downloaded from Hugging Face,
|
||
|
|
converted, and saved in the directory specified by `--mlx-path`.
|
||
|
|
|
||
|
|
The model sizes are:
|
||
|
|
|
||
|
|
- `facebook/sam-vit-base`
|
||
|
|
- `facebook/sam-vit-large`
|
||
|
|
- `facebook/sam-vit-huge`
|
||
|
|
|
||
|
|
## Run
|
||
|
|
|
||
|
|
See examples `notebooks/predictor_example.ipynb` and
|
||
|
|
`notebooks/automatic_mask_generator_example.ipynb` to try the Segment Anything
|
||
|
|
Model with MLX.
|
||
|
|
|
||
|
|
You can also generate masks from the command line:
|
||
|
|
|
||
|
|
```bash
|
||
|
|
python main.py --model <path/to/model> --input <image_or_folder> --output <path/to/output>
|
||
|
|
```
|
||
|
|
|
||
|
|
[^1]: The original Segment Anything [GitHub repo](https://github.com/facebookresearch/segment-anything/tree/main).
|