mlx-examples

mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-24 17:31:18 +08:00

History

Shunta Saito 85c1ff8fd6 Add PLaMo-13B model as an LLM example (#303 ) * Convert HF weights of PLaMo and load it to a plamo model in mlx * Fix model inference part * Add bos at the beginning of the prompt * Fix convert.py to copy tokenizer.model into the converted dir * Use the required insturction format in generate.py when "--instruct" option is specified * Change filenames and update existing scripts * Add README * Add requirements.txt * Fix plamo.py to stop generation when EOS appears * Add quantization to convert.py * Use mlx>=0.0.9 for mx.core.outer() in PLaMo model * Update acknowledgements.md * Fix card text in upload_to_hub() * Not use prompt template when --instruct is not specified * Ask if you trust_remote_code for loading tokenizer of PLaMo * Check the user trusts the remote code when converting * Remove plamo directory * Update README * Add PLaMo model file * Fix the handling of cache in PLaMo and update README * Ask if trust_remote_code only when the model is PLaMo * Remove resolve_trust_remote_code from convert.py and use the latest transformers * Remove code not to add EOS * Update README to fix an example not to use noncommercial version of the model * Remove unused imports * Remove unnecessary description about the instruct model of PLaMo from README * format, nits in README * typo --------- Co-authored-by: Shunta Saito <shunta@mitmul-mbp.local> Co-authored-by: Awni Hannun <awni@apple.com>		2024-01-23 07:17:24 -08:00
..
models	Add PLaMo-13B model as an LLM example (#303 )	2024-01-23 07:17:24 -08:00
__init__.py	Mlx llm package (#301 )	2024-01-12 10:25:56 -08:00
convert.py	chore: fix the convert.py script for weights are not sanitized and support quant for non-32 dimensions (#340 )	2024-01-19 21:07:21 -08:00
generate.py	Add colorized output option to generate script (#347 )	2024-01-23 05:25:44 -08:00
README.md	Mlx llm package (#301 )	2024-01-12 10:25:56 -08:00
requirements.txt	refactor(qwen): moving qwen into mlx-lm (#312 )	2024-01-22 15:00:07 -08:00
UPLOAD.md	Mlx llm package (#301 )	2024-01-12 10:25:56 -08:00
utils.py	Add PLaMo-13B model as an LLM example (#303 )	2024-01-23 07:17:24 -08:00

README.md

Generate Text with MLX and 🤗 Hugging Face

This an example of large language model text generation that can pull models from the Hugging Face Hub.

For more information on this example, see the README in the parent directory.