zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-11-02 04:30:17 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
fc93c557238e9441835afe2748fd170016cb068b
mlx-examples/llms/mlx_lm
History
L fc93c55723 feat(mlx_lm): Nemotron (#949) 
* feat: Nemotron

https://huggingface.co/nvidia/Minitron-4B-Base

This is basically Llama with partial RoPE and LayerNorm instead of
BatchNorm. Also they add 1 to the LayerNorm weight for some reason.

* fixup! feat: Nemotron

* nits

---------

Co-authored-by: Awni Hannun <awni@apple.com>
2024-08-29 21:08:57 -07:00
..
examples
Example of response generation with optional arguments (#853)
2024-07-09 06:49:59 -07:00
models
feat(mlx_lm): Nemotron (#949)
2024-08-29 21:08:57 -07:00
tuner
feat(mlx_lm): Nemotron (#949)
2024-08-29 21:08:57 -07:00
__init__.py
mlx_lm: Add Streaming Capability to Generate Function (#807)
2024-06-03 09:04:39 -07:00
cache_prompt.py
Docs on prompt scaling (#963)
2024-08-29 15:05:17 -07:00
convert.py
Create executables for generate, lora, server, merge, convert (#682)
2024-04-16 16:08:49 -07:00
fuse.py
Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)
2024-08-16 07:38:36 -07:00
generate.py
Docs on prompt scaling (#963)
2024-08-29 15:05:17 -07:00
gguf.py
Whisper updates to allow HF models (#923)
2024-08-09 11:11:58 -07:00
LORA.md
Configuration-based use of HF hub-hosted datasets for training (#701)
2024-06-26 10:20:50 -07:00
lora.py
Pass use_dora parameter to linear_to_lora_layers (#885)
2024-07-11 14:34:34 -07:00
MANAGE.md
Add model management functionality for local caches (#736)
2024-05-03 12:20:13 -07:00
manage.py
Add model management functionality for local caches (#736)
2024-05-03 12:20:13 -07:00
MERGE.md
Create executables for generate, lora, server, merge, convert (#682)
2024-04-16 16:08:49 -07:00
merge.py
Create executables for generate, lora, server, merge, convert (#682)
2024-04-16 16:08:49 -07:00
py.typed
Add py.typed to support PEP-561 (type-hinting) (#389)
2024-01-30 21:17:38 -08:00
README.md
feat: move lora into mlx-lm (#337)
2024-01-23 08:44:37 -08:00
requirements.txt
Use fast rope (#945)
2024-08-23 13:18:51 -07:00
sample_utils.py
Min P implementation (#926)
2024-08-15 15:45:02 -07:00
SERVER.md
Adapters loading (#902)
2024-08-01 16:18:18 -07:00
server.py
Predict stop sequence matches during streaming (#541)
2024-08-06 15:24:15 -07:00
tokenizer_utils.py
Fix setattr for the TokenizerWrapper (#961)
2024-08-28 14:47:33 -07:00
UPLOAD.md
Mlx llm package (#301)
2024-01-12 10:25:56 -08:00
utils.py
Add the ability to load the KV cache from a file (#956)
2024-08-28 22:11:45 -07:00
version.py
Docs on prompt scaling (#963)
2024-08-29 15:05:17 -07:00

README.md

Generate Text with MLX and 🤗 Hugging Face

This an example of large language model text generation that can pull models from the Hugging Face Hub.

For more information on this example, see the README in the parent directory.

This package also supports fine tuning with LoRA or QLoRA. For more information see the LoRA documentation.