zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-25 01:41:19 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
69181e0058
mlx-examples/transformer_lm
History
Kosti cfeef6d9d2
Typo: SGD->AdamW (#471)
2024-02-20 15:47:17 -08:00
..
datasets.py Add llms subdir + update README (#145) 2023-12-20 10:22:25 -08:00
main.py Typo: SGD->AdamW (#471) 2024-02-20 15:47:17 -08:00
README.md Add grad checkpointing and PE in the transformer example (#387) 2024-02-01 13:04:03 -08:00
requirements.txt Update a few examples to use compile (#420) 2024-02-08 13:00:41 -08:00

README.md

Transformer LM

This is an example of a decoder-only Transformer LM. The only dependency is MLX.

Run the example on the GPU with:

python main.py --gpu

By default the dataset is the PTB corpus. Choose a different dataset with the --dataset option.