mirror of
https://github.com/ml-explore/mlx-examples.git
synced 2025-06-25 09:51:19 +08:00
76710f61af
* initial commit * initial commit * Adding first lines * adding x, and dt projection layers * adding the clamping mechanism * First succesful inference * last commit for today - added custom geenrate function and it works as expected, will try training and then with loading a model from the hub * clean up * save up * almost * update * update * fixed cache handeling * fixed loading * added seperate generat_step method in the model and also in the utils to automaticaly use the generate step mthod in the model class * quick update * still not working * save * still not working * initial commit * utils.py logits = logits[:, -1, :] TypeError: tuple indices must be integers or slices, not tuple * update * update * Fixing the Batching Depfwise Comnvolution and multi token input * fixing generate and logits outputs * Done! * Fixing the cache handling, generating works now trying training * update ACKNOWLEDGEMENTS * removing the model_type if stuff in the _step loop in generate_step and adding MambaCache in base.py for training easier generations and removing mamba in tuner/utils. * quick clean up * update trainer/utils for right initialisation of the layers for LoRA, but not working. * clean up * Forther update to trainer/utils for correct layer selection. Successfull training * removing extra mamba-infer.py file * clean up, reformating will come later * reformat and big clean up, final commit * some speedups and cleanups * fix test * nits * nits --------- Co-authored-by: Awni Hannun <awni@apple.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| base.py | ||
| cohere.py | ||
| dbrx.py | ||
| deepseek_v2.py | ||
| deepseek.py | ||
| gemma2.py | ||
| gemma.py | ||
| gpt2.py | ||
| gpt_bigcode.py | ||
| gpt_neox.py | ||
| internlm2.py | ||
| llama.py | ||
| mamba.py | ||
| minicpm.py | ||
| mixtral.py | ||
| nemotron.py | ||
| olmo.py | ||
| openelm.py | ||
| phi3.py | ||
| phi3small.py | ||
| phi.py | ||
| phimoe.py | ||
| phixtral.py | ||
| plamo.py | ||
| qwen2_moe.py | ||
| qwen2.py | ||
| qwen.py | ||
| recurrent_gemma.py | ||
| stablelm.py | ||
| starcoder2.py | ||
| su_rope.py | ||
| switch_layers.py | ||