mlx-examples/llms
Anchen 31ddbd7806
add deepseek coder example (#172)
* feat: add example for deepseek coder

* chore: remove hardcoded rope_scaling_factor

* feat: add quantization support

* chore: update readme

* chore: clean up the rope scalling factor param in create cos sin theta

* feat: add repetition_penalty

* style /consistency changes to ease future integration

* nits in README

* one more typo

---------

Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-28 21:42:22 -08:00
..
deepseek-coder add deepseek coder example (#172) 2023-12-28 21:42:22 -08:00
llama add deepseek coder example (#172) 2023-12-28 21:42:22 -08:00
mistral add deepseek coder example (#172) 2023-12-28 21:42:22 -08:00
mixtral add deepseek coder example (#172) 2023-12-28 21:42:22 -08:00
phi2 add deepseek coder example (#172) 2023-12-28 21:42:22 -08:00
qwen add deepseek coder example (#172) 2023-12-28 21:42:22 -08:00
speculative_decoding add speculative decoding example for llama (#149) 2023-12-28 15:20:43 -08:00