5 Commits

Author	SHA1	Message	Date
Awni Hannun	a5d6d0436c	Support Hugging Face models (#215) ... * support hf direct models	2024-01-03 15:13:26 -08:00
Anchen	e632d7aaaa	fix: deepseek coder tokenizer error (#211)	2024-01-01 06:10:37 -08:00
Anchen	ee3c44d231	chore: make the Deepseek example compatible with Yi models. (#205) ... * Update convert.py * Update convert.py * Update deepseek_coder.py	2023-12-30 06:11:33 -08:00
Anchen	1cdbf9e886	chore: fix the load quantization model for deepseek coder (#203) ... * chore: fix the load quantization model * change to explicitly check for quantization config	2023-12-29 05:25:38 -08:00
Anchen	31ddbd7806	add deepseek coder example (#172) ... * feat: add example for deepseek coder * chore: remove hardcoded rope_scaling_factor * feat: add quantization support * chore: update readme * chore: clean up the rope scalling factor param in create cos sin theta * feat: add repetition_penalty * style /consistency changes to ease future integration * nits in README * one more typo --------- Co-authored-by: Awni Hannun <awni@apple.com>	2023-12-28 21:42:22 -08:00