6 Commits

Author	SHA1	Message	Date
Anchen	a2402116ae	refactor(hf_llm): moving phi2 example into hf_llm (#293) ... * refactor: moving phi2 example into hf_llm * chore: clean up * chore: update phi2 model args so it can load args from config * fix phi2 + nits + readme * allow any HF repo, update README * fix bug in llama --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-11 12:29:12 -08:00
Anchen	7380ebfb0d	fix: undefined hf_path (#292)	2024-01-11 05:53:52 -08:00
Konstantin Kerekovski	047d4650c4	Add -local flag to llms/hf_llm/convert.py for reading source HF models from filesystem. (#260) ... * * Add --local flag for reading models from filesystem and related code for doing so * Disable uploading to huggingface if --local flag is set * Remove code related to .bin files and merge fetch_from_local and fetch_from_hub into one function. * Update llms/hf_llm/convert.py Co-authored-by: Awni Hannun <awni.hannun@gmail.com> * format / nits --------- Co-authored-by: Awni Hannun <awni.hannun@gmail.com> Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-10 19:53:01 -08:00
Awni Hannun	cf0ad26a89	force fp16 for quantized models (#240)	2024-01-05 21:29:15 -08:00
Vaibhav Srivastav	f95cf30a31	Fix upload to hub for HF LLMs conversion script. (#221) ... * Fix upload to hub snippet. * Weights -> model. * reverting last commit.	2024-01-04 06:06:05 -08:00
Awni Hannun	a5d6d0436c	Support Hugging Face models (#215) ... * support hf direct models	2024-01-03 15:13:26 -08:00