12 Commits

Author	SHA1	Message	Date
Anchen	7380ebfb0d	fix: undefined hf_path (#292)	2024-01-11 05:53:52 -08:00
Konstantin Kerekovski	047d4650c4	Add -local flag to llms/hf_llm/convert.py for reading source HF models from filesystem. (#260) ... * * Add --local flag for reading models from filesystem and related code for doing so * Disable uploading to huggingface if --local flag is set * Remove code related to .bin files and merge fetch_from_local and fetch_from_hub into one function. * Update llms/hf_llm/convert.py Co-authored-by: Awni Hannun <awni.hannun@gmail.com> * format / nits --------- Co-authored-by: Awni Hannun <awni.hannun@gmail.com> Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-10 19:53:01 -08:00
Alwin Arrasyid	2bbe9d3bd8	fix use of args in generate function (#284)	2024-01-10 08:09:21 -08:00
Awni Hannun	7b258f33ac	Move lora example to use the same model format / conversion as hf_llm (#252) ... * huffing face the lora example to allow more models * fixes * comments * more readme nits * fusion + works better for qlora * nits' * comments	2024-01-09 11:14:52 -08:00
Nino Risteski	b152d12d7b	Update README.md (#243) ... a few typos	2024-01-06 11:44:49 -08:00
Anchen	758f05c09a	refactor: merge deepseek coder example into hf_llm example (#234) ... * refactor: merge deepseek coder example into hf_llm example * remove deepseek example * chore: fix format in readme * chore: remove default rope_scaling dict and use get to access type and factor to avoid key error * Update llms/hf_llm/models.py Co-authored-by: Awni Hannun <awni.hannun@gmail.com> * chore: fix lint --------- Co-authored-by: Awni Hannun <awni.hannun@gmail.com>	2024-01-06 07:53:46 -08:00
Awni Hannun	cf0ad26a89	force fp16 for quantized models (#240)	2024-01-05 21:29:15 -08:00
Christian Bieniak	4fa659acbd	Handle receiving 0 tokens gracefully (#231) ... * handle 0 tokens gracefully * Formatting * Move no token check to statistics section	2024-01-04 19:14:13 -08:00
Andy Peatling	12c9bafbf5	Update README.md to fix --hf-model param call. (#229) ... Update `--hf-model` to `--hf-path` since the `--hf-model` param does not exist in convert.py.	2024-01-04 11:53:51 -08:00
Awni Hannun	e14afb3e77	fix to use actual prompt (#227)	2024-01-04 11:12:05 -08:00
Vaibhav Srivastav	f95cf30a31	Fix upload to hub for HF LLMs conversion script. (#221) ... * Fix upload to hub snippet. * Weights -> model. * reverting last commit.	2024-01-04 06:06:05 -08:00
Awni Hannun	a5d6d0436c	Support Hugging Face models (#215) ... * support hf direct models	2024-01-03 15:13:26 -08:00