5 Commits

Author	SHA1	Message	Date
Chunyang Wen	3779150750	refactor: all use schedule (#1973)	2025-03-19 11:24:04 -07:00
jlwitthuhn	7e5674d8be	Treate 'minimum' differently in cosine decay (#1138)	2024-05-20 08:00:48 -07:00
Chime Ogbuji	f5a1582fe8	Add minimum for cosine decay function (#859) ... * Add minimum for cosine decay function * Update python/mlx/optimizers/schedulers.py Co-authored-by: Awni Hannun <awni.hannun@gmail.com> --------- Co-authored-by: Awni Hannun <awni.hannun@gmail.com>	2024-03-21 07:33:29 -07:00
Chime Ogbuji	3b661b7394	Add linear warmup and schedule joining for use with existing schedules (#721) ... * Add linear warmup to schedules for use with existing schedules * Changed parameters for simplicity of most common case (0 initial value) * Added ScheduleJoiner and updated documentation * ScheduleJoiner -> join_schedules (ala optax #) * black compliance * Different evaluation of schedules * nits --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-02-26 07:28:48 -08:00
Srimukh Sripada	818cda16bc	Support LR schedulers (#334) ... * Add a few LR schedulers * Move parents's constructor call to the top * Fix docstring * refactor optimizers into two files * add docs * nit * Fix Callable type annotation for python 3.8 --------- Co-authored-by: Awni Hannun <awni@apple.com> Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com>	2024-02-15 11:26:20 -08:00