zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-09-01 04:24:36 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Add linear warmup and schedule joining for use with existing schedules (#721)

Browse Source 
* Add linear warmup to schedules for use with existing schedules

* Changed parameters for simplicity of most common case (0 initial value)

* Added ScheduleJoiner and updated documentation

* ScheduleJoiner -> join_schedules (ala optax #)

* black compliance

* Different evaluation of schedules

* nits

---------

Co-authored-by: Awni Hannun <awni@apple.com>
This commit is contained in:
Chime Ogbuji
2024-02-26 10:28:48 -05:00
committed by GitHub
parent e6418781ab
commit 3b661b7394
3 changed files with 109 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/src/python/optimizers/schedulers.rst
View File

@@ -8,6 +8,8 @@ Schedulers
.. autosummary::
:toctree: _autosummary
step_decay
exponential_decay
cosine_decay
exponential_decay
join_schedules
linear_schedule
step_decay