Chime Ogbuji 3b661b7394 Add linear warmup and schedule joining for use with existing schedules (#721) ...

* Add linear warmup to schedules for use with existing schedules

* Changed parameters for simplicity of most common case (0 initial value)

* Added ScheduleJoiner and updated documentation

* ScheduleJoiner -> join_schedules (ala optax #)

* black compliance

* Different evaluation of schedules

* nits

---------

Co-authored-by: Awni Hannun <awni@apple.com>

2024-02-26 07:28:48 -08:00

..

__init__.py

Support LR schedulers (#334)

2024-02-15 11:26:20 -08:00

optimizers.py

Support LR schedulers (#334)

2024-02-15 11:26:20 -08:00

schedulers.py

Add linear warmup and schedule joining for use with existing schedules (#721)

2024-02-26 07:28:48 -08:00