Goekdeniz-Guelmez d8e7834345 Removed rejected_rewards handling, Updated batch unpacking to match iterator, Updated batch unpacking to match iterator, Added preference score scaling, Simplified reward calculation, Removed redundant rejected_rewards

2025-01-25 21:35:37 +01:00

..

__init__.py

LoRA: Extract small function (#614)

2024-06-02 06:38:42 -07:00

datasets.py

updates

2025-01-24 16:57:18 +01:00

dora.py

Feature: QDoRA (#891)

2024-09-30 08:01:11 -07:00

lora.py

Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)

2024-08-16 07:38:36 -07:00

orpo_trainer.py

Removed rejected_rewards handling, Updated batch unpacking to match iterator, Updated batch unpacking to match iterator, Added preference score scaling, Simplified reward calculation, Removed redundant rejected_rewards

2025-01-25 21:35:37 +01:00

trainer.py

reduction moved to CPU in case of distributed training (#1200)

2025-01-14 17:20:42 -08:00

utils.py

add internlm3 (#1206)

2025-01-15 14:55:41 -08:00