mlx-examples

zhangyiss/mlx-examples

Fork 0

mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-08-27 22:30:16 +08:00

Commit Graph

Select branches

Hide Pull Requests

awq

awq-tq

dist-eval

distributed-layers

fix_whisper_temp

fix_wwdc_notebook_models

flux-dist-improv

flux-qlora

load-gguf

main

openlm

packed-quants

#1

#10

#1001

#1003

#1004

#1006

#1009

#1012

#1013

#1014

#1015

#1016

#102

#1020

#1023

#1024

#1026

#1027

#1028

#103

#1035

#1036

#1037

#1038

#1040

#1045

#1047

#1048

#1048

#1049

#105

#1050

#1054

#1055

#106

#1061

#1062

#1063

#1065

#1068

#1069

#107

#1070

#1072

#1074

#1075

#1078

#1079

#108

#1080

#1081

#1082

#1085

#1089

#1090

#1092

#1093

#1094

#1096

#1099

#110

#1100

#1103

#1105

#1113

#1114

#1115

#1117

#1118

#1119

#112

#1121

#1122

#1125

#1128

#1129

#113

#1131

#1132

#1133

#1135

#1137

#1140

#1141

#1143

#1144

#1145

#1146

#1148

#1149

#115

#1152

#1153

#1154

#1155

#1156

#1157

#1158

#1159

#116

#1163

#1164

#1166

#1173

#1174

#1176

#1178

#1180

#1189

#1191

#1192

#1193

#1194

#1196

#1197

#1199

#12

#1200

#1202

#1204

#1205

#1206

#1208

#1209

#121

#1210

#1211

#1212

#1213

#1214

#1215

#1216

#1217

#1220

#1222

#1225

#1228

#1229

#123

#1230

#1230

#1231

#1231

#1233

#1234

#1235

#1240

#1241

#1242

#1246

#1249

#1250

#1251

#1253

#1257

#1259

#1260

#1263

#1265

#1267

#1270

#1271

#1272

#1273

#1276

#1277

#1278

#1279

#1280

#1283

#1287

#129

#1291

#1294

#1295

#1297

#1298

#1299

#1300

#1301

#1302

#1304

#1305

#1308

#1311

#1312

#1314

#1315

#1316

#1319

#1321

#1322

#1323

#1324

#1325

#1326

#133

#1330

#1331

#1332

#1336

#1338

#1339

#134

#1340

#1342

#1346

#1348

#1349

#1350

#1353

#1358

#1359

#136

#1364

#1365

#1367

#1370

#1371

#1375

#1375

#1377

#1377

#1383

#1383

#1385

#1385

#1386

#1386

#14

#140

#141

#144

#145

#147

#149

#151

#152

#153

#154

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#167

#169

#171

#172

#173

#174

#176

#177

#178

#180

#183

#184

#186

#187

#189

#19

#190

#191

#192

#193

#195

#197

#198

#2

#200

#201

#202

#203

#205

#208

#211

#213

#214

#215

#219

#22

#221

#222

#227

#229

#23

#231

#234

#235

#237

#238

#24

#240

#241

#242

#243

#245

#248

#250

#251

#252

#253

#254

#255

#257

#260

#263

#264

#265

#266

#269

#27

#270

#271

#272

#274

#275

#276

#278

#282

#284

#285

#287

#290

#291

#292

#293

#294

#295

#30

#300

#301

#302

#303

#306

#307

#308

#309

#310

#311

#312

#315

#318

#319

#32

#320

#321

#325

#326

#33

#331

#333

#335

#337

#338

#340

#342

#343

#347

#350

#351

#352

#353

#354

#358

#36

#360

#361

#363

#364

#365

#366

#369

#37

#373

#375

#377

#378

#379

#380

#386

#387

#388

#389

#391

#392

#393

#396

#397

#398

#399

#40

#401

#405

#408

#409

#41

#41

#411

#413

#414

#415

#417

#418

#419

#42

#420

#421

#424

#426

#427

#429

#43

#431

#432

#433

#439

#441

#443

#445

#446

#449

#45

#450

#451

#453

#455

#457

#458

#461

#462

#466

#467

#468

#469

#47

#470

#471

#472

#474

#475

#479

#48

#482

#483

#483

#486

#489

#491

#494

#495

#496

#497

#498

#5

#50

#501

#502

#503

#505

#506

#509

#51

#510

#514

#515

#516

#518

#519

#52

#520

#521

#522

#523

#528

#53

#530

#531

#534

#536

#539

#541

#544

#545

#546

#547

#548

#549

#55

#552

#555

#558

#562

#563

#565

#566

#569

#570

#571

#572

#573

#574

#577

#578

#580

#581

#585

#589

#590

#591

#592

#595

#596

#599

#602

#603

#604

#608

#609

#610

#611

#613

#614

#62

#621

#623

#628

#632

#633

#634

#636

#639

#64

#640

#643

#644

#645

#648

#650

#651

#654

#657

#66

#661

#665

#666

#667

#668

#670

#673

#674

#675

#676

#679

#680

#681

#682

#683

#684

#685

#687

#688

#69

#690

#691

#693

#694

#697

#698

#7

#701

#702

#703

#705

#707

#708

#711

#712

#715

#716

#717

#719

#720

#721

#729

#73

#731

#735

#736

#739

#74

#740

#743

#744

#746

#749

#75

#752

#753

#758

#76

#760

#763

#766

#77

#770

#773

#775

#778

#779

#78

#782

#789

#79

#790

#792

#793

#794

#797

#798

#8

#80

#800

#802

#803

#806

#807

#810

#813

#817

#818

#82

#821

#822

#824

#825

#827

#828

#830

#831

#833

#835

#837

#838

#839

#84

#840

#85

#851

#852

#853

#855

#856

#857

#86

#863

#867

#87

#871

#877

#879

#88

#882

#885

#886

#888

#889

#89

#890

#891

#895

#898

#899

#90

#902

#903

#904

#905

#906

#907

#911

#913

#914

#915

#915

#920

#923

#926

#93

#931

#932

#935

#936

#937

#94

#940

#942

#945

#946

#948

#949

#954

#955

#956

#957

#96

#960

#961

#962

#963

#965

#969

#97

#971

#971

#973

#979

#98

#981

#983

#984

#989

#99

#990

#991

#993

#995

#996

#998

ef6ff92add

Merge branch 'ml-explore:main' into adding-GRPO-training Gökdeniz Gülmez 2025-02-25 13:26:22 +0100
834c087479

Avoid importing private function chaihahaha 2025-02-25 15:07:11 +0800
c37e26a1a3

Add plamo-2-1b model (#1283) Shunta Saito 2025-02-25 12:24:43 +0900
53185c7f3d last update, gn Goekdeniz-Guelmez 2025-02-24 22:20:07 +0100
e4eac9c97b adding custom system message integration in dataset, more opimizations (generates now faster, while same RAM usage), fix for the identical generatrions, seperated the reward functions into a seperate file. Goekdeniz-Guelmez 2025-02-24 20:49:11 +0100
7900a6c22c fix Awni Hannun 2025-02-24 09:10:24 -0800
2edcc0355f cleanup Awni Hannun 2025-02-24 09:07:07 -0800
9392bc70f7 cleanup Awni Hannun 2025-02-24 08:51:12 -0800
09f5add151 Update lora.py paNikitin 2025-02-24 19:30:17 +0300
b2ab37238e added adapter additional tokens load on fuse paNikitin 2025-02-24 12:21:30 +0300
e2ace6fb0f Update trainer.py paNikitin 2025-02-24 09:12:31 +0300
675c322978 Merge remote-tracking branch 'upstream/main' into mitmul/add-plamo2-1b-support Shunta Saito 2025-02-24 13:37:43 +0900
431ece6c5b Generate: Support Prefill Prompt madroid 2025-02-24 12:19:49 +0800
231f5e870e fixed full dequantization mem leak paNikitin 2025-02-23 15:24:59 +0300
5b7581f41c Update trainer.py paNikitin 2025-02-23 12:56:09 +0300
a2b61afd05 update upstream paNikitin 2025-02-23 12:48:25 +0300
0f790c4c84 Update lora.py paNikitin 2025-02-23 12:37:49 +0300
95d44228c9 Update new_tokens.py paNikitin 2025-02-23 12:34:17 +0300
68403f5577 added cot loss masking training paNikitin 2025-02-23 12:31:44 +0300
fb1559e1f3 Add __iter__ and __next__ methods to PlamoCache Shunta Saito 2025-02-23 17:33:19 +0900
e2d9d619c4 Add state property to PlamoCache Shunta Saito 2025-02-23 16:06:38 +0900
21c0abaf23 Fix to use repeat instead of tile Shunta Saito 2025-02-23 14:54:23 +0900
d7426c7750 Do not pass mask to prepare_inputs_for_generation Shunta Saito 2025-02-23 14:47:49 +0900
31225f4960 Remove unnecessary code and add a test for plamo2 Shunta Saito 2025-02-23 14:43:14 +0900
12d1e968cc

Add support for IPv6 chaihahaha 2025-02-23 02:13:11 +0800
bd5f081ca5

Merge branch 'ml-explore:main' into adding-GRPO-training Gökdeniz Gülmez 2025-02-22 19:11:26 +0100
ea7ca22d10

Merge branch 'ml-explore:main' into adding-dpo-training Gökdeniz Gülmez 2025-02-22 19:11:15 +0100
2d4895d68b

Merge branch 'ml-explore:main' into adding-orpo-training Gökdeniz Gülmez 2025-02-22 19:11:02 +0100
c0bd89aa15 add usage in LORA.md Goekdeniz-Guelmez 2025-02-22 17:29:06 +0100
9705ed908e fix wrong generation in train Goekdeniz-Guelmez 2025-02-22 17:21:08 +0100
09b641aaa7

Fix FutureWarning in torch.load by setting weights_only=True (#1295) Usama Ahmed 2025-02-22 17:08:54 +0300
e4e7678c2c

Fix FutureWarning in torch.load by setting weights_only=True Usama Ahmed 2025-02-22 14:36:24 +0300
d4e688edc3 Fix reference to layers Shunta Saito 2025-02-22 19:55:42 +0900
d9c4c6e60c clean up and readding temperature argument Goekdeniz-Guelmez 2025-02-22 02:34:56 +0100
d653371e3d nits Goekdeniz-Guelmez 2025-02-22 02:12:02 +0100
235348c211 generation speed improvement in training too from 3 t/s to 15 t/s Goekdeniz-Guelmez 2025-02-22 02:03:01 +0100
79de353530 nits Goekdeniz-Guelmez 2025-02-22 01:05:58 +0100
c51b0a2715 fix Goekdeniz-Guelmez 2025-02-22 00:21:47 +0100
710bc1490e training mode working too got from 2 toks/sec to 30 toks/sec with raw 1.5B model Goekdeniz-Guelmez 2025-02-21 22:42:15 +0100
6086137131 Huge speed improvement in validation mode. Goekdeniz-Guelmez 2025-02-21 22:08:49 +0100
5704136791 better dataset handling Goekdeniz-Guelmez 2025-02-21 21:12:45 +0100
de147187c1

Merge branch 'ml-explore:main' into adding-orpo-training Gökdeniz Gülmez 2025-02-21 19:59:43 +0100
d050911ab5

Merge branch 'ml-explore:main' into adding-dpo-training Gökdeniz Gülmez 2025-02-21 18:35:52 +0100
2f20107d9b little faster generation + prints ot a examplke generatino in validation mode, more optimization in trianing function Goekdeniz-Guelmez 2025-02-21 16:02:27 +0100
3d793ecf68

Fix logits processor bugs with spec dec (#1291) Awni Hannun 2025-02-20 15:55:55 -0800
f83d02369d bump patch Awni Hannun 2025-02-20 15:48:43 -0800
85669451d0

Fix num layers in fine tune (#1294) Awni Hannun 2025-02-20 13:32:01 -0800
5fc071a33b Fix num layers in fine tune Awni Hannun 2025-02-20 08:39:55 -0800
b1eb530531 Fix logits processor bugs with spec dec Awni Hannun 2025-02-19 14:03:02 -0800
11c8991476

Merge branch 'ml-explore:main' into adding-GRPO-training Gökdeniz Gülmez 2025-02-19 21:24:22 +0100
6d5432b143

Merge branch 'ml-explore:main' into adding-dpo-training Gökdeniz Gülmez 2025-02-19 21:24:10 +0100
65d777b868

Merge branch 'ml-explore:main' into adding-orpo-training Gökdeniz Gülmez 2025-02-19 21:23:49 +0100
1cbf5cdac7

use more standard window strategy (#1287) Awni Hannun 2025-02-19 06:22:51 -0800
348f728c10

Merge branch 'ml-explore:main' into adding-orpo-training Gökdeniz Gülmez 2025-02-18 17:19:07 +0100
ab35c87911

Merge branch 'ml-explore:main' into adding-dpo-training Gökdeniz Gülmez 2025-02-18 17:17:49 +0100
541f0be937 fix generation cutoff in evaluation Goekdeniz-Guelmez 2025-02-17 14:39:38 +0100
1eea135a20

Merge branch 'ml-explore:main' into adding-GRPO-training Gökdeniz Gülmez 2025-02-17 14:25:03 +0100
6a6bd53e43 removing print and switching some variables in the math Goekdeniz-Guelmez 2025-02-15 15:38:51 +0100
5ec4790656 removing comments + adding temperature + reward weighting Goekdeniz-Guelmez 2025-02-15 15:29:22 +0100
1e75bf184c Include .jsonl files to download from Huggingface hub Shunta Saito 2025-02-15 10:08:33 +0900
9f422b4729 Fix import Shunta Saito 2025-02-14 23:35:10 +0900
28f3f3adab Give all inputs when it's the first time call of model Shunta Saito 2025-02-14 23:24:45 +0900
103c6616c4 Remove unused code part Shunta Saito 2025-02-14 23:06:42 +0900
66dd97ed3d Fix channel first weights to channel last for right use of MLX's conv1d Shunta Saito 2025-02-14 22:38:13 +0900
81917d41d5 Allow a cache obj defined externally Shunta Saito 2025-02-14 21:11:30 +0900
00d13ebd40 Fix some part Shunta Saito 2025-02-14 01:51:06 +0900
fb5e225523 Apply formatter Shunta Saito 2025-02-13 20:02:38 +0900
07cf4336b3 Add plamo2.py Shunta Saito 2025-02-13 19:54:07 +0900
ebea6928a3 Remove unnecessary changes Shunta Saito 2025-02-13 19:53:34 +0900
72269c306c Use sanitize() Shunta Saito 2025-02-13 19:45:01 +0900
197fd6aad8 Fix model Shunta Saito 2025-02-13 18:57:00 +0900
40c7ce8048 Use mlx's BaseModelArgs Shunta Saito 2025-02-13 14:47:08 +0900
9a6e6541de Fix cache.py to support non-top level layers Shunta Saito 2025-02-13 13:44:31 +0900
58686bbcac Add pfnet/plamo-2-1b Shunta Saito 2025-02-13 13:06:44 +0900
7efc5f8c5e use more standard window strategy Awni Hannun 2025-02-14 06:53:31 -0800
baeb9f117f reduncancy fix + nits Goekdeniz-Guelmez 2025-02-14 09:09:59 +0100
96bf37008e

Update README.md to include how to set temperature (#1280) Matthias Neumayer 2025-02-14 04:32:56 +0100
2229775369 nits Awni Hannun 2025-02-13 19:31:51 -0800
7b07b14e67

add logits processor to spec gen (#1260) Awni Hannun 2025-02-13 19:19:53 -0800
65a49dda0e nits Goekdeniz-Guelmez 2025-02-13 21:46:30 +0100
8179b99436 quick prompting fix Goekdeniz-Guelmez 2025-02-12 19:24:35 +0100
a7273f6a56 small fix Goekdeniz-Guelmez 2025-02-12 18:30:12 +0100
0408925f0d

Update README.md to include how to set temperature Matthias Neumayer 2025-02-12 12:14:50 +0100
3823154014

Merge branch 'ml-explore:main' into adding-GRPO-training Gökdeniz Gülmez 2025-02-12 11:10:10 +0100
4b44434c54

Merge branch 'ml-explore:main' into adding-dpo-training Gökdeniz Gülmez 2025-02-12 11:09:58 +0100
80c64da960

Merge branch 'ml-explore:main' into adding-orpo-training Gökdeniz Gülmez 2025-02-12 11:09:43 +0100
c26e188417

Merge branch 'ml-explore:main' into adding-support-for-mamba2 Gökdeniz Gülmez 2025-02-12 11:09:20 +0100
e33d9d509b updates Goekdeniz-Guelmez 2025-02-12 11:07:53 +0100
607c300e18 Add Direct Preference Optimization (DPO) method Anupam Mediratta 2025-02-12 15:21:21 +0530
c42e858d7e Merge branch 'adding-GRPO-training' of https://github.com/Goekdeniz-Guelmez/mlx-examples into adding-GRPO-training Goekdeniz-Guelmez 2025-02-12 08:57:33 +0100
5aeefc8c47 update new iterade batches function + nits Goekdeniz-Guelmez 2025-02-12 08:57:26 +0100
ec30dc3538

hunyuan finetune (#1270) Awni Hannun 2025-02-11 16:49:35 -0800
42413c5d85

fix lora timings after validation (#1278) Awni Hannun 2025-02-11 16:48:55 -0800
423badeb2b fix lora timings after validation Awni Hannun 2025-02-11 16:44:28 -0800
f8cbf159e0

fix sharding for more even number of layers (#1276) Awni Hannun 2025-02-11 16:26:59 -0800
e879ea70e1

fix generation evaluations (#1277) Awni Hannun 2025-02-11 16:10:30 -0800
3d677f0870

Add "from_draft" to GenerationResponse (#1272) Matt Clayton 2025-02-11 18:41:02 -0500
e1ee189ad1 fix generation evaluations Awni Hannun 2025-02-11 15:24:54 -0800
361e3547e8 fix sharding for more even number of layers Awni Hannun 2025-02-11 13:41:36 -0800
978deab589 small fix Goekdeniz-Guelmez 2025-02-11 17:48:42 +0100