Monolithic fused head-loss kernel (torch.compile) (#507)#549

Merged

jlamypoirier merged 37 commits into

mainfrom

jlp_monolithic_head_loss

Jul 20, 2026

Commits on Jun 26, 2026

Monolithic head-loss kernel: scaffolding + cross-entropy (#507)

jlamypoirier
and
claude
committed
Monolithic head-loss kernel: add z-loss (#507)

jlamypoirier
and
claude
committed
Monolithic head-loss kernel: add from-distribution KL losses (#507)

jlamypoirier
and
claude
committed

Commits on Jun 27, 2026

Monolithic head-loss kernel: wire distillation + fix dropped temperature (#507)

jlamypoirier
and
claude
committed
Monolithic head-loss kernel: GRPO objective + new_logprobs (#507)

jlamypoirier
and
claude
committed

Commits on Jun 29, 2026

Commits on Jun 30, 2026

Commits on Jul 2, 2026

Commits on Jul 3, 2026

Commits on Jul 7, 2026

Fuse GSPO into the monolithic compiled loss (#507) (#552)

jlamypoirier
and
claude
authored

Commits on Jul 8, 2026

Fuse the GSPO segment seam into compiled blocks (#507) (#554)

jlamypoirier
and
claude
authored

Commits on Jul 10, 2026

Commits on Jul 13, 2026

Policy metrics in the compiled monolithic loss (#507) (#565)

jlamypoirier
and
claude
authored

Commits on Jul 14, 2026

Triton monolithic head-loss kernel (#507) (#558)

jlamypoirier
and
claude
authored

Commits on Jul 15, 2026

Fuse distillation + z-loss in the triton monolithic path (#507) (#566)

jlamypoirier
and
claude
authored

Commits on Jul 16, 2026

Commits on Jul 20, 2026