Skip to content

Pull requests: huggingface/trl

New pull request New
117 Open 2,861 Closed
117 Open 2,861 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add JEPO trainer
#5411 opened Mar 31, 2026 by zbills Loading…
3 of 7 tasks
4
Add log_multimodal param to GRPOConfig and RLOOConfig to control image logging
#5408 opened Mar 30, 2026 by apardyl Loading…
3 of 8 tasks
4
Add DistillationTrainer for efficient on-policy distillation
#5407 opened Mar 30, 2026 by cmpatino Loading…
8 tasks
10
Add length-normalized sigmoid loss type to DPO trainer
#5406 opened Mar 30, 2026 by BrownianNotion Loading…
5 of 8 tasks
1
5
Mark as strict the xfail tests with zero3 for RLOO and GRPO
#5404 opened Mar 30, 2026 by albertvillanova Loading…
1
Fix flaky CI test_rloo[fsdp2]: Replace non-deterministic xfail with skipif for transformers 5.4.0
#5403 opened Mar 30, 2026 by albertvillanova Loading…
1
Remove xfail for Qwen3VL CI tests
#5402 opened Mar 30, 2026 by albertvillanova Loading…
2
Fix CI slow-tests cannot remove: No such file or directory
#5401 opened Mar 30, 2026 by albertvillanova Loading…
1
Add per-sample tool filtering to GRPOTrainer via tools column
#5398 opened Mar 27, 2026 by lailanelkoussy Loading…
3 tasks done
30
Better test consistency RLOO vs GRPO
#5396 opened Mar 27, 2026 by qgallouedec Loading…
1
Add tool calling support to RLOOTrainer
#5395 opened Mar 27, 2026 by qgallouedec Loading…
11
feat(grpo): add stop_tool_names for immediate agent loop termination
#5390 opened Mar 27, 2026 by lailanelkoussy Loading…
1
13
Remove xfail for ZeRO 2 and 3 + SFT + PEFT test
#5383 opened Mar 27, 2026 by qgallouedec Loading…
2
Fix DAPO token-level loss to use prompt-level aggregation
#5381 opened Mar 26, 2026 by matdou Loading…
2 of 5 tasks
1
6
Remove truncation_mode from DPO
#5372 opened Mar 25, 2026 by albertvillanova Loading…
8
[vllm-serve] Add extra_llm_kwargs for passing additional arguments to vllm.LLM()
#5367 opened Mar 25, 2026 by jonahsamost Loading…
1 of 5 tasks
10
add more generaic device suppport for CI tests
#5357 opened Mar 24, 2026 by kaixuanliu Loading…
1
Add chunked LM head for memory-efficient log-prob computation for AsyncGRPOTrainer
#5349 opened Mar 23, 2026 by AmineDiro Loading…
25
[Test] Fix *test_training_vlm_multi_image* by skipping vision params in assertion
#5341 opened Mar 22, 2026 by YangKai0616 Loading…
5
Fix Liger kernel crash with device_map="auto" on multi-GPU in GRPOTrainer
#5340 opened Mar 22, 2026 by YangKai0616 Loading…
8
Enable Tensor Parallelism in SFT script
#5331 opened Mar 21, 2026 by songhappy Loading…
2
Support multimodal tool responses in environment_factory for VLM training
#5323 opened Mar 20, 2026 by sergiopaniego Loading…
5 tasks
27
(5/5) async grpo metrics
#5322 opened Mar 20, 2026 by AmineDiro Loading…
6
(4/5) async grpo break out of generation loop (is_done)
#5321 opened Mar 20, 2026 by AmineDiro Loading…
6
(3/5) Cancel Stale inflight tasks
#5320 opened Mar 20, 2026 by AmineDiro Loading…
10
ProTip! no:milestone will show everything without a milestone.