Issues

• Rename forest-training call-linking fields (request_replay, candidate_replay, …) in Gym and RL

  DocumentationFeature
  NVIDIA-NeMo/RL#5123 · Filter by author terrykong opened on Nov 8, 2026
  

• Megatron Inference token capture: forest training loses capture on every continued Gym call

  NVIDIA-NeMo/RL#5119 · Filter by author terrykong opened on Nov 7, 2026
  

• SingleController: consolidate EOF tails and allow borrowing without raw-prompt repayment

  bug
  NVIDIA-NeMo/RL#5099 · Filter by author RayenTian opened on Nov 6, 2026

• [Tracking] AutoModel backend support for Single Controller

  Feature
  NVIDIA-NeMo/RL#5090 · Filter by author sharonyu-115 opened on Nov 5, 2026
  

• Megatron critic does not mask router padding outside Forest

  bug
  NVIDIA-NeMo/RL#5089 · Filter by author bg51717 opened on Nov 5, 2026
  

• Investigate recurring median probability-error failures in DAPO Mistral Medium 3.5 128B

  accuracybug
  NVIDIA-NeMo/RL#5071 · Filter by author terrykong opened on Nov 4, 2026

• refactor(config): split checkpointing into save and load sections

  NVIDIA-NeMo/RL#5067 · Filter by author yuki-97 opened on Nov 4, 2026

• Async GRPO rejects DAPO reward scaling: scale_rewards is not applied in async_grpo_train

  community-requestFeature
  NVIDIA-NeMo/RL#5062 · Filter by author linmuchuiyang opened on Nov 4, 2026

• SingleController parity with legacy GRPO/PPO: remaining features and validation gaps

  Feature
  NVIDIA-NeMo/RL#5044 · Filter by author yuki-97 opened on Nov 3, 2026

• Align v1's dynamic-sampling reward metrics with the SingleController naming

  bugDocumentation
  NVIDIA-NeMo/RL#5039 · Filter by author RayenTian opened on Nov 3, 2026

• Rollout marks EOS-terminated responses as truncated when the final environment observation is cut

  bugcommunity-request
  NVIDIA-NeMo/RL#5016 · Filter by author damienen opened on Nov 2, 2026

• refactor(reward-penalties): share one malformed-think-tag predicate between the echo and capture paths

  enhancement
  NVIDIA-NeMo/RL#5008 · Filter by author bg51717 opened on Oct 31, 2026
  

• data-plane: keep CUDA work on each rank's own GPU (follow-up to #4966)

  bug
  NVIDIA-NeMo/RL#5004 · Filter by author zyzhou5 opened on Oct 30, 2026

• feat(generation): add CoreWeave Dedicated Inference backend with checkpoint hot-load

  community-requestFeaturewaiting-on-maintainers
  NVIDIA-NeMo/RL#4964 · Filter by author anson627 opened on Oct 28, 2026

• Generation-node restart: replacement refit fails and router ignores new endpoints

  bug
  NVIDIA-NeMo/RL#4937 · Filter by author zyzhou5 opened on Oct 27, 2026

• bbox_giou_reward is unbounded: reversed-corner or NaN boxes score far above 1 (RefCOCO env)

  bugcommunity-request
  NVIDIA-NeMo/RL#4871 · Filter by author jimmy-holdout opened on Oct 23, 2026

• feat: generalize run_rollout_only.py into a single-controller simulator

  Feature
  NVIDIA-NeMo/RL#4860 · Filter by author yuki-97 opened on Oct 22, 2026
  

• Consider native async TQ APIs for async data-plane callers

  Speed
  NVIDIA-NeMo/RL#4848 · Filter by author zyzhou5 opened on Oct 21, 2026

• Megatron policy can't start from a builder-format Megatron Bridge checkpoint (pretrained_checkpoint.format: megatron_bridge)

  bug
  NVIDIA-NeMo/RL#4841 · Filter by author kamran-nvidia opened on Oct 21, 2026

• fix(xtoken): ordinary chat mode mis-supervises a final assistant turn with prose and tool_calls

  bug
  NVIDIA-NeMo/RL#4831 · Filter by author yuki-97 opened on Oct 21, 2026
  

• Use Gym’s exported server-type keys

  bug
  NVIDIA-NeMo/RL#4800 · Filter by author zyzhou5 opened on Oct 20, 2026

• Track Nano 3.5 PIECEWISE logprob-error tail spikes in r0.8.0 validation

  accuracybug
  NVIDIA-NeMo/RL#4777 · Filter by author fujial-code opened on Oct 18, 2026

• PPO and xtoken off-policy distillation ignore checkpointing.pretrained_checkpoint

  bug
  NVIDIA-NeMo/RL#4768 · Filter by author terrykong opened on Oct 17, 2026
  1

• refactor: consolidate Rollout Routing Replay (R3) code under nemo_rl/router_replay/

  NVIDIA-NeMo/RL#4767 · Filter by author yuki-97 opened on Oct 17, 2026

• [Bug] tilelang==0.1.11 pin in the automodel extra is x86-only; on aarch64 (GB200) the Automodel venv gets tilelang 0.1.12, tile_kernels cannot import, and DeepSeek-V4.1 training fails at the first forward

  bugcommunity-request
  NVIDIA-NeMo/RL#4754 · Filter by author linmuchuiyang opened on Oct 16, 2026