Issues

• Typo in docs/utils/mpi.rst: duplicate word "a a"

  openai/spinningup#463 · Filter by author 000wahab000 opened on Sep 18, 2026
  2

• Upgrade plans to later Python & Gymnasium

  openai/spinningup#458 · Filter by author keivanzavari opened on Mar 30, 2026

• Add recommended system requirements for running in a Ubuntu VM

  openai/spinningup#456 · Filter by author thomaswatters opened on Jan 8, 2026

• Documentation update

  openai/spinningup#455 · Filter by author noor-malaika opened on Jan 5, 2026

• Simplest policy gradient code implementation assumes uniform episode lengths?

  openai/spinningup#454 · Filter by author HimanshuKhanchandani opened on Dec 31, 2025

• Is This the Best RL Implementation for Robotics Simulation (e.g., PPO)?

  openai/spinningup#447 · Filter by author Rooshy-yang opened on Jun 11, 2025

• Links broken to content.

  openai/spinningup#446 · Filter by author clars867 opened on Jun 5, 2025
  1

• Spinning Up not working on M1 MacBooks – Working fork with fixes

  openai/spinningup#444 · Filter by author tae-h-yang opened on Apr 1, 2025
  1

• TRPO KL Divergence Direction

  openai/spinningup#443 · Filter by author rqi3 opened on Mar 10, 2025

• Failed to integrate with CUDA GPU

  openai/spinningup#440 · Filter by author LYK-love opened on Feb 7, 2025
  1

• Working simplified version of Spinning Up that works on Windows + Pytorch (CPU)

  openai/spinningup#437 · Filter by author jchiwai opened on Jan 12, 2025

• Why is there a minus sign in the loss function of simplest policy gradient in part 3?

  openai/spinningup#436 · Filter by author inv1s10n opened on Jan 9, 2025
  2

• issue: watch a video of the trained policy

  openai/spinningup#435 · Filter by author Aroopjosy opened on Jan 3, 2025

• Rewards-to-Go issue

  openai/spinningup#433 · Filter by author Raymondliz opened on Dec 30, 2024

• Chapter 11 in PDF version of the docs is problematic

  openai/spinningup#431 · Filter by author HailinRen opened on Dec 23, 2024

• Link broken in file rl_intro3.rst

  openai/spinningup#429 · Filter by author Doublelup opened on Nov 28, 2024
  1

• Error: python setup.py egg_info did not run successfully

  openai/spinningup#428 · Filter by author Choutouridis opened on Nov 24, 2024

• ModuleNotFoundError: No module named 'spinup.algos'

  openai/spinningup#427 · Filter by author ger3tto opened on Nov 20, 2024
  2

• sharing my minimalist, simple and clear implementation of spinning-up

  openai/spinningup#425 · Filter by author tesla-cat opened on Oct 20, 2024

• BUG VPG: pi_info_old seems to be the same as pi_info

  openai/spinningup#424 · Filter by author tesla-cat opened on Oct 20, 2024
  2

• libgl error

  openai/spinningup#423 · Filter by author hanjoonwon opened on Oct 6, 2024
  1

• Dead link in RL Intro

  openai/spinningup#420 · Filter by author shelwinsunga opened on Sep 13, 2024

• maybe Error in the formula in the introduction chapter of RL

  openai/spinningup#419 · Filter by author yulong-ge opened on Sep 2, 2024

• Cannot install python 3.6 in mac using conda

  openai/spinningup#415 · Filter by author ZisenShao opened on Jul 4, 2024
  5

• The compute_loss function is wrong for the Simplest Policy Gradient

  openai/spinningup#414 · Filter by author alantpetrescu opened on Jun 5, 2024
  3