An introduction to Policy Gradient methods – Deep Reinforcement Learning
In this episode I introduce Policy Gradient methods for Deep Reinforcement Learning.
After a general overview, I dive into Proximal Policy Optimization: an algorithm designed at OpenAI that tries to find a balance between sample efficiency and code complexity. PPO is the algorithm used to train the OpenAI Five system and is also used in a wide range of other challenges like Atari and robotic control tasks.
If you want to support this channel, here is my patreon link:
https://patreon.com/ArxivInsights --- You are amazing!! ;)
If you have questions you would like to discuss with me personally, you can book a 1-on-1 video call through Pensight: https://pensight.com/x/xander-steenbrugge
Links mentioned in the video:
β¦ PPO paper: https://arxiv.org/abs/1707.06347
β¦ TRPO paper: https://arxiv.org/abs/1502.05477
β¦ OpenAI PPO blogpost: https://blog.openai.com/openai-baselines-ppo/
β¦ Aurelien Geron: KL divergence and entropy in ML: https://youtu.be/ErfnhcEV1O8
β¦ Deep RL Bootcamp - Lecture 5: https://youtu.be/xvRrgxcpaHY
β¦ RL-adventure PyTorch implementation: https://github.com/higgsfield/RL-Adventure-2
β¦ OpenAI Baselines TensorFlow implementation: https://github.com/openai/baselines
In this episode I introduce Policy Gradient methods for Deep Reinforcement Learning.
After a general overview, I dive into Proximal Policy Optimization: an algorithm designed at OpenAI that tries to find a balance between sample efficiency and code complexity. PPO is the algorithm used to train the OpenAI Five system and is also used in a wide range of other challenges like Atari and robotic control tasks.
If you want to support this channel, here is my patreon link:
https://patreon.com/ArxivInsights — You are amazing!! π
If you have questions you would like to discuss with me personally, you can book a 1-on-1 video call through Pensight: https://pensight.com/x/xander-steenbrugge
Links mentioned in the video:
β¦ PPO paper: https://arxiv.org/abs/1707.06347
β¦ TRPO paper: https://arxiv.org/abs/1502.05477
β¦ OpenAI PPO blogpost: https://blog.openai.com/openai-baselines-ppo/
β¦ Aurelien Geron: KL divergence and entropy in ML: https://youtu.be/ErfnhcEV1O8
β¦ Deep RL Bootcamp – Lecture 5: https://youtu.be/xvRrgxcpaHY
β¦ RL-adventure PyTorch implementation: https://github.com/higgsfield/RL-Adventure-2
β¦ OpenAI Baselines TensorFlow implementation: https://github.com/openai/baselines
