• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer
  • IEEE.org
  • IEEE Xplore
  • IEEE Standards
  • IEEE Spectrum
  • More Sites

IEEE Robotics & Automation Magazine

  • IEEE.org
  • IEEE Xplore
  • IEEE Standards
  • IEEE Spectrum
  • More Sites

Tumbling Robot Control Using Reinforcement Learning: An Adaptive Control Policy That Transfers Well to the Real World

June 28, 2023 by Andrew Schwartzwald

Tumbling robots are simple platforms that are able to traverse large obstacles relative to their size, at the cost of being difficult to control. Existing control methods apply only a subset of possible robot motions and make the assumption of flat terrain. Reinforcement learning (RL) allows for the development of sophisticated control schemes that can adapt to diverse environments. By utilizing domain randomization while training in simulation, a robust control policy can be learned that transfers well to the real world. In this article, we implement autonomous set point navigation on a tumbling robot prototype and evaluate it on flat, uneven, and valley–hill terrain. Our results demonstrate that RL-based control policies can generalize well to challenging environments that were not encountered during training. The flexibility of our system demonstrates the viability of nontraditional robots for navigational tasks.

For more about this article see link below.

https://ieeexplore.ieee.org/document/9845375

For the open access PDF link of this article please click here.

Filed Under: Past Features Tagged With: Adaptation models, Collision avoidance, Friction, Legged locomotion, Numerical models, Prototypes, Reinforcement learning, Robot motion, Robots, Robust control, Servomotors

Primary Sidebar

Current Issue

Get the entire issue now.

About the Magazine

IEEE Robotics & Automation Magazine (RAM) has over 14,000 readers who are the people who drive this remarkable technology. More than half work in basic research and many of the others are top level engineers and decision-makers in industry.  This magazine highlights new concepts in Robotics and Automation that are applied to real-world systems. It delivers tutorial and survey papers by distinguished experts in the field, organizes focused special issues on hot topics, and provides a forum for disseminating and discussing emerging trends, novel achievements, and selected news relevant to the development of the whole community active in these fields worldwide.

Past Issues

Search

Footer

LINKS

Home | Contact IEEE | Accessibility |
Nondiscrimination  Policy | IEEE Ethics Reporting | Terms & Disclosures| IEEE Privacy Policy

© Copyright 2025 IEEE – All rights reserved. A public charity, IEEE is the world’s largest technical professional organization dedicated to advancing technology for the benefit of humanity.

ABOUT US

IEEE Robotics & Automation Magazine  publishes four issues per year: March, June, September and December.