Autonomy, Army STTR, Phase I
Uncertainty and Model Predictive Control During Discontinuous Events in Autonomous Legged Robots
Objective
An autonomous legged robotic control system capable of navigating highly uneven, obstructed, and uncertain terrain.
Description
The future Warfighter will require autonomous robotic systems to traverse highly uneven, obstructed, and uncertain terrain at speed. Legged platforms are clear frontrunners to meet this requirement, but the control of such systems presents a substantial engineering challenge.
However, recent developments in hybrid dynamical systems (the branch of control engineering science that effectively models legged systems) and computational capability suggest that the time to address this challenge has arrived. New techniques in signal filtration and uncertainty characterization may be refined to create a controller capable of guiding a robotic platform across terrain that, up until now, has been impassable by an autonomous agent.
Successful performers will have to prove the validity of novel physics-based models and control frameworks for a quadruped robot in question for wide arrays of tasks and demonstrate superiority of this paradigm over learning-based control in specific situations. The results will be further streamlined and tested on current quadruped robots.
Phase I
Design, develop, and validate improved techniques for state estimation and uncertainty propagation in model predictive control of hybrid dynamical systems – specifically quadruped robots in dynamic and uncertain environments. Demonstrate proof-of-concept of this new control paradigm, and quantify its efficacy over the current state-of-the-art.
This demonstration should illustrate the ability of a quadruped robot to successfully autonomously navigate a test environment featuring sharply uneven terrain (roots and rocks whose characteristic length are on the order of, and slightly larger than, that of the quadruped foot) hidden underneath grass or grass-like obstructions whose height is on the order of the robot’s.
A successful demonstration will permit a quadruped to traverse ten body lengths at 0.5 body lengths per second over flat but uneven terrain featuring ground level variance and grass-like obstructions not exceeding 20% of the robot’s height.
Phase II
Design, develop, and validate broad techniques for state estimation and uncertainty propagation across a wide array of physical environments in which a quadruped robot may operate. Demonstrate integration with existing novel perception and sensing capability in a path-planning exercise whose terrain includes obstructions like those in the demonstration of Phase I.
Phase II should extend the methodologies of proprioception developed in Phase I to enable increased performance. Compare the efficacy of this new controller against that of traditional techniques such as deep reinforcement learning (DRL) controllers or Model Predictive Control (MPC). A successful demonstration will permit a quadruped to traverse a five body-length incline of +/- 20 degrees with root-like obstructions and slippery surfaces at 0.3 body lengths per second.
Phase III
The end-state control architecture should be mature enough to extrapolate locomotor performance to any number of scenarios, environments, and robotic platforms. The ideal resulting controllers will feature selective frameworks (such as a framework that could choose between MPC, DRL, etc.), and the inherent ability to determine what control technique is most effective for the task at hand. Production-ready controllers will also enable a robotic platform to extract itself from a “stuck” position in brush, soft soil, and/or rocky terrain.
Submission Information
Please refer to the 23.B BAA for more information. Proposals must be submitted via the DoD Submission site at https://www.dodsbirsttr.mil/submissions/login
References:
- Christopher Allred, Mason Russell, Mario Harper, and Jason Pusey. Improving methods for multi- terrain classification beyond visual perception. In 2021 Fifth IEEE International Conference on Robotic Computing (IRC), pages 96–99. IEEE, 2021.
- Berk Altın and Ricardo G Sanfelice. Model predictive control for hybrid dynamical systems: Sufficient conditions for asymptotic stability with persistent flows or jumps. In 2020 American Control Conference (ACC), pages 1791–1796. IEEE, 2020.
- Taylor Apgar, Patrick Clary, Kevin Green, Alan Fern, and Jonathan W Hurst. Fast online trajectory optimization for the bipedal robot cassie. In Robotics: Science and Systems, volume 101, page 14, 2018.
Objective
An autonomous legged robotic control system capable of navigating highly uneven, obstructed, and uncertain terrain.
Description
The future Warfighter will require autonomous robotic systems to traverse highly uneven, obstructed, and uncertain terrain at speed. Legged platforms are clear frontrunners to meet this requirement, but the control of such systems presents a substantial engineering challenge.
However, recent developments in hybrid dynamical systems (the branch of control engineering science that effectively models legged systems) and computational capability suggest that the time to address this challenge has arrived. New techniques in signal filtration and uncertainty characterization may be refined to create a controller capable of guiding a robotic platform across terrain that, up until now, has been impassable by an autonomous agent.
Successful performers will have to prove the validity of novel physics-based models and control frameworks for a quadruped robot in question for wide arrays of tasks and demonstrate superiority of this paradigm over learning-based control in specific situations. The results will be further streamlined and tested on current quadruped robots.
Phase I
Design, develop, and validate improved techniques for state estimation and uncertainty propagation in model predictive control of hybrid dynamical systems – specifically quadruped robots in dynamic and uncertain environments. Demonstrate proof-of-concept of this new control paradigm, and quantify its efficacy over the current state-of-the-art.
This demonstration should illustrate the ability of a quadruped robot to successfully autonomously navigate a test environment featuring sharply uneven terrain (roots and rocks whose characteristic length are on the order of, and slightly larger than, that of the quadruped foot) hidden underneath grass or grass-like obstructions whose height is on the order of the robot’s.
A successful demonstration will permit a quadruped to traverse ten body lengths at 0.5 body lengths per second over flat but uneven terrain featuring ground level variance and grass-like obstructions not exceeding 20% of the robot’s height.
Phase II
Design, develop, and validate broad techniques for state estimation and uncertainty propagation across a wide array of physical environments in which a quadruped robot may operate. Demonstrate integration with existing novel perception and sensing capability in a path-planning exercise whose terrain includes obstructions like those in the demonstration of Phase I.
Phase II should extend the methodologies of proprioception developed in Phase I to enable increased performance. Compare the efficacy of this new controller against that of traditional techniques such as deep reinforcement learning (DRL) controllers or Model Predictive Control (MPC). A successful demonstration will permit a quadruped to traverse a five body-length incline of +/- 20 degrees with root-like obstructions and slippery surfaces at 0.3 body lengths per second.
Phase III
The end-state control architecture should be mature enough to extrapolate locomotor performance to any number of scenarios, environments, and robotic platforms. The ideal resulting controllers will feature selective frameworks (such as a framework that could choose between MPC, DRL, etc.), and the inherent ability to determine what control technique is most effective for the task at hand. Production-ready controllers will also enable a robotic platform to extract itself from a “stuck” position in brush, soft soil, and/or rocky terrain.
Submission Information
Please refer to the 23.B BAA for more information. Proposals must be submitted via the DoD Submission site at https://www.dodsbirsttr.mil/submissions/login
References:
- Christopher Allred, Mason Russell, Mario Harper, and Jason Pusey. Improving methods for multi- terrain classification beyond visual perception. In 2021 Fifth IEEE International Conference on Robotic Computing (IRC), pages 96–99. IEEE, 2021.
- Berk Altın and Ricardo G Sanfelice. Model predictive control for hybrid dynamical systems: Sufficient conditions for asymptotic stability with persistent flows or jumps. In 2020 American Control Conference (ACC), pages 1791–1796. IEEE, 2020.
- Taylor Apgar, Patrick Clary, Kevin Green, Alan Fern, and Jonathan W Hurst. Fast online trajectory optimization for the bipedal robot cassie. In Robotics: Science and Systems, volume 101, page 14, 2018.