Amazing stuff! This could be a breakthrough!
The researchers of this paper are with Robotics and AI Institute, which seems to be in a sort of stealth mode as it appears it has not published anything recently on ZEST. E.g. searching for ZEST on their website results in nothing. None of the authors of this paper are familiar to me.
Notice only about 7 months elapsed between preprint date and journal article date. This is unusually fast.
From the abstract:
"Achieving robust, humanlike whole-body control on humanoid robots for agile, contact-rich behaviors remains a central challenge, demanding heavy per-skill engineering and a brittle process of tuning controllers.
We introduce ZEST (zero-shot embodied skill transfer), a streamlined motion-imitation framework that trains policies via reinforcement learning from diverse sources—high-fidelity motion capture, noisy monocular video, and non–physics-constrained animation—and deploys them to hardware zero-shot.
ZEST generalizes across behaviors and platforms without relying on contact labels, reference or observation windows, state estimators, or extensive reward shaping.
Its training pipeline combines adaptive sampling, which focuses training on difficult motion segments, and an automatic curriculum using a model-based assistive wrench, together enabling dynamic, long-horizon maneuvers.
We further provide a procedure for selecting joint-level gains from approximate analytical armature values for closed-chain actuators, along with a refined model of actuators. Trained entirely in simulation with moderate domain randomization, ZEST demonstrated broad generality.
On Boston Dynamics’ Atlas humanoid, ZEST learned dynamic, multicontact skills (army crawl and breakdancing) from motion capture. It transferred expressive dance and scene-interaction skills, such as box climbing, directly from videos to Atlas and the Unitree G1.
Furthermore, it extended across morphologies to the Spot quadruped, enabling acrobatics, such as a continuous backflip, through animation.
Together, these results demonstrate robust zero-shot deployment across heterogeneous data sources and embodiments, establishing ZEST as a scalable interface between biological movements and their robotic counterparts."
ZEST: Zero-shot embodied skill transfer for athletic robot control (no public access)
ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control (preprint, open access)
No comments:
Post a Comment