OmniTrack: General Motion Tracking
via Physics-Consistent Reference

Yuhan Li1,2* Peiyuan Zhi2* Yunshen Wang2,3 Tengyu Liu2 Sixu Yan1,2 Wenyu Liu1
Xinggang Wang1 Baoxiong Jia2 Siyuan Huang2
1 Huazhong University of Science and Technology
2 State Key Lab of General AI, Beijing Institute for General Artificial Intelligence (BIGAI)
3 Shanghai Jiao Tong University
* Equal contribution ✉ Corresponding authors

Abstract

Learning motion tracking from rich human motion data is a foundational task for achieving general control in humanoid robots, enabling them to perform diverse behaviors. However, discrepancies in morphology and dynamics between humans and robots, combined with data noise, introduce physically infeasible artifacts in reference motions, such as floating and penetration. During both training and execution, these artifacts create a conflict between following inaccurate reference motions and maintaining the robot's stability, hindering the development of a generalizable motion tracking policy. To address these challenges, we introduce OmniTrack, a general tracking framework that explicitly decouples physical feasibility from general motion tracking. In the first stage, a privileged generalist policy generates physically plausible motions that strictly adhere to the robot's dynamics via trajectory rollout in simulation. In the second stage, the general control policy is trained to track these physically feasible motions, ensuring stable and coherent control transfer to the real robot. Experiments show that OmniTrack improves tracking accuracy and demonstrates strong generalization to unseen motions. In real-world tests, OmniTrack achieves hour-long, consistent, and stable tracking, including complex acrobatic motions such as flips and cartwheels. Additionally, we show that OmniTrack supports human-style stable and dynamic online teleoperation, highlighting its robustness and adaptability to varying user inputs.

OmniTrack Framework

Result Demonstrations

Online Teleoperation

One-hour Tracking

Long-Horizon Tracking

Continuous 1-hour demo.

Consecutive Side Flips

17 Consecutive Side Flips

Continuous side-flip sequence with 17 repetitions.

Diverse Motion Tracking

Diverse Motion Tracking with One Policy

All motions shown here are executed by a single unified policy.

More Results

All motion results are generated by the same unified policy.

BibTeX

@article{omnitrack2026,
  title   = {OmniTrack: General Motion Tracking via Physics-Consistent Reference},
  author  = {Yuhan, Li and et al.},
  journal = {arXiv preprint arXiv:2602.23832},
  year    = {2026}
}