Pose tracking is the continuous estimation of the position and orientation (6-DoF pose) of a device, user, or body over time. In spatial computing it underpins head, hand, and controller tracking for AR and VR, fusing camera, IMU, and depth data at low latency. Accurate, drift-free pose tracking is essential for stable, comfortable immersive experiences.

Content

  • Inside-out tracking fuses visual feature tracking with high-rate inertial measurements to estimate pose with low latency and minimal drift. Techniques include visual-inertial odometry, SLAM, and learned keypoint detection. Tight calibration and prediction reduce motion-to-photon latency, which is critical for avoiding discomfort in head-mounted displays.