Motion Tracking

ToF AR’s human skeleton estimation function uses distance data, which allows a highly accurate 3D skeleton estimation compared to color cameras.

Since regular color camera images lose distance data, skeleton estimations are calculated based on joint points and presented as relative coordinates. Although the absolute coordinates may be calculated based on the camera with these relative coordinates, complete recovery of the once-lost distance data is in principle difficult. The coordinate calculation results may diverge significantly from the actual distance depending on the scene.

On the other hand, ToF AR’s skeleton estimation using distance data directly estimates absolute coordinates based on the camera, which allows a highly accurate 3D skeleton estimation. When we check the skeleton plotted on the 3D space, we can see how high the accuracy of the skeleton estimation made by ToF AR is.

This highly accurate skeleton estimation function, including distance data, supports application development requiring accuracy, such as natural control of 3D avatars and interactions with AR objects.