ToF AR Components
Here is an overview of the components provided by ToF AR.
See the ToF AR reference articles in the development guide for more explanations and data formats.
ToF
Gives access to Depth Data, Confidence Data, and PointCloud Data of the ToF camera.
- ［Key features］
- Data acquisition
- Data display
- ToF camera control (change frame rates and exposure time, etc.)
Color
Gives access to RGB camera data.
- ［Key features］
- Data acquisition
- Data display
- RGB camera control（settings for resolution, auto-focus, auto-exposure, white balance, etc.)
Plane
Provides real-time recognition of planes, including the points selected in the Depth camera image.
- ［Key features］
- Plane data acquisition
- Creating a dynamic object in a Unity scene
Up to 8 recognition settings can be selected/obtained at once. Select null or a setting list with the element 0 to deactivate the plane recognition.
Mesh
Generates a real-time 3D mesh from Depth camera images.
- ［Key features］
- Vertex and triangle data acquisition
- Creating a dynamic mesh object inside a Unity scene
- Mesh optimization control
- Creating a mesh excluding masks generated by the Segmentation component
Coordinate
Converts coordinates among images with different resolutions from the Depth camera, RGB camera, and 3D camera. By accessing component properties, coordinate data can be acquired after conversion.
Hand
Provides real-time recognition of the human hand and finger joint positions from ToF camera images.
MarkRecog
Provides mark recognition in any optional binary images.
- ［Key feature］
- Mark recognition in an image
Modeling
Accumulates Depth data of the ToF camera across frames to generate 3D mesh data.
- ［Key features］
- Starting/ending 3D modeling
- Setting 3D modeling parameters
- Outputting data
- Creating a mesh excluding masks generated by the Segmentation component
ARFoundationConnector
Makes the co-existence of AR Foundation and ToF AR on Unity Project possible. When using the ARFoundationConnector, ToF AR does not directly control the camera in lower layers and uses output data frames of the RGB or ToF camera acquired from AR Foundation to activate Hand and Body recognition. This allows app developers to obtain data frames on the same interface from ToF AR regardless of the use of AR Foundation.
Body
Obtains data on recognition results through Body recognition-related processes.
- ［Key Features］
- Recognizes the Body by ToF camera images
- Displays the results of Body recognition
- Recognizes Body gestures
HumanDetector
Generates a mask texture by estimating human body parts from Color camera images.
AR Foundation Human Stencil / Human Depth
Generates a mask texture by acquiring Human Stencil data and Human Depth data from the AR Foundation. Available only for iOS.
Face
Acquires data on recognition results through Face recognition-related processes.
- ［Key Features］
- Outputs BlendShape data (Face recognition data in an AR Foundation compatible format)
- Displays Face recognition results
- Displays eye-tracking recognition results
Segmentation
Acquires data on recognition results through Segmentation recognition-related processes.
- ［Key Features］
- Generates a mask texture by estimating sky parts from Color camera images (when using SkyDetector)
- Generates a mask texture by estimating human body parts from Color camera images (when using HumanDetector)
SkyDetector
Generates a mask texture by estimating sky parts from Color camera images.