Here, for each of the subtasks obtained in “Decomposition into subtasks,” the available tracking DOF were investigated using the following steps:

Step 1. Check the available tracking DOF used for the user tracking throughout the entire task.

For the entire task (all the subtasks), check the available tracking DOF that can be used in conjunction with the HMD used.

List of tracking DOF that can be used with representative HMDs

Representative HMD The available tracking DOF
HoloLens 3D position and rotation
Magic Leap 3D position and rotation
Google Glass V1 3D rotation

Step 2. Check the available tracking DOF for tracking the object in each of the subtasks.

Depending on the type of subtasks, considering the “target object” and the “installation location” (for details, check the list of subtasks), check all the types of object tracking and their respective degrees of freedom that is necessary for all the target objects of the subtasks.

List of representative technologies for object tracking and the available tracking types and respective degrees of freedom

Representative technology example Object tracking types The available tracking DOF
In case of detection and recognition of the AR (rectangular) markers (affixed to the objects) performed with the camera (mounted) on HMD HMD-based

3D position and rotation

(6DoF)

In case of detection and recognition of the small spherical markers (affixed to the objects) performed with the camera mounted on HMD HMD-based

3D position

(3D Pos)

In case of detection and recognition of the AR (rectangular) markers (affixed to the objects) performed with a camera installed in the environment Global coordinate based 3D position and rotation
(when object tracking cannot be performed) - (N/A)

Example: In the case of the designing software under the following condition, use the “Task breakdown” example

Condition

User tracking

- When using the HoloLens functions, always enable the collection of 3D position and rotation information of the HMD.

Object tracking

- Enable the collection of 3D position and rotation information for the initial position of the block.

- Thereafter, the tracking of the block will not be performed and will be treated as N/A.

- Since the foundation (plate) is fixed in the global coordinate system, always enable the collection of 3D position and rotation information.

Available tracking DOF for each subtask

Subtask NumberSubtask contentSubtask TypeUser TrackingObject Tracking
1Pick up the blue block (2 × 4).(S1)6DoFTarget object:6DoF
2Place the blue block (2 × 4) on the foundation (plate) five spaces (stud spacing) from the left edge and three spaces (stud spacing) from the lower edge of the foundation.(S3)6DoFTarget object:N/A, Installation Site: 6DoF
3Pick up the blue block (2 × 2).(S1)6DoFTarget object:6DoF
4Place the blue block (2 × 2) on the foundation four spaces (stud spacing) from the left edge and two spaces (stud spacing) from the upper edge of the blue block (2 × 4) that has already been placed.(S3)6DoFTarget object:N/A, Installation Site: 6DoF
5Pick up the yellow block (2 × 4).(S1)6DoFTarget object:6DoF
6Place the yellow block (2 × 4) on the foundation four spaces (stud spacing) from the right edge, and two spaces (stud spacing) from the lower edge of the already-placed blue block (2 × 4).(S3)6DoFTarget object:N/A, Installation Site: 6DoF
7Pick up the red block (2 × 4)(S1)6DoFTarget object:6DoF
8Place the red block (2 × 4) on the already-placed blue (2 × 2) and yellow block (2 × 4).(S2)6DoFTarget object:N/A, Installation Site: 6DoF

After determining the available degrees of freedom for the user tracking of the entire task and the types of available degrees of freedom for object tracking for each of the subtasks, proceed to the next stage (“Information presentation method selection tool”).

Information Design Table
User Tracking DOF:
Subtask Number Subtask Content Subtask Type Object Tracking Information-presentation Method Operation
Add this row below(), Delete this row(), Replace below()
Target object: