Head Tracking Setup

Prev Next

This section explains how to set up and use head tracking with the Unity AAC app. The head tracking feature allows individuals who are unable to use their hands to alternatively use small head movements to control where the pointer moves on the screen. The front camera in your device translates these head movements into pointer movements and activations/selections on the screen.

Note: Head tracking is only available on iOS devices or iPadOS devices that have a front-facing TrueDepth® camera.

Turn Head Tracking On or Off

To access the head tracking settings, select Menu > Settings and scroll to the Head Tracking section. Select Enable Head Tracking to turn head tracking on or off.

The first time you enable head tracking:

  1. You will be prompted to calibrate: “Calibration Needed: Your cursor may not be accurate. Please calibrate now.”

  2. Select Calibrate and perform the calibration procedure. If you aren’t ready to calibrate, select Later.

  3. You will be prompted to allow access to the device’s front-facing camera. Select OK. If you don’t allow access, you will not be able to use head tracking. If the message “Camera Permission Denied” appears, see the resolution under Troubleshooting.


Position the User

⚠️ Analysis of positioning by a qualified person is required to prevent repetitive stress injuries to the user.

Position the user approximately 12 to 36 inches from the device screen. You may find that the user has more control when located toward the lower end of that range.

If someone is sitting beside the user, try to position the device to face the user as much as possible. If the camera detects two faces, the head tracking system will choose the largest or most clearly recognizable face.


Head Tracking Settings

It is important to adjust the head tracking settings in the app to work best for the individual who will be using it.

Important: Because head tracking depends on the user’s head movement capabilities, these instructions only cover the setup basics. You may need to refine your settings several times. We suggest changing one setting at a time as the user adjusts.

Change a setting

  1. Select Menu > Settings and scroll to the Head Tracking section.

  2. Select the setting you want to change. A list of options will be displayed.

  3. Select the option you want.

  4. Select Done.

Available Settings

Enable Head Tracking

Turn head tracking on or off. When you turn Enable Head Tracking on, all the head tracking settings are displayed.

Cursor Adjustment

Cursor Adjustment allows you to adjust the relative position of the cursor when the user is unable to be positioned directly in front of the device.

Select Center to adjust the position of the cursor so that it is centered with respect to the user’s current head position. If you change the orientation or the position of the device relative to the user, you may need to re-center the cursor.

For example, a device is mounted slightly to the left of the user on a wheelchair. Because of this, when the user looks straight ahead, the cursor may appear shifted to the right. To compensate for this, have the user position his or her head at a comfortable, natural starting position and then select Center. This will automatically adjust the cursor so that it is once again centered on the screen, relative to the user.

When you select Center, the cursor is hidden temporarily and the centering image appears in the center of the screen. Have the user look at the image until the image disappears (after three seconds). The cursor will be centered.

Tip: You can also center the cursor by creating a Center button in your vocabulary.

  1. Navigate to the page that includes the button you want to use.

  2. Select Menu, select Edit Page, select the button you want to use, and select Edit This Button.

  3. Give the button a name that describes its purpose.

  4. Scroll to the Button Actions section.

  5. Select Add.

  6. Scroll through the list of actions and select Center Head Tracking.

  7. Select Save. Select Done to exit edit mode.

Tracking Speed

The relative speed at which the cursor moves on the screen for each head movement. Choose from the following tracking speeds: Very Slow, Slow (default), Normal, Fast, and Very Fast. The slower settings require greater head movement; the faster settings require less head movement.

Cursor Shape

The type of cursor that is displayed to indicate head position as you move your head and make selections. You can indicate head position by cursor, by highlight, or by both at the same time.

Choose from the following cursor shapes:

Dot (default)A red opaque dot Screenshot of red dot

Crosshair — A plus symbol with lines intersecting at the center Screenshot of crosshair

Arrow — A black opaque pointer Screenshot of an arrow

If you set Cursor Shape to None, it is best to turn the Highlight Buttons setting on. If you have Highlight Buttons turned off, there will be no visible cursor and you will have no visible way to track head movement.

Off-Screen Indicator

Indicates when head movement is taking the cursor off the screen to the left, right, top, bottom, or any corner. Choose from the following off-screen indicators.

None — No off-screen indicator will appear

Dot — A dot will appear at the edge of the screen. The dot gets larger the farther off-screen you move.

Triangle (default) — A triangle will appear at the edge of the screen

Trigger Action

The head or face action that will make an activation. When you stop moving your head to point at the item you want, the cursor appears on that item or the item is highlighted. The selected action then activates the item. Choose from the following trigger actions.

None — No activations will be made

Hover — When you point at an item for an extended time, a circle begins to form around the cursor. For example:  Example of a circle forming around the arrow cursor.. When the circle is complete (determined by your Hover Time setting), the item is activated. If you point away from the item before the circle is complete, the item is not activated.

Note: When you select Hover as the trigger action, the setting Hover Time replaces the setting Trigger Sensitivity.

Important: If you select Hover as the trigger action, do not attempt to pause head tracking. Currently, the hover trigger will not resume head tracking.

Blink (default) — Blink your eyes to make an activation.

Mouth Open — Open your mouth to make an activation.

Eyebrows Up — Raise your eyebrows to make an activation

Tongue Out — Stick out your tongue to make an activation

Smile — Smile to make an activation

Frown — Frown to make an activation

Trigger Sensitivity

The degree of trigger movement required to make an activation. Choose Low, Medium, or High (default).

Note: When you select Hover as the trigger action, the setting Hover Time replaces the setting Trigger Sensitivity.

Rest Area

The rest area is an inactive area surrounding the last activation point. This area allows the user to rest before moving to the next activation. When the user is within the rest area, head-tracking does not make activations via any trigger action. To access the rest area settings, choose Rest Area from the Head Tracking settings. The rest area settings will be displayed.

To activate the rest area: Select the Rest Area On/Off button to turn the rest area On. Turning the button on activates the rest area and the rest area settings.

Note: When the Rest Area On/Off button is turned Off, the rest area settings are not available.

To set the size of the rest area: Select Rest Area Size to open a window for adjusting the size of the rest area radius. Select a value and choose OK.

Note: Even if Rest Area Size value is set to Off, the “Use Button as Rest Area” option is still available.

To use the last vocabulary button activated as the rest area: Select Use Button as Rest Area. The last vocabulary button activated becomes the rest area. While the pointer is within the button, head tracking does not make any activations, allowing the user to rest. “Show rest area” and “Rest area size” are not needed and are therefore not available when User Button as Rest Area is selected.

To make the rest area visible on the screen: Select Show Rest Area. A light circle will outline the rest area perimeter. Selecting Show Rest Area does not enable the rest area itself. It merely makes the rest area visible on the screen. The Rest Area On/Off setting (see above) enables and disables the rest area. To leave the rest area: To leave the rest area and resume making activations, the user simply moves the pointer out of the rest area circle or off the vocabulary button used as the rest area.

Trigger Indicator

The visual indication that an item has been activated. Choose one of these indicators:

None — No visual indicator

Dot — A light-colored, transparent dot  

Pop (default) — A starburst  

Note: A red X appears when you try to use your trigger action on a non-selectable item.

Highlight Buttons

When Highlight Buttons is turned on, buttons are highlighted by a colored outline to indicate head position as you move your head. Tap to turn on the highlight. You can indicate head position by cursor, by highlight, or by both at the same time. Highlight Buttons is turned on by default. If you turn Highlight Buttons off, be sure to select a cursor shape. If you turn Highlight Buttons off and set Cursor Shape to None, you will have no visible way to track head movement.

Cursor Smoothing

Smoothing compensates for minor shakiness or tremors to reduce accidental button activations. The greater the user’s involuntary head movement, the more you may need to increase the smoothing value to compensate. A lower smoothing value will also make the cursor more responsive. Choose one of these options:

Low — The cursor will appear less stable but will be more responsive to head movements.

Medium (default) — The cursor will appear slightly more stable and will be slightly less responsive to head movements.

High — The cursor will appear very stable but will be less responsive to head movements.

Start Paused

When you toggle ON Enable Head Tracking, head tracking is paused and “Resume” appears centered between Vocab and Menu. Activate Resume to start making selections.

Additional Setting – Auto-Lock Time

If the device screen dims while you are using head tracking, change the Auto-Lock time. Change the time only as much as necessary. Longer auto-lock times will use more battery charge.

  1. Open the iPad settings.

  2. Select Display & Brightness in the left pane.

  3. In the right pane, select Auto-Lock.

  4. Select the next higher time value.

  5. Return to the app and continue using head tracking.

  6. If the screen still dims too soon, repeat steps 1 through 5.


Head Tracking Tips

Pausing Head Tracking

When you turn head tracking on, “Pause” appears centered between Vocab and Menu. When you activate Pause, head tracking stops temporarily and “Resume” appears. Use your trigger action to activate Resume and start up head tracking again.

Note: When the on/off head tracking setting Start Paused is on, head tracking is paused by default when opened. Simply Activate Resume to start making selections.

Scrolling

When head tracking is enabled, quick scroll arrows appear in the corners of the app settings and the app list of vocabularies. When you need to scroll through these lists of items, point at and trigger the appropriate quick scroll arrow.

 A white arrow pointing downward in a gray circle — Scroll down through the listed items

 A white arrow pointing upward in a gray circle — Scroll up through the listed items

 A double white arrow pointing downward in a gray circle — Jump to the bottom of the list

 A double white arrow pointing upward in a gray circle — Jump to the top of the list


Troubleshooting

Error message “Camera Permission Denied” when trying to enable head tracking.

  1. Open the iPad settings.

  2. Select the Unity app in the left pane.

  3. In the right pane under “Allow Unity to Access”, toggle ON Camera.

  4. Return to the app and enable head tracking in the settings.