Attention Aware Interaction refers to human-computer interaction techniques that leverage eye tracking, gaze detection, and attention modeling to understand user focus and adapt interfaces accordingly, enabling foveated rendering, gaze-based selection, and contextual content presentation in VR, A…

Semantic Classification

Content

Technical Details

Key components include:

  • Eye Tracking: Cameras and sensors detecting eye position, pupil dilation, and gaze direction

  • Gaze-Based Interfaces: UI systems responding to where users look, enabling hands-free interaction

  • Foveated Rendering: High-detail rendering only where user is looking to optimize GPU resources

  • Dwell Time Activation: Using gaze duration as an interaction trigger

    UX Considerations

  • Midas Touch Problem: Avoiding unintended activations during natural looking behavior

  • Multimodal Integration: Combining gaze with voice, gestures, or controllers for robust interaction

  • Social Presence: Enabling realistic eye contact in virtual avatars

    Hardware Implementation

    Meta Quest Pro, Apple Vision Pro, and other headsets incorporate eye tracking. Tobii and Pupil Labs provide dedicated eye tracking solutions.

Provenance