Multimodal Sequence Navigation

Multimodal sequence navigation is a specific subset of multimodal sequences in interfaces, which is concerned solely with the locomotion of the user's focal point. Moving the focal point for the user's sense of self across the virtual environment. Like all multimodal interfaces, it is interaction independent,. Comprising of any mixture of vocal, touch, gaze, or gesture based commands.

The first command opens up an invisible interface within the system, of which the user is not consciously aware. This interface recognises the first action as a possible command action, and awaits one of a list of other actions which will tell it how to perform the command.

An example might be pointing to another user's avatar in the VR and saying aloud “move me to them”, or another example of the same might be looking at the avatar with gaze tracking folloing your eyes followed by the gesture to pull them towards you. Multiple modes of navigation possible using a mix of methods to accomplish the same task.

One advantage of a multimodal sequence for navigation, is that if the first of the commands was not really a command – say the user was just tapping a virtual wall with no wish to change it – then if a valid secondary command is not forthcoming immediately, the system recognises the first action was not a command and quietly drops it. A second advantage is that if the user cannot use one pathway – cannot use voice for example – then other natural interface pathways exist to perform the same task.

Using sequences as commands rather than individual natural gestures, speech or touch as commands offer a layer of security against user frustration, as they cannot accidentally trigger a change in the system with their natural expression. Changes follow naturally and intuitively, but are very hard to complete by accident.

See Also: Multimodal Sequence, Gesture Sequence, Touch Sequence, Biometric, Natural User Interface, Voice Control

Below, we offer a selection of links from our resource databases which may match this term.

Gesture Sequence Navigation Multimodal Sequence Multimodal Sequence Navigation

Touch Sequence Navigation

Results by page [1]   [2]   [3]   

Animation: Gait and movement differs according to wealth
A look at using a pool of sequence files and the socio-economic status of an NPC, to create a set of sequence files for their avatar that makes their behaviour both unique and believable.

GPS for Buses
German researchers are working on a system which they hope will encourage more people to use public transport: A vehicle-independent and company-independent GPS navigation system for public transport, modelled on the way in-car GPS navigation systems work.

Optical Machine Vision Navigation System Found in Flies
A study conducted to understand how flies and bees can navigate so precisely using just natural sunlight, has interesting implications for machine vision, and adding additional sense-based navigation systems to UAVs and UGVs without adding the weight or cost of any extra hardware.

A Wheelchair With Ears and Brain
At MIT, researchers are working on an artificially intelligent electric wheelchair, designed to aid the least mobile individuals with navigation.

Results by page