Untitled Document
Not a member yet? Register for full benefits!

Virtual Dictionary

Multimodal Sequence

A multimodal sequence can refer to several things in VR.

1. It may refer to a communication system that seamlessly switches from one mode of communication to another as they become available – Wi-Fi to Wi-Max to 3G, to ADSL – seamlessly in the background without disturbing the user's experience, choosing whichever technologies offer the best bandwidth at the time.

2. It may refer to a type of Natural User Interface or NUI in which multiple interface types are combined – gestures, touch, eye movement, voice, etcetera – to create a single interface.

In this type of interface, a command is given to the system as a series of separate actions by the user. Perhaps a touch command to start, followed by a voice command to modify, or a vocal command to start followed by a gesture to modify.

The first command opens up an invisible interface within the system, of which the user is not consciously aware. This interface recognises the first action as a possible command action, and awaits one of a list of other actions which will tell it how to perform the command.

An example might be tapping a surface in a virtual environment, saying the word 'colour' out loud, then using a gesture to select the colour desired from a colour wheel. The result is the simu8lation painting that surface in that colour.

The advantage of a multimodal sequence, is that if the first of the commands was not really a command – say the user was just tapping a virtual wall with no wish to change it – then if a valid secondary command is not forthcoming immediately, the system recognises the first action was not a command and quietly drops it.

Such sequences as commands rather than individual natural gestures, speech or touch as commands offer a layer of security against user frustration, as they cannot accidentally trigger a change in the system with their natural expression. Changes follow naturally and intuitively, but are very hard to complete by accident.

See Also: Multimodal Sequence Navigation, Gesture Sequence, Touch Sequence, Biometric, Natural User Interface, Voice Control

Below, we offer a selection of links from our resource databases which may match this term.

Related Dictionary Entries for Multimodal Sequence:

Gesture Sequence

Gesture Sequence Navigation

Multimodal Sequence

Multimodal Sequence Navigation

Touch Sequence

Touch Sequence Navigation


Resources in our database matching the Term Multimodal Sequence:

Results by page [1]   [2]   

Locally Hosted resource
Animation: Gait and movement differs according to wealth
A look at using a pool of sequence files and the socio-economic status of an NPC, to create a set of sequence files for their avatar that makes their behaviour both unique and believable.

Locally Hosted resource
Swift MoCap Sequence Retrieval
A better way has been developed for premade MoCap summoning. A method that uses general limb movements to call up the closest matching MoCap file.

Locally Hosted resource
Lawnmower Man
Created in 1992 during the height of the first great public VR hype, Lawnmower Man is a little on the hammy side, but is that rarest of rare things: A sci-fi film that has done its homework. Every VR sequence, all the VR hardware is directly based on actual capabilities of the time, and nothing is done that could not be done from a VR and interfacing standpoint.

Locally Hosted resource
Large Image Display: Animatrix: The Second Renaissance: Zooming into the Machine
This single still is from the widescreen version of ?The Second Renaissance?, one of the Animatrix animated shorts. The full sequence encapsulates the id's version of the capabilities of VR, rather well.


Industry News containing the Term Multimodal Sequence:

Results by page

Mimicking the way in which a retina works is as hard as it sounds. Scientists from Stanford University, in the United States, have spent the past two years working on imitating the way in which information is processed in biological systems...

Last December, Ion Torrent, something of an upstart in the sequencing industry, launched its new semiconductor-based sequencing machine. At $50,000, it was a comparatively inexpensive device designed to move DNA sequencing from large, speci...

06 November 2009 - 06 November 2009
MIT Media Lab, Boston, USA

A vital requirement for social robots and virtual agents is the ability to infer the affective and mental states of humans, so as to be able to engage in a...

A portable instrument based on an ultrasensitive nanoscale sensor could detect bacteria in minutes, helping to catch infectious diseases early and prevent their spread. The simple, low-cost device should be available within three years, say...

A Korean venture start-up has developed an inaudible sound sequence, based on submiminal messaging which it claims can prevent obsessive use of online games, thus falling in line with government mandates.

?We incorporated me...