Mudahan lembut hati pensyarah menyemak kertas jawapan kalian 🤣😍😜😘🤭

• Multimodal system organizes human natural capabilities to communicate using more than one modalities. 
• The advantages of multimodal interaction include supporting natural language and behavior recognition. 
• Challenges in multimodal interaction technology development include how to combine more than one modalities and how to consider user cognitive load. 

Advantages of multimodal interaction 
• Natural language support. 
• Human behavior/action recognition . 
• Offers flexibility, reliability, efficiency, precision. 
• Alternative interaction technique beyond GUI. 
• Accommodate wider range of user and task. 

#itmiaomiao
#mitclass

i.Dictation system 

ii.Navigation system 

iii.Transaction system 

iv.Operator services 

v.Recording meetings and indexing them 

Reason to use auditory interface: 

i.Better concentration – Human are not designed for multitasking 

ii.Disabilities – As a tool to assist hearing-impaired individuals 

iii.Information gaining – Provide additional information or description together with graphical interface 

#slytherinvsaquasome
#mitclass

•Each type of tracker has advantages and disadvantages. Wires and cables are a usability issue. 

•In addition to position-tracking motion sensors, there are sensors that measure other, simpler characteristics of the user's body motion. 

#kancilmerahvsohana
#mitclass

 -§could reduce stress
-§increase information processing, 
-§enhance memory performance through better problem solving,
-§reduce response times
-§produce fewer errors 
-§increase recall
-§advanced visual and audio outputs
-subconsciously change your mood

 

#error404vsbellefemme
#mitclass 

 -§could reduce stress
-§increase information processing, 
-§enhance memory performance through better problem solving,
-§reduce response times
-§produce fewer errors 
-§increase recall
-§advanced visual and audio outputs
-subconsciously change your mood

#error404vsbellefemme
#mitclass

IVR technology can benefit both large and small businesses in the following ways:

#leginvssapheiros
#mitclass

An IVR application provides prerecorded voice responses for appropriate situations, keypad signal logic, access to relevant data and, potentially, the ability to record voice input for later use. Using computer telephony integration (CTI), IVR systems can hand off a call to a human being who can view data related to the caller on a display.

IVR systems also use dual-tone multi-frequency (DTMF) signals as a line of communication between a phone and a computer. The computer uses a telephony board or card to understand DTMF signals. 

Here are a few other examples of ways an IVR system can be used in this manner:

#leginvssapheiros
#mitclass 

: Quiz method: Kahoot 

#daedalusvsnots
#mitclass

-Military application 

-Assistive technology for the blind and visually impaired 

-Museum display 

-Entertainment 

-Holographic interaction 

 

#vulpesvsinoted
#mitclass

From the previous class, we have learned about Locomotive Interface. Locomotion interfaces are energy-extractive devices that, in a confined space, simulate unrestrained human mobility such as walking and running for virtual reality. Locomotion interfaces overcome limitations of using joysticks for maneuvering or whole-body motion platforms, in which the user is seated and does not expend energy, and of room environments, where only short distances can be traversed. Their use yields realistic navigation and engagement in modeled worlds and an enhanced sense of spatial layout.

Pose and Motion Sensors

Trade-offs in Tracking Technologies 

•Each type of tracker has advantages and disadvantages. Wires and cables are a usability issue. 

•In addition to position-tracking motion sensors, there are sensors that measure other, simpler characteristics of the user's body motion. 

#kancilmerahvsohana
#mitclass 

The advantage of the multimodal interface is permitting the flexible use of input nodes which include the alternative and integrated use. Other than that, it can improve the efficiency when dealing in graphical information. Furthermore, it can lead to enhanced error avoidance and ease of error resolution (Turk, 2013). They also provide more convenient of interaction design for users needs. 

The disadvantage of the multimodal interface is when the combinations which can increase the complexity and it can lead too difficult to find the satisfactory solution of problems. Furthermore, it is a lengthy process (Hong, Lee, Lama & Kwon, 2016). 

#knomore10vsmig
#mitclass

-In conclusion, multimodal interfaces are just beginning to model human-like sensory perception and communication patterns. 

-They are recognising and identifying actions (Gesture & Locomotive UI), language and people that have been seen, heard (VUI) or in other ways experienced in the past. 
-They literally reflect and acknowledge the existence of human users, empower them in new ways. 
-They also can be playful and self-reflective interfaces that suggest new forms of human identity as we interact face-to-face with animated personas representing our own kind. 

 

a)     The Sonification of Complex Data

Sonification is one of the auditory interface or display that use non-speech sound. The purpose of sonification is to render data, to convey information, and to enhance the visual display or audio display. In addition, sonification also defines as the conversion of numeric data relation to perceive data relation in musical or non-musical that called an acoustic signal to allow the communication and interpretation. 

 

Nowadays, sonification is currently being used in a wide range of application and fields. For example, the medicine field and automobile field. There are some of the existing application in the auditory interface by using sonification. Such as auditory altimeter, interactive sonification, and medical and surgical auditory display. 

 

Usually, sonification has been used in medicine. Such as, to track physiological variable. Besides, in medicine it also has been studied in a number of contexts likes help for paralyzed and visually impaired patients, potential aid in disease treatment and physiotherapy data display.

According to Blattner (1989), earcons is a non-verbal audio message that used in user computer interface for interaction, and operation. The purpose of earcon is to get or receive information. Besides, earcon has a big difference with the auditory icon. It is better known as synthetics nonverbal auditory message. In addition, earcons are not naturally occurring sounds while auditory icons are includes of it which are naturally occurring sound and not naturally occurring sound. 

 

There are some advantages of using earcons as the auditory interface. Firstly, earcons is a synthetic which is can be organized easily. Then, it also can be as simple sounds or maybe a complex sound that involve a multiple layers of simple sounds. For each layer, it will present a different detail.  For example, Morse code sound pattern.

One of the basic types of auditory interface is audification. Audification is a technique that represents a sequence or raw data as a sound. Basically, audification is good for a large dataset with periodic components. To make sure all the data have been needed to make an audification, it allows a listener to hear the periodic components as frequencies. According to Hayward & Terenzi (1994), everything that comes from the low frequency of seismic data to a very high frequency of radio telescope data can be transformed into perceptible sound. Therefore, a listener can get meaningful information from the audification. For example, an esophageal stethoscope which can increase the natural sound that occurred without using any inputs such as gas analysis result.