Multimodal Interface for Human-Machine Communication PDF Download
Are you looking for read ebook online? Search for your book and save it on your Kindle device, PC, phones or tablets. Download Multimodal Interface for Human-Machine Communication PDF full book. Access full book title Multimodal Interface for Human-Machine Communication by P C Yuen. Download full books in PDF and EPUB format.
Author: P C Yuen Publisher: World Scientific ISBN: 9814491241 Category : Computers Languages : en Pages : 276
Book Description
With the advance of speech, image and video technology, human–computer interaction (HCI) will reach a new phase. In recent years, HCI has been extended to human–machine communication (HMC) and the perceptual user interface (PUI). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication. Moreover, the machine can support human-to-human communication (e.g. an interface for the disabled). For this reason, various aspects of human communication are to be considered in HMC. The HMC interface, called a multimodal interface, includes different types of input methods, such as natural language, gestures, face and handwriting characters. The nine papers in this book have been selected from the 92 high-quality papers constituting the proceedings of the 2nd International Conference on Multimodal Interface (ICMI '99), which was held in Hong Kong in 1999. The papers cover a wide spectrum of the multimodal interface. Contents:Introduction to Multimodal Interface for Human–Machine Communication (P C Yuen et al.)Algorithms:A Face Location and Recognition System Based on Tangent Distance (R Mariani)Recognizing Action Units for Facial Expression Analysis (Y-L Tian et al.)View Synthesis Under Perspective Projection (G C Feng et al.)Single Modality Systems:Sign Language Recognition (W Gao & C Wang)Helping Designers Create Recognition-Enabled Interfaces (A C Long et al.)Information Retrieval:Cross-Language Text Retrieval by Query Translation Using Term Re-Weighting (I Kang et al.)Direct Feature Extraction in DCT Domain and Its Applications in Online Web Image Retrieval for JPEG Compressed Images (G Feng et al.)Multimodality Systems:Advances in the Robust Processing of Multimodal Speech and Pen Systems (S Oviatt)Information-Theoretic Fusion for Multimodal Interfaces (J W Fisher III & T Darrell)Using Virtual Humans for Multimodal Communication in Virtual Reality and Augmented Reality (D Thalmann) Readership: Computer scientists and engineers. Keywords:
Author: P C Yuen Publisher: World Scientific ISBN: 9814491241 Category : Computers Languages : en Pages : 276
Book Description
With the advance of speech, image and video technology, human–computer interaction (HCI) will reach a new phase. In recent years, HCI has been extended to human–machine communication (HMC) and the perceptual user interface (PUI). The final goal in HMC is that the communication between humans and machines is similar to human-to-human communication. Moreover, the machine can support human-to-human communication (e.g. an interface for the disabled). For this reason, various aspects of human communication are to be considered in HMC. The HMC interface, called a multimodal interface, includes different types of input methods, such as natural language, gestures, face and handwriting characters. The nine papers in this book have been selected from the 92 high-quality papers constituting the proceedings of the 2nd International Conference on Multimodal Interface (ICMI '99), which was held in Hong Kong in 1999. The papers cover a wide spectrum of the multimodal interface. Contents:Introduction to Multimodal Interface for Human–Machine Communication (P C Yuen et al.)Algorithms:A Face Location and Recognition System Based on Tangent Distance (R Mariani)Recognizing Action Units for Facial Expression Analysis (Y-L Tian et al.)View Synthesis Under Perspective Projection (G C Feng et al.)Single Modality Systems:Sign Language Recognition (W Gao & C Wang)Helping Designers Create Recognition-Enabled Interfaces (A C Long et al.)Information Retrieval:Cross-Language Text Retrieval by Query Translation Using Term Re-Weighting (I Kang et al.)Direct Feature Extraction in DCT Domain and Its Applications in Online Web Image Retrieval for JPEG Compressed Images (G Feng et al.)Multimodality Systems:Advances in the Robust Processing of Multimodal Speech and Pen Systems (S Oviatt)Information-Theoretic Fusion for Multimodal Interfaces (J W Fisher III & T Darrell)Using Virtual Humans for Multimodal Communication in Virtual Reality and Augmented Reality (D Thalmann) Readership: Computer scientists and engineers. Keywords:
Author: Sharon Oviatt Publisher: Morgan & Claypool ISBN: 1970001666 Category : Computers Languages : en Pages : 600
Book Description
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces— user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations—for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.
Author: Harry Bunt Publisher: Springer ISBN: 3540697640 Category : Computers Languages : en Pages : 354
Book Description
This book constitutes the strictly reviewed post-workshop documentation of the First International Conference on Cooperative Multimodal Communication held in Eindhoven, The Netherlands, in 1995. The volume presents an introductory survey and carefully re vised and updated full versions of three invited contributions and 14 papers selected for inclusion in the book after intensive reviewing. Among the issues addressed are intelligent multimedia retrieval, cooperative conversation, agent system communication, multimodal maps, multimodal plan presentation, multimodal user interfaces, multimodal dialog, and various systems for multimodal HCI.
Author: Denis Lalanne Publisher: Springer Science & Business Media ISBN: 3642004369 Category : Computers Languages : en Pages : 319
Book Description
Human Machine Interaction, or more commonly Human Computer Interaction, is the study of interaction between people and computers. It is an interdisciplinary field, connecting computer science with many other disciplines such as psychology, sociology and the arts. The present volume documents the results of the MMI research program on Human Machine Interaction involving 8 projects (selected from a total of 80 proposals) funded by the Hasler Foundation between 2005 and 2008. These projects were also partially funded by the associated universities and other third parties such as the Swiss National Science Foundation. This state-of-the-art survey begins with three chapters giving overviews of the domains of multimodal user interfaces, interactive visualization, and mixed reality. These are followed by eight chapters presenting the results of the projects, grouped according to the three aforementioned themes.
Author: Matej Rojc Publisher: CRC Press ISBN: 1466598255 Category : Computers Languages : en Pages : 436
Book Description
Embodied conversational agents (ECA) and speech-based human–machine interfaces can together represent more advanced and more natural human–machine interaction. Fusion of both topics is a challenging agenda in research and production spheres. The important goal of human–machine interfaces is to provide content or functionality in the form of a dialog resembling face-to-face conversations. All natural interfaces strive to exploit and use different communication strategies that provide additional meaning to the content, whether they are human–machine interfaces for controlling an application or different ECA-based human–machine interfaces directly simulating face-to-face conversation. Coverbal Synchrony in Human-Machine Interaction presents state-of-the-art concepts of advanced environment-independent multimodal human–machine interfaces that can be used in different contexts, ranging from simple multimodal web-browsers (for example, multimodal content reader) to more complex multimodal human–machine interfaces for ambient intelligent environments (such as supportive environments for elderly and agent-guided household environments). They can also be used in different computing environments—from pervasive computing to desktop environments. Within these concepts, the contributors discuss several communication strategies, used to provide different aspects of human–machine interaction.
Author: Ronald Böck Publisher: Springer ISBN: 3319155571 Category : Computers Languages : en Pages : 109
Book Description
This book constitutes the thoroughly refereed post-workshop proceedings of the Second Workshop on Multimodal Analyses Enabling Artificial Agents in Human Interaction, MA3HMI 2014, held in Conjunction with INTERSPEECH 2014, in Singapore, Singapore, on September 14th, 2014. The 9 revised papers presented together with a keynote talk were carefully reviewed and selected from numerous submissions. They are organized in two sections: human-machine interaction and dialogs and speech recognition.
Author: R. Anandan Publisher: John Wiley & Sons ISBN: 1119750598 Category : Computers Languages : en Pages : 498
Book Description
HUMAN COMMUNICATION TECHNOLOGY A unique book explaining how perception, location, communication, cognition, computation, networking, propulsion, integration of federated Internet of Robotic Things (IoRT) and digital platforms are important components of new-generation IoRT applications through continuous, real-time interaction with the world. The 16 chapters in this book discuss new architectures, networking paradigms, trustworthy structures, and platforms for the integration of applications across various business and industrial domains that are needed for the emergence of intelligent things (static or mobile) in collaborative autonomous fleets. These new apps speed up the progress of paradigms of autonomous system design and the proliferation of the Internet of Robotic Things (IoRT). Collaborative robotic things can communicate with other things in the IoRT, learn independently, interact securely with the world, people, and other things, and acquire characteristics that make them self-maintaining, self-aware, self-healing, and fail-safe operational. Due to the ubiquitous nature of collaborative robotic things, the IoRT, which binds together the sensors and the objects of robotic things, is gaining popularity. Therefore, the information contained in this book will provide readers with a better understanding of this interdisciplinary field. Audience Researchers in various fields including computer science, IoT, artificial intelligence, machine learning, and big data analytics.
Author: Sharon Oviatt Publisher: Morgan & Claypool ISBN: 1970001739 Category : Computers Languages : en Pages : 813
Book Description
The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces. This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.
Author: Publisher: ISBN: Category : Languages : en Pages : 7
Book Description
No one claims that people must interact with machines in the same way that they interact with other humans. Certainly, people do not carry on conversations with their toasters in the morning, unless they have a serious problem. However, the situation becomes a bit more complex when we begin to build and interact with machines or robots that either look like humans or have functionalities and capabilities. Then, people well might interact with their humanlike machines in ways that mimic human-human communication. For example, if a robot has a face, a human might interact with it similarly to how humans interact with other creatures with faces. Specifically, a human might talk to it, gesture to it, smile at it, and so on. If a human interacts with a computer or a machine that understands spoken commands, the human might converse with the machine, expecting it to have competence in spoken language. In our research on a multimodal interface to mobile robots, we have assumed a model of communication and interaction that, in a sense, mimics how people communicate. Our interface therefore incorporates both natural language understanding and gesture recognition as communication modes. We limited the interface to these two models to simplify integrating them in the interface and to make our research more tractable. We believe that with an integrated system, the user is less concerned with how to communicate (which interactive mode to employ for a task) and is therefore free to concentrate on the tasks and goals at hand. Because we integrate all our system's components, users can choose any combination of our interface's modalities. The onus is on our interface to integrate the input, process it, and produce the desired results.
Author: M. M. Taylor Publisher: John Benjamins Publishing ISBN: 9027221901 Category : Computers Languages : en Pages : 541
Book Description
Most dialogues are multimodal. When people talk, they use not only their voices, but also facial expressions and other gestures, and perhaps even touch. When computers communicate with people, they use pictures and perhaps sounds, together with textual language, and when people communicate with computers, they are likely to use mouse gestures almost as much as words. How are such multimodal dialogues constructed? This is the main question addressed in this selection of papers of the second Venaco Workshop, sponsored by the NATO Research Study Group RSG-10 on Automatic Speech Processing, and by the European Speech Communication Association (ESCA).
Author: P C Yuen
Author: P C Yuen
Author: Sharon Oviatt
Author: Harry Bunt
Author: Denis Lalanne
Author: Matej Rojc
Author: Ronald Böck
Author: R. Anandan
Author: Sharon Oviatt
Author: 
Author: M. M. Taylor