rdf-syntax-grammar
mods:
  schema location: http://www.loc.gov/mods/v3 http://www.loc.gov/standards/mods/v3/mods-3-2.xsd
  title info:
    non sort: The
    title: paradigm shift to multimodality in contemporary computer interfaces
  title info:
    title: Synthesis digital library of engineering and computer science
  name:
    name part: Oviatt, Sharon
    role:
      role term: creator
    role:
      role term: author.
  name:
    name part: Cohen, Philip R.
    role:
      role term: author.
  type of resource: text
  genre: abstract or summary
  genre: Electronic books.
  origin info:
    place:
      place term: cau
    date issued: 2015
    issuance: monographic
  language:
    language term: eng
  physical description:
    reformatting quality: access
    form: remote
    extent: 1 online resource (xxii, 221 pages) : illustrations.
  abstract: During the last decade, cell phones with multimodal interfaces based on combined new media have become the dominant computer interface worldwide. Multimodal interfaces support mobility and expand the expressive power of human input to computers. They have shifted the fulcrum of human-computer interaction much closer to the human. This book explains the foundation of human-centered multimodal interaction and interface design, based on the cognitive and neurosciences, as well as the major benefits of multimodal interfaces for human cognition and performance. It describes the data-intensive methodologies used to envision, prototype, and evaluate new multimodal interfaces. From a system development viewpoint, this book outlines major approaches for multimodal signal processing, fusion, architectures, and techniques for robustly interpreting users' meaning. Multimodal interfaces have been commercialized extensively for field and mobile applications during the last decade. Research also is growing rapidly in areas like multimodal data analytics, affect recognition, accessible interfaces, embedded and robotic interfaces, machine learning and new hybrid processing approaches, and similar topics. The expansion of multimodal interfaces is part of the long-term evolution of more expressively powerful input to computers, a trend that will substantially improve support for human cognition and performance.
  table of contents: 1. Definition and types of multimodal interface --
  table of contents: 10. Emerging multimodal research areas and applications -- 10.1 Tangible, ubiquitous, and wearable multimodal interfaces -- 10.2 Multimodal affect recognition -- 10.3 Multimodal learning analytics and education -- 10.4 Multimodal accessible interfaces -- 10.5 Multimodal virtual agents and robotic interfaces --
  table of contents: 11. Beyond multimodality: designing more expressively powerful interfaces -- 11.1 Impact of interface support for expressing multiple representations -- 11.1.1 Ideational fluency -- 11.1.2 Problem solving -- 11.1.3 Inferential accuracy -- 11.1.4 Beyond average: reducing the performance gap between users -- 11.2 Explanatory theory and interface design principles -- 11.3 Future directions: interface support for expressing world linguistic codes --
  table of contents: 12. Conclusions and future directions -- Bibliography -- Author biographies.
  table of contents: 2. History of paradigm shift from graphical to multimodal interfaces -- 2.1 Early multimodal interfaces -- 2.2 Later advanced multimodal interfaces -- 2.3 Recent mobile devices with multimodal interfaces --
  table of contents: 3. Aims and advantages of multimodal interfaces -- 3.1 User preference and natural interaction patterns -- 3.2 Flexible interaction patterns -- 3.3 Accommodation of individual differences -- 3.4 Efficiency -- 3.5 Superior error handling -- 3.6 Minimization of cognitive load -- 3.7 Expressive power and stimulation of cognition --
  table of contents: 4. Evolutionary, neuroscience, and cognitive foundations of multimodal interfaces -- 4.1 Evolution of multimodal perceptual and communication abilities -- 4.2 Neuroscience and behavioral research on multisensory processes -- 4.3 Cognitive science and multimodal human-computer interaction research -- 4.3.1 Frequency and occurrence of multimodal interaction -- 4.3.2 Multimodal integration and synchronization patterns -- 4.3.3 Individual and cross-cultural differences in integration patterns -- 4.3.4 Complementarity versus redundancy in multimodal integration --
  table of contents: 5. Theoretical foundations of multimodal interfaces -- 5.1 Gestalt theory: greater multimodal coherence, stability, and robustness -- 5.2 Affordance theory: multimodal interfaces guide human communication and activity -- 5.3 Communication accommodation theory: multimodal dialogue convergence improves intelligibility -- 5.4 Working memory theory: distributed multimodal processing improves memory -- 5.5 Cognitive load theory: multimodal processing minimizes load -- 5.6 Activity theory: intensity of multimodal communication stimulates thought --
  table of contents: 6. Human-centered design of multimodal interfaces -- 6.1 Methods for prototyping and evaluating multimodal interfaces -- 6.2 Human-centered philosophy and strategies for multimodal interface design -- 6.3 Community-based participatory design of global multimodal interfaces --
  table of contents: 7. Multimodal signal processing, fusion, and architectures -- 7.1 Dimensions of modality fusion -- 7.1.1 Why fuse? -- 7.1.2 What to fuse? -- 7.1.3 When and how to fuse? -- 7.2 Fusion architectures -- 7.3 Multimodal emotion recognition example --
  table of contents: 8. Multimodal language, semantic processing, and multimodal integration -- 8.1 Multimodal language -- 8.2 Semantic processing and multimodal integration -- 8.2.1 Meaning representations -- 8.2.2 Meaning combination -- 8.3 Evaluation of multimodal integration -- 8.4 Principles for strategizing multimodal integration --
  table of contents: 9. Commercialization of multimodal interfaces -- 9.1 Automotive interfaces -- 9.2 Geospatial and design interfaces -- 9.3 Virtual assistant interfaces -- 9.4 Robotic interfaces -- 9.5 Multi-biometric interfaces -- 9.6 Educational interfaces -- 9.7 Entertainment and gaming interfaces -- 9.8 Warehouse automation interfaces -- 9.9 International standards and commercial toolkits -- 9.10 Organizational resistance to adopting new technologies --
  target audience: specialized
  note: Sharon Oviatt, Philip R. Cohen.
  note: Abstract freely available; full-text restricted to subscribers or individual document purchasers.
  note: Also available in print.
  note: Mode of access: World Wide Web.
  note: System requirements: Adobe Acrobat Reader.
  note: Includes bibliographical references (pages 173-219).
  subject:
    topic: Human-computer interaction
  subject:
    topic: Multimodal user interfaces (Computer systems)
  subject:
    topic: cognition and performance
  subject:
    topic: commercialization
  subject:
    topic: communication interfaces
  subject:
    topic: data-intensive systems
  subject:
    topic: design prototyping
  subject:
    topic: expressive power
  subject:
    topic: human-centered
  subject:
    topic: hybrid architectures
  subject:
    topic: mobility
  subject:
    topic: multimodal interface
  subject:
    topic: multimodal-multisensor interface
  subject:
    topic: multisensory perception
  subject:
    topic: new media
  subject:
    topic: semantic integration
  subject:
    topic: signal processing
  subject:
    topic: smart phones and mobile devices
  subject:
    topic: technology paradigm shift
  subject:
    topic: theoretical foundations
  subject:
    topic: time-sensitive processing
  subject:
    topic: wearable technology
  classification: QA76.9.U83 O936 2015
  classification: 005.437
  related item:
    title info:
      title: Synthesis lectures on human-centered informatics ; # 30
  identifier: 9781627057523
  identifier: 9781627057516
  identifier: http://proxy.library.tamu.edu/login
  access condition: Abstract freely available; full-text restricted to subscribers or individual document purchasers.
  record info:
    record content source: CaBNVSL
    record creation date: 150426
    record change date: 20210728125144.0
    record identifier: in00003778510
    language of cataloging:
      language term: eng