Multimodal Corpora : From Models of Natural Interaction to Systems and Applications / edited by Michael Kipp, Jean-Claude Martin, Patrizia Paggio, Dirk Heylen.

Format:

Book

Contributor:

Kipp, Michael, editor.

Martin, Jean-Claude, 1965- editor.

Paggio, Patrizia, editor.

Heylen, D. (Dirk), editor.

SpringerLink (Online service)

Series:

Computer Science (Springer-11645)

Lecture notes in computer science. Lecture notes in artificial intelligence ; 5509.

Lecture Notes in Artificial Intelligence ; 5509

Language:

English

Subjects (All):

Optical data processing.

Natural language processing (Computer science).

Computer graphics.

Pattern perception.

Biometry.

Computer Imaging, Vision, Pattern Recognition and Graphics.

Natural Language Processing (NLP).

Image Processing and Computer Vision.

Computer Graphics.

Pattern Recognition.

Biometrics.

Local Subjects:

Computer Imaging, Vision, Pattern Recognition and Graphics.

Natural Language Processing (NLP).

Image Processing and Computer Vision.

Computer Graphics.

Pattern Recognition.

Biometrics.

Physical Description:

1 online resource (X, 223 pages).

Edition:

First edition 2009.

Contained In:

Springer eBooks

Place of Publication:

Berlin, Heidelberg : Springer Berlin Heidelberg : Imprint: Springer, 2009.

System Details:

text file PDF

Summary:

Empirically based research in multimodality starts with the collection of video data relevant for a specific research question. This data must then be enriched by human coders, who annotate the corpus and who also explore the potential interconnections between modalities (e.g., face, gesture, speech, posture, et cetera). The data must then be validated for consistency using quantitative measures -- systematic analysis of the observed multimodal behaviors is the central characteristic of multimodal corpora. For analysis and modeling tasks, exploratory qualitative and quantitative analysis tools are needed for browsing, viewing, extraction, and modeling. At the same time, the intercultural dimension must be taken into account, since multimodal interaction is always embedded in a social setting. This state-of-the-art survey documents the scientific outcome of the International Workshop on "Multimodal Corpora: From Models of Natural Interaction to Systems and Applications", held in conjunction with the 6th International Conference for Language Resources and Evaluation (LREC), on May 27, 2008, in Marrakech, Morocco. It presents current research from fields as diverse as psychology, artificial intelligence, robotics, signal processing, computational linguistics, and human-computer interaction. The 6 selected workshop contributions are complemented by 7 invited research articles, including contributions from major international multimodal corpus projects like AMI and SmartWeb. All papers underwent a special review process for this volume, resulting in significant revisions and extensions based on the experts' advice.

Contents:

Collecting and Distributing Multimodal Corpora

The SmartWeb Corpora: Multimodal Access to the Web in Natural Environments

Promoting free Dialog Video Corpora: The IFADV Corpus Example

Coding and Analyzing Multimodal Corpora

Creating and Exploiting Multimodal Annotated Corpora: The ToMA Project

Multi-track Annotation of Child Language and Gestures

Gesture, Gaze and Persuasive Strategies in Political Discourse

Unsupervised Clustering in Multimodal Multiparty Meeting Analysis

Validating Multimodal Corpora

Multimodal Corpora Annotation: Validation Methods to Assess Coding Scheme Reliability

On the Contextual Analysis of Agreement Scores

The Intercultural Dimension of Multimodal Corpora

Creating Standardized Video Recordings of Multimodal Interactions across Cultures

Multimodal Intercultural Information and Communication Technology - A Framework for Designing and Evaluating Multimodal Intercultural Communicators

Tools for Browsing, Coding and Exchanging Data in Multimodal Corpora

Tools and Resources for Visualising Conversational-Speech Interaction

Accessing a Large Multimodal Corpus Using an Automatic Content Linking Device

An Exchange Format for Multimodal Annotations.

Other Format:

Printed edition:

ISBN:

978-3-642-04793-0

9783642047930

Access Restriction:

Restricted for use by site license.