Sample chapter – Interactive software for mulitmodal analysis
This article presents the design and functionalities of interactive software for multimodal analysis currently being developed. The software is being used for the annotation, analysis, search and retrieval of semantic patterns in unified but complex semiotic acts – for example, the interaction of gesture, gaze, intonation, camera angle, and music in a film.