MAGiC: A multimodal framework for analysing gaze in dyadic communication
AbstractThe analysis of dynamic scenes has been a challenging domain in eye tracking research. This study presents a framework, named MAGiC, for analyzing gaze contact and gaze aversion in face-to-face communication. MAGiC provides an environment that is able to detect and track the conversation partner’s face automatically, overlay gaze data on top of the face video, and incorporate speech by means of speech-act annotation. Specifically, MAGiC integrates eye tracking data for gaze, audio data for speech segmentation, and video data for face tracking. MAGiC is an open source framework and its usage is demonstrated via publicly available video content and wiki pages. We explored the capabilities of MAGiC through a pilot study and showed that it facilitates the analysis of dynamic gaze data by reducing the annotation effort and the time spent for manual analysis of video data.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Open Access Policy
The Journal of Eye Movement Research (JEMR) is an open access journal which means that all content is freely available without charge to the user in accordance with the BOAI definition of open access. Users are allowed to read, download, copy or use the content for any lawful purpose, without asking prior permission from the publisher or the author. The content is licensed under the Creative Commons Attribution License (CC BY 4.0).
Under the Creative Commons Attribution License (CC BY 4.0) the following terms are met:
Copyright on any open access article published in JEMR is retained by the author or authors. Authors grant JEMR a licence to publish the article and identify itself as the original publisher.
Authors grant any third party the right to use the article freely as long as its integrity is maintained and its original authors, citation details and publisher are identified. No permission is required from the authors or the journal publisher to reuse or repurpose JEMR content provided the original article is properly cited. For any reuse or redistribution of a work, the licence terms under which the work was published must be made clear.
The Journal of Eye Movement Research is committed to publish only original material that has not already been published or reviewed elsewhere. Any manuscript that raises concerns about plagiarism will be checked and cases of plagiarism will be sanctioned.