Automating areas of interest analysis in mobile eye tracking experiments based on machine learning
For an in-depth, AOI-based analysis of mobile eye tracking data, a preceding gaze assignment step is inevitable. Current solutions such as manual gaze mapping or marker-based approaches are tedious and not suitable for applications manipulating tangible objects. This makes mobile eye tracking studies with several hours of recording difficult to analyse quantitatively. We introduce a new machine learning-based algorithm, the computational Gaze-Object Mapping (cGOM), that automatically maps gaze data onto respective AOIs. cGOM extends state-of-the-art object detection and segmentation by mask R-CNN with a gaze mapping feature. The new algorithm’s performance is validated against a manual fixation-by-fixation mapping, which is considered as ground truth, in terms of true positive rate (TPR), true negative rate (TNR) and efficiency. Using only 72 training images with 264 labelled object representations, cGOM is able to reach a TPR of approx. 80% and a TNR of 85% compared to the manual mapping. The break-even point is reached at 2 hours of eye tracking recording for the total procedure, respectively 1 hour considering human working time only. Together with a real-time capability of the mapping process after completed training, even hours of eye tracking recording can be evaluated efficiently.(Code and video examples have been made available at: https://gitlab.ethz.ch/pdz/cgom.git)
This work is licensed under a Creative Commons Attribution 4.0 International License.
Open Access Policy
The Journal of Eye Movement Research (JEMR) is an open access journal which means that all content is freely available without charge to the user in accordance with the BOAI definition of open access. Users are allowed to read, download, copy or use the content for any lawful purpose, without asking prior permission from the publisher or the author. The content is licensed under the Creative Commons Attribution License (CC BY 4.0).
Under the Creative Commons Attribution License (CC BY 4.0) the following terms are met:
Copyright on any open access article published in JEMR is retained by the author or authors. Authors grant JEMR a licence to publish the article and identify itself as the original publisher.
Authors grant any third party the right to use the article freely as long as its integrity is maintained and its original authors, citation details and publisher are identified. No permission is required from the authors or the journal publisher to reuse or repurpose JEMR content provided the original article is properly cited. For any reuse or redistribution of a work, the licence terms under which the work was published must be made clear.
The Journal of Eye Movement Research is committed to publish only original material that has not already been published or reviewed elsewhere. Any manuscript that raises concerns about plagiarism will be checked and cases of plagiarism will be sanctioned.