A Novel Eye Movement Data Transformation Technique that Preserves Temporal Information: A Demonstration in a Face Processing Task

Michał Król , Magdalena Król


Existing research has shown that human eye-movement data conveys rich information about underlying mental processes, and that the latter may be inferred from the former. However, most related studies rely on spatial information about which different areas of visual stimuli were looked at, without considering the order in which this occurred. Although powerful algorithms for making pairwise comparisons between eye-movement sequences (scanpaths) exist, the problem is how to compare two groups of scanpaths, e.g., those registered with vs. without an experimental manipulation in place, rather than individual scanpaths. Here, we propose that the problem might be solved by projecting a scanpath similarity matrix, obtained via a pairwise comparison algorithm, to a lower-dimensional space (the comparison and dimensionality-reduction techniques we use are ScanMatch and t-SNE). The resulting distributions of low-dimensional vectors representing individual scanpaths can be statistically compared. To assess if the di�erences result from temporal scanpath features, we propose to statistically compare the cross-validated accuracies of two classifiers predicting group membership: (1) based exclusively on spatial metrics; (2) based additionally on the obtained scanpath representation vectors. To illustrate, we compare autistic vs. typically-developing individuals looking at human faces during a lab experiment and find significant differences in temporal scanpath features.
Author Michał Król
Michał Król,,
, Magdalena Król (Filia we Wrocławiu / II Wydział Psychologii we Wrocławiu)
Magdalena Król,,
- II Wydział Psychologii we Wrocławiu
Journal seriesSensors, [SENSORS-BASEL], ISSN 1424-8220, (N/A 100 pkt)
Issue year2019
Publication size in sheets0.5
Article number2377
Keywords in Englisheye tracking; scanpath comparison; dimensionality reduction; machine learning; autism; face perception
ASJC Classification2208 Electrical and Electronic Engineering; 1303 Biochemistry; 3107 Atomic and Molecular Physics, and Optics; 1602 Analytical Chemistry
Languageen angielski
a novel eye movement_tekst.pdf 1.02 MB
Additional file
a novel eye movement_oswiadczenie.pdf 422.78 KB
Score (nominal)100
Score sourcejournalList
Publication indicators Scopus SNIP (Source Normalised Impact per Paper): 2016 = 1.393; WoS Impact Factor: 2017 = 2.475 (2) - 2017=3.014 (5)
Citation count*7 (2021-02-23)
Share Share

Get link to the record

* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Are you sure?