Multimodal learning with audio description: an eye tracking study of children's gaze during a visual recognition task

Krzysztof Krejtz , Izabela Krejtz , Andrew T. Duchowski , Agnieszka Szarkowska , Agnieszka Walczak

Abstract

The paper explores the effects of adding audio description to an educational film on children's learning behaviour, manifested by a visual recognition task. We hypothesize that the multimodal educational setting, consisting of both verbal (film dialogue and audio description) and non-verbal (motion pictures) representations of knowledge, fosters knowledge acquisition as it provides information via multiple channels, which in turn strengthens memory retrieval. In the study we employ eye tracking methodology to examine the recognition of previously seen film material, testing whether audio description promotes recognition- rather than elimination-based decision-making in the visual recognition task. The analysis of first fixation duration and first run fixation count measures in the experimental and control groups partially confirmed our hypotheses. Children in the experimental group generally looked longer at the scenes they had seen, which supports the hypothesis that their decision was based on recognition, whereas children in the control group had longer fixations on scenes they were unfamiliar with, suggesting a decision based on elimination.
Author Krzysztof Krejtz (Wydział Psychologii)
Krzysztof Krejtz,,
- Wydział Psychologii
, Izabela Krejtz (Wydział Psychologii)
Izabela Krejtz,,
- Wydział Psychologii
, Andrew T. Duchowski
Andrew T. Duchowski,,
-
, Agnieszka Szarkowska
Agnieszka Szarkowska,,
-
, Agnieszka Walczak
Agnieszka Walczak,,
-
Journal seriesSAP '12 Proceedings of the ACM Symposium on Applied Perception, (0 pkt)
Issue year2012
Vol1
Pages83-90
Publication size in sheets0
DOIDOI:10.1145/2338676.2338694
URL http://dl.acm.org/citation.cfm?id=2338694&dl=ACM&coll=DL&CFID=286165054&CFTOKEN=57552044
Languageen angielski
File
paper.pdf of 14-09-2015
837.15 KB
p83-krejtz.pdf of 14-09-2015
950.99 KB
Score (nominal)0
Citation count*22 (2020-10-24)
Additional fields
Dorobek Naukowy - Preview URLhttp://dn.swps.edu.pl/Podglad.aspx?WpisID=11804
Dorobek Naukowy - Approve URLhttp://dn.swps.edu.pl/Biuro/ZatwierdzanieWpisu.aspx?WpisID=11804
Dorobek Naukowy - Preview URLhttp://dn.swps.edu.pl/Podglad.aspx?WpisID=11820
Dorobek Naukowy - Approve URLhttp://dn.swps.edu.pl/Biuro/ZatwierdzanieWpisu.aspx?WpisID=11820
Cite
Share Share

Get link to the record


* presented citation count is obtained through Internet information analysis and it is close to the number calculated by the Publish or Perish system.
Back
Confirmation
Are you sure?