Does adding video and subtitles to an audio lesson facilitate its comprehension? |
| |
Institution: | 1. Department of Psychology, University of Hong Kong, Hong Kong Special Administrative Region;2. The State Key Laboratory of Brain and Cognitive Sciences, University of Hong Kong, Hong Kong Special Administrative Region |
| |
Abstract: | We examined whether adding video and subtitles to an audio lesson facilitates its comprehension and whether the comprehension depends on participants' cognitive abilities, including working memory and executive functions, and where they looked during video viewing. Participants received lessons consisting of statements of facts under four conditions: audio-only, audio with verbatim subtitles, audio with relevant video, and audio with both subtitles and video. Comprehension was assessed as the accuracy in answering multiple-choice questions for content memory. We found that subtitles facilitated comprehension whereas video did not. In addition, comprehension of audio lessons with video depended on participants' cognitive abilities and eye movement pattern: a more centralized (looking mainly at the screen center) eye movement pattern predicted better comprehension as opposed to a distributed pattern (with distributed regions of interest). Thus, whether video facilitates comprehension of audio lessons depends on both learners’ cognitive abilities and where they look during video viewing. |
| |
Keywords: | Multimedia learning Eye movement Hidden markov model EMHMM |
本文献已被 ScienceDirect 等数据库收录! |
|