|
|||||
|
|
Effects of multimedia on psychometric characteristics of cognitive tests: A comparison between technology-based and paper-based modalities |
|
| Institution: | 1. Faculty of Education, An Giang University- VNU-HCM, 18 Ung Van Khiem St, Dong Xuyen Ward, Long Xuyen City, An Giang Province, Vietnam;2. Doctoral School of Education, University of Szeged, 32-34. Pet?fi S. sgt., Szeged H-6722, Hungary;3. Epi?STEM National Centre for STEM Education, School of Education, University of Limerick, Plassey Park Road, Casteltroy, Limerick, Ireland;4. Institute of Education, University of Szeged, 32-34. Pet?fi S. sgt., Szeged H-6722, Hungary;5. MTA-SZTE Research Group on the Development of Competencies, Szeged, Hungary |
| Abstract: | The study aims to investigate the effects of delivery modalities on psychometric characteristics and student performance on cognitive tests. A first study assessed the inductive reasoning ability of 715 students under the supervision of teachers. A second study examined 731 students’ performance on the application of the control-of-variables strategy in basic physics but without teacher supervision due to the COVID-19 pandemic. Rasch measurement showed that the online format fitted to the data better in the unidimensional model across two conditions. Under teacher supervision, paper-based testing was better than online testing in terms of reliability and total scores, but contradictory findings were found in turn without teacher supervision. Although measurement invariance was confirmed between two versions at item level, the differential bundle functioning analysis supported the online groups on the item bundles constructed of figure-related materials. Response time was also discussed as an advantage of technology-based assessment for test development. |
| Keywords: | Test equivalence DBF DIF Inductive reasoning Control-of-variables strategy Technology-based assessment Paper-and-pencil test DBF"} {"#name":"keyword" "$":{"id":"key0045"} "$$":[{"#name":"text" "_":"differential bundle functioning DIF"} {"#name":"keyword" "$":{"id":"key0055"} "$$":[{"#name":"text" "_":"differential item functioning |
| 本文献已被 ScienceDirect 等数据库收录！ | |