The impact of immediate test score reporting on university students' achievement emotions in the context of computer-based multiple-choice exams

Test-taking is an emotion-laden event for many students. Typically, negative emotions are highest at the start of an examination and are replaced by positive emotions as the exam progresses. The impact of computer-based testing and immediate score reporting on students' emotions has not been examined. In Study 1, we evaluated university students’ emotions at the end of a computer-based exam and found positive emotions more strongly endorsed than negative. In Study 2, we replicated this finding and used a quasi-experimental pre-post design to examine how emotions changed in response to real examination scores. Exam scores presented immediately had significant positive effects on relief, pride, and hope and negative effects on anxiety and shame even after controlling for the corresponding emotion at the end of the exam. The one exception was anger, which was not impacted by examination score. No interaction effects were found.     

Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to cover a more comprehensive construct of inquiry abilities and target secondary school students in different grades while this potential is leveraged. We implemented five steps derived from the construct modeling approach to design MASIA. During the implementation, multiple sources of evidence were collected in the steps of pilot testing and Rasch modeling to support the validity of MASIA. Particularly, through the participation of 1,066 8th and 11th graders, MASIA showed satisfactory psychometric properties to discriminate students with different levels of inquiry abilities in 101 items in 29 tasks when Rasch models were applied. Additionally, the Wright map indicated that MASIA offered accurate information about students’ inquiry abilities because of the comparability of the distributions of student abilities and item difficulties. The analysis results also suggested that MASIA offered precise measures of inquiry abilities when the components (questioning, experimenting, analyzing, and explaining) were regarded as a coherent construct. Finally, the increased mean difficulty thresholds of item responses along with three performance levels across all sub-abilities supported the alignment between our scoring rubrics and our inquiry framework. Together with other sources of validity in the pilot testing, the results offered evidence to support the validity of MASIA.     

Computer-based knowledge of results feedback in different delivery modes: Effects on performance,motivation, and achievement emotions

Immediate Knowledge of Results (KR) feedback at the task level may motivate test takers by showing that their answers matter. Appealing feedback cues may help to prevent negative emotions in lower performers who receive a higher amount of negative feedback. In this experiment, we varied the presence of KR feedback and the feedback delivery mode in a 1 × 5 between-subjects design (i.e., no feedback vs. text, color, sound, or animation feedback) to investigate effects on learning outcomes and affective-motivational measures. Our sample included 661 fifth and sixth graders who solved two computer-based multiple-choice science tests. First, students worked on an 18-item treatment test (with experimental feedback manipulation). Students repeatedly rated their effort, enjoyment, pride, and boredom during the test, as well as their expectancy of success and attainment value after the test. Subsequently, they worked on a posttest (without feedback) that assessed recall and near-transfer learning. All KR feedback conditions significantly increased recall, but there was no evidence for near-transfer learning. Feedback had a significant, negative effect on attainment value, whereas significant interactions between the feedback conditions and students’ treatment performance revealed that feedback effects on several affective-motivational dimensions (i.e., expectancy of success, enjoyment, pride, and boredom) were performance-dependent. Feedback benefited higher performers’ motivation and affect but showed negative effects on some affective-motivational measures for lower performers. The pattern of results indicated that color/sound/animation feedback may have reduced the effect of performance on emotional feedback perception to some extent. However, none of the feedback conditions improved affective-motivational outcomes independent of students’ performance.     

Learner preferences and prior knowledge in learner-controlled computer-based instruction

This study examined the effects of prior knowledge, learner preference for control, and type of control (learner or program) on the achievement of middle-school students in a computer-based instructional program on adding and subtracting integers. Students were blocked by preference-for-control scores and randomly assigned to either a learner-control or program-control version of instruction. A significant three-way interaction (prior knowledge × preference scores × type of control) revealed that students with high prior knowledge achieved better on the posttest when their preference for control was matched with the type of control they received, whereas students with low prior knowledge achieved better when their preference was mismatched. A significant three-way interaction on attitude reflected the same pattern found in the interaction for achievement scores. The overall results indicate that matching learner preference to the type of program they receive is an effective strategy for high-prior-knowledge students but not for those with low prior knowledge.

情报检索的理论和方法在改善搜索引擎搜索性能中的应用

本文认为计算机情报检索的理论与方法对改善搜索引擎的搜索性能具有重要意义，并从索引数据库和检索功能两方面探讨了改善其搜索性能的措施。     

Chemistry problem solving instruction: a comparison of three computer-based formats for learning from hierarchical network problem representations

Within the cognitive load theory framework, we designed and compared three alternative instructional solution formats that can be derived from a common static hierarchical network representation depicting problem structure. The interactive-solution format permitted students to search in self-controlled manner for solution steps, static-solution format displayed all solutions steps, and no-solution format did not have solution steps. When we matched instructional time across the formats, in relation to the complex molarity problems rather than the dilution problems, differential transfer performance existed between the static-solution or no-solution formats and the interactive-solution format, but not between the static-solution format and no-solution format. The manner in which learners interact with the static-solution and no-solution formats depends on their level of expertise in the chemistry domain. With considerable learner expertise, provision of solution steps may be redundant incurring extraneous cognitive load. Absence of the solution steps may not have left sufficient cognitive capacity for germane cognitive load as some beginning learners lacked the prior knowledge to deduce the solution steps. Searching for solution steps presumably incurred extraneous cognitive load which interfered with learning and hence, in the interactive-solution format, it outweighed the benefit of engaging in self-regulated interaction with the content. Hence, cognitive load theory is a promising tool to predict the mental load associated with learning from the three alternative computer-based instructional formats.     

Do instant messaging interruptions help or hinder knowledge workers’ task performance?

The modern workplace environment is filled with interruptions due to the necessity of coworkers to communicate with each other. Studies have revealed that interruptions can impact task performance (TP). Communication interruptions are due, in part, to the unavoidable side-effect of using technology to facilitate these interactions. This experimental case study reports about an investigation we conducted on the role of instant messaging interruptions (IMI) and its implications on knowledge workers’ TP in a workplace environment. We have gathered data from knowledge workers engaged in an e-learning activity. The case study included a total of 60 experimental observations and analysis of the 120 records revealed that the time to complete a task (TPtct) for certain types of tasks, was significantly affected by IMI. This case study addressed gaps in IM interruption research and practical knowledge about the role of instant messages in the organization. Previous research has been conducted in a laboratory environment with interruptions generated by means other than actual IM. This case study used IMI with participants working in their normal workplace. Findings were used to provide a set of lessons learned recommendations for managers when it comes to the use of IM in the workplace.     

The interrupted learner: How distractions during live and video lectures influence learning outcomes

New instructional technologies have been increasingly incorporated into the medical school learning environment, including lecture video recordings as a substitute for live lecture attendance. The literature presents varying conclusions regarding how this alternative experience impacts students' academic success. Previously, a multi‐year study of the first‐year medical histology component at the University of Michigan found that live lecture attendance was positively correlated with learning success, while lecture video use was negatively correlated. Here, three cohorts of first‐year medical students (N = 439 respondents, 86.6% response rate) were surveyed in greater detail regarding lecture attendance and video usage, focusing on study behaviors that may influence histology learning outcomes. Students who reported always attending lectures or viewing lecture videos had higher average histology scores than students who employed an inconsistent strategy (i.e., mixing live attendance and video lectures). Several behaviors were negatively associated with histology performance. Students who engaged in “non‐lecture activities” (e.g., social media use), students who reported being interrupted while watching the lecture video, or feeling sleepy/losing focus had lower scores than their counterparts not engaging in these behaviors. This study suggests that interruptions and distractions during medical learning activities—whether live or recorded—can have an important impact on learning outcomes. Anat Sci Educ 11: 366–376. © 2017 American Association of Anatomists.     

Supporting Technical Professionals’ Metacognitive Development in Technical Communication through Contrasting Rhetorical Problem Solving

This article presents an experimental pedagogical framework for providing technical professionals with practice on writing skills focusing on the development of their metacognitive rhetorical awareness. The article outlines the theoretical foundation that led to the development of the framework, followed by a report of a pilot study involving information technology professionals in a global setting using an online learning environment that was designed based on the framework.     

Developing formative assessments for postgraduate students in engineering

This paper outlines an approach taken to produce computer-based formative assessments for two modules in a one-year taught MSc programme in Road Management and Engineering. It presents the aims of the assessments, the taxonomy adopted to ensure that the formulation of the questions addressed learning outcomes related to the development of higher order skills and the choice of software used. Further, the students’ qualitative perception of the assessments is presented together with a discussion on key elements that affected the implementation procedure. This included an understanding of the higher order skills assessed, knowledge of the facilities offered by the software to be used, and the commitment needed to designing, delivering and improving flexible learning materials.