Group differences in test-taking behaviour: an example from a high-stakes testing program

This study investigated whether different groups of test-takers vary in their reported test-taking behaviour in a high-stakes test situation. A between-group design (N = 1129) was used to examine whether high and low achievers, as well as females and males, differ in their use of test-taking strategies, and in level of reported test anxiety and motivation. The results showed differences between high and low achievers on a number of test-taking strategies, where high achievers reported using successful strategies to a higher extent. There were also gender differences: females, for example, reported using random guessing to a higher extent than males. Further, low achievers, especially females, reported significantly higher levels of test anxiety than high achievers, and high achievers reported slightly higher levels of motivation when compared to low achievers. To conclude, test-taking behaviour might bring additional variance to test scores, whether or not this is irrelevant variance is discussed.     

Effects of homework motivation and worry anxiety on homework achievement in mathematics and English

Direct and mediating effects of homework worry anxiety on homework effort and homework achievement and the differences in the structural relations among homework motivation constructs and homework achievement across mathematics and English homework were examined in 268 tenth graders in China. Homework motivation included task value, homework self-efficacy, homework worry anxiety, and motivation application. Homework accomplishments were rated by mathematics and English teachers. Homework value had positive effects on homework effort and worry anxiety in both subjects. Homework self-efficacy had positive and negative effects on homework effort and worry, respectively. Homework worry mediated the relation of homework value to effort and to achievement; the relation was more prominent in mathematics than in English homework. The mediating effects of worry anxiety in the relation of self-efficacy to homework effort and to achievement were significant only in mathematics. The domain specificity and direct and mediating effects were discussed in the cultural and educational context.     

Computer-based knowledge of results feedback in different delivery modes: Effects on performance,motivation, and achievement emotions

Immediate Knowledge of Results (KR) feedback at the task level may motivate test takers by showing that their answers matter. Appealing feedback cues may help to prevent negative emotions in lower performers who receive a higher amount of negative feedback. In this experiment, we varied the presence of KR feedback and the feedback delivery mode in a 1 × 5 between-subjects design (i.e., no feedback vs. text, color, sound, or animation feedback) to investigate effects on learning outcomes and affective-motivational measures. Our sample included 661 fifth and sixth graders who solved two computer-based multiple-choice science tests. First, students worked on an 18-item treatment test (with experimental feedback manipulation). Students repeatedly rated their effort, enjoyment, pride, and boredom during the test, as well as their expectancy of success and attainment value after the test. Subsequently, they worked on a posttest (without feedback) that assessed recall and near-transfer learning. All KR feedback conditions significantly increased recall, but there was no evidence for near-transfer learning. Feedback had a significant, negative effect on attainment value, whereas significant interactions between the feedback conditions and students’ treatment performance revealed that feedback effects on several affective-motivational dimensions (i.e., expectancy of success, enjoyment, pride, and boredom) were performance-dependent. Feedback benefited higher performers’ motivation and affect but showed negative effects on some affective-motivational measures for lower performers. The pattern of results indicated that color/sound/animation feedback may have reduced the effect of performance on emotional feedback perception to some extent. However, none of the feedback conditions improved affective-motivational outcomes independent of students’ performance.     

Motivational and cognitive test-taking strategies and their influence on test performance in mathematics

A structural equation model of relationships among testing-related motivation variables (test value, effort, self-efficacy, and test anxiety), test-taking strategies (test tactics and metacognitive strategies), gender, and math test performance were examined with a sample of 10th graders (N = 438; 182 males and 256 females). In general, motivation variables influenced the use of test-taking strategies and demonstrated stronger impacts on math performance than did test-taking strategies. Gender differences were found in self-efficacy and test anxiety. With a few surprising but culturally relevant results that warrant further investigation, the current study extended previous works on antecedents of academic achievement to testing situations within the self-regulated learning theory.     

Fear appeals in the primary classroom: Effects on test anxiety and test grade

The present study investigated whether fear appeals used prior to a test increased self-reported test anxiety and had a detrimental effect on test scores. Forty primary school pupils were instructed for one week under a low threat condition under which no fear appeals were made and another week under a high threat condition in which fear appeals were made salient. An end-of-week test was given in both conditions. Pupils reported an increase in test anxiety related worrisome thoughts and autonomic reactions under the high threat condition, but not in off-task behaviours. Test scores were lower under the high threat condition, but were not attributable to the increases in test anxiety related thoughts and autonomic reactions. This study adds weight to the argument that fear appeals are a damaging classroom strategy, but the mechanism by which fear appeals are reducing test scores is not yet clear.     

Role of academic self-efficacy in moderating the relation between task importance and test anxiety

Emphasizing task importance, which is regarded as a way of motivating engaged behavior, may increase an individual's anxiety. The present research investigated whether academic self-efficacy could moderate the maladaptive relation between task importance and test anxiety. 1978 and 1670 Grade 9 Singaporean students participated in a survey related to their learning experience and motivational processes in math and English respectively. Results from both samples showed convergent findings that high levels of task importance were related to high levels of test anxiety, whereas high levels of academic self-efficacy were related to low levels of test anxiety. Most importantly, academic self-efficacy moderated the relation between task importance and test anxiety—the maladaptive relation between task importance and test anxiety was significantly weaker when academic self-efficacy was higher. Implications of findings are discussed.     

Additive and multiplicative effects of working memory and test anxiety on mathematics performance in grade 3 students

The aim of this study was to investigate the interplay between test anxiety and working memory (WM) on mathematics performance in younger children. A sample of 624 grade 3 students completed a test battery consisting of a test anxiety scale, WM tasks and the Swedish national examination in mathematics for grade 3. The main effects of test anxiety and WM, and the two-way interaction between test anxiety and WM on mathematics performance, were modelled with structural equation modelling techniques. Additionally, the effects were also tested separately on tasks with high WM demands (mathematical problem-solving) versus low WM demands (basic arithmetic). As expected, WM positively predicted mathematics performance in all three models (overall mathematics performance, problem-solving tasks, and basic arithmetic). Test anxiety had a negative effect on problem-solving on the whole sample level but concerning basic arithmetic only students with lower WM were affected by the negative effects of test anxiety on performance. Thus, students with low WM are more vulnerable to the negative effects of test anxiety in low WM tasks like basic arithmetic. The results are discussed in relation to the early identification of test anxiety.     

The developmental trajectory of intrinsic reading motivation: Measurement invariance,group variations,and implications for reading proficiency

The goal of the present study is to extend previous research on the developmental trajectory of intrinsic reading motivation during early adolescence. Using large-scale panel data on secondary school students in Germany, we examined: (1) the longitudinal measurement invariance of intrinsic reading motivation, (2) the generalizability of the developmental trajectory of intrinsic reading motivation across students’ gender, parental socioeconomic status (SES), and school tracks (academic vs. vocational), and (3) the associations between the developmental trajectory of intrinsic reading motivation and the developmental trajectory of reading proficiency. The scale we used to measure intrinsic reading motivation showed the (strict) measurement invariance across six occasions of measurement from Grades 5 to 10, indicating the high structural similarity (e.g., factor loadings, intercepts) of intrinsic reading motivation during early adolescence. Our analyses of latent growth curve models also confirm previous findings that students tend to experience a steady and significant linear decline in intrinsic reading motivation from Grades 5 to 10. This developmental decline also seems to be more pronounced in size (Δ =  − 0.772, p < .001) than previously reported. The developmental decline in intrinsic reading motivation was observed irrespective of students’ gender, parental SES, and school tracks. Male students expressed lower mean-levels of intrinsic reading motivation across the waves and exhibited a steeper motivational decline compared to female students. Despite mean-level differences across the waves, students showed similar degrees of a motivational decline across parental SES and school tracks. Finally, the larger decline in students’ intrinsic reading motivation was associated with the smaller growth of their reading proficiency from Grades 5 to 10. Our study provides further support for the high prevalence of the developmental decline in intrinsic reading motivation during early adolescence, its generalizability across students’ demographic characteristics, and its implications for the development of reading proficiency.     

Little more than personality: Dispositional determinants of test anxiety (the Big Five, core self-evaluations, and self-assessed intelligence)

This study attempted a hierarchical integration of several dispositional determinants of test anxiety (TA) [Sarason, I.G. (1984). Stress, anxiety and cognitive interference: Reactions to tests. Journal of Personality and Social Psychology, 46, 929–938.], namely the Big Five personality traits [Costa, P.T. Jr., & McCrae, R.R. (1992). Revised NEO personality inventory (NEO-PI-R) and NEO five-factor inventory (NEO-FFI): Professional manual. Odessa: Psychological Assessment Resources.], core self-evaluations (CSE) [Judge, T.A., Erez, A., Bono, J.E., & Thoreson, C.J. (2003). The Core Self-Evaluation Scale: Development of a measure. Personnel psychology, 56, 303–331.], and self-assessed intelligence (SAI) [Furnham, A. (2001). Self-estimates of intelligence: Culture and gender difference in self and other estimates of both general (g) and multiple intelligences. Personality and Individual Differences, 31, 1381–1405.] in a sample of 388 US and UK university students. Structural equation models showed that TA was largely a function of Neuroticism, and that CSE and SAI do not contribute to the prediction of TA over established personality traits. Furthermore, the relationship between CSE and TA was fully accounted for by personality traits, whereas SAI was not a significant predictor of TA. The results undermine the notion that self-beliefs affect TA and suggest that wider dispositions play a salient role determining individual differences in TA. Theoretical and applied implications are discussed, particularly in regards to educational settings.     

Portfolios as a tool for AfL and student motivation: are they related?

ABSTRACT

The power of portfolios in enhancing student motivation is frequently emphasised. Portfolios are conceptualised as a tool to implement Assessment for Learning (AfL) in classroom practice. However, the relation between portfolios and AfL on the one hand, and student motivation on the other hand, is complex and subject to many assumptions. This study investigates whether portfolio use actually supports the integration of AfL in classroom practice and the relation with students’ motivation. Questionnaires were administered to a total of 419 grade 4 to 6 students from seven Dutch elementary schools. The results of structural equation modelling did not confirm a direct relation between portfolio use and students’ motivational orientation. The findings indicate that the relation between portfolios and motivational orientation is fully mediated by students’ perceptions of AfL. The findings indicate that the tool portfolio is not related to students’ motivation, however, AfL practices do affect motivation.     

Attachment,self-esteem and test anxiety in adolescence and early adulthood

The purpose of this study was to assess how attachment dimensions (anxiety and avoidance), self-esteem, and three subscales of test anxiety – cognitive obstruction, social derogation and tenseness are related in two age groups: adolescents and college students. Participants (N?=?327) completed relevant questionnaires. Results showed that college students revealed higher test anxiety than did high school students on the cognitive obstruction and tenseness scales, whereas high school students revealed higher social derogation than college students. Anxious attachment was related to all three sub-scales of test anxiety and avoidant attachment was related to cognitive obstruction among college students and to tenseness among high school students. Most of the correlations between anxious attachment and test anxiety were mediated by self-esteem among high school students. The mediation ability of self-esteem was weaker among college students.     

Evaluating the effectiveness of a mindfulness coloring activity for test anxiety in children

The authors investigated the effectiveness of a mindfulness art activity compared with a free draw/coloring activity on test anxiety in children. The sample consisted of 152 students (50% female; M_age = 10.38 years, SD = 0.88 years) randomly assigned to a mindful (n = 76) or free (n = 76) group. Participants completed a standardized measure of anxiety and state mindfulness before and after the coloring activity, immediately before a spelling test, as well as a measure of dispositional mindfulness. Results revealed an overall significant decrease in test anxiety and an overall significant increase in state mindfulness following the interventions. Furthermore, although a significant negative correlation was found between dispositional mindfulness and change in state mindfulness pre- and post-coloring intervention, a significant positive correlation was found between dispositional mindfulness and pre-intervention state mindfulness, suggesting a possible ceiling effect. Explanations for these findings and implications for school personnel and future research are discussed.     

Social and dimensional comparisons in math and verbal test anxiety: Within- and cross-domain relations with achievement and the mediating role of academic self-concept

The present study builds on two strands of research: (1) the recently established generalized internal/external frame of reference (GI/E) model assuming social (comparing one’s achievement in one domain with the achievement of one’s peers in the same domain) and dimensional (comparing one’s achievement in one domain with one’s achievement in another domain) comparison processes in the formation of motivational constructs and self-perceptions, and (2) research on domain-specific facets of test anxiety. Using a sample of 5135 German seventh grade students, it is tested whether and how both comparison processes are involved in the formation of domain-specific facets of test anxiety when considering both the emotionality and worry components of test anxiety, and whether the relation between achievement and test anxiety is mediated through academic self-concept. When applying the GI/E model to test anxiety, the results showed negative relations between achievement and test anxiety within math and verbal (German) domains, but partially positive relations across domains. This pattern of relations emerged for both the worry and emotionality components while stronger achievement relations were found for worry. These findings indicate that dimensional achievement comparison processes operate in the formation of domain-specific test anxiety. Domain-specific academic self-concepts were found to mediate the relations between achievement and test anxiety within and across domains, the mediation being stronger for worry than for emotionality as an outcome. Boys and girls did not differ regarding direct and indirect relations among constructs. Implications for research on dimensional comparison processes and test anxiety are discussed.     

Measurement invariance and validity of a brief questionnaire on reading motivation in elementary students

In order to initiate more research on the role of reading motivation during the initial stages of learning to comprehend texts, we developed the Reading Motivation Questionnaire for Elementary Students (RMQ‐E). The sample comprised 1497 elementary students in Grades 1–3. By means of exploratory and confirmatory factor analyses, three factors were determined: Curiosity, involvement and competition. The three‐factor structure of the RMQ‐E was found to be invariant across grade levels (scalar invariance) and across female and male students (strict invariance). As was anticipated, students in higher grades and male students were lower in curiosity and involvement than students in lower grades and female students. Whereas competitive reading motivation did not differ across grade levels, it was higher for boys than for girls. Moreover, the contributions of involvement and competition to reading amount and reading competence were in accordance with the hypotheses. The predictive validity of curiosity, however, was not confirmed.     

The merits of representational pictures in educational assessment: Evidence for cognitive and motivational effects in a time-on-task analysis

Adding representational pictures (RPs) to text-based items has been shown to improve students’ test performance. Focusing on potential explanations for this multimedia effect in testing, we propose two functions of RPs in testing, namely, (1) a cognitive facilitation function and (2) a motivational function. We found empirical support for both functions in this computer-based classroom experiment with N = 410 fifth and sixth graders. All students answered 36 manipulated science items that either contained (text-picture) or did not contain (text-only) an RP that visualized the text information in the item stem. Each student worked on both item types, following a rotated within-subject design. We measured students’ (a) solution success, (b) time on task (TOT), and identified (c) rapid-guessing behavior (RGB). We used generalized and linear mixed-effects models to investigate RPs’ impact on these outcome parameters and considered students’ level of test engagement and item positions as covariates. The results indicate that (1) RPs improved all students’ performance across item positions in a comparable manner (multimedia effect in testing). (2) RPs have the potential to accelerate item processing (cognitive facilitation function). (3) The presence of RPs reduced students’ RGB rates to a meaningful extent (motivational function). Overall, our data indicate that RPs may promote more reliable test scores, supporting a more valid interpretation of students’ achievement levels.     

Cognitive ability,exam-related emotions and exam performance: A field study in a college setting

Using lab and field data, this paper investigates (a) the degree to which pre- and post-exam positive and negative achievement emotions and cognitive ability are uniquely and jointly associated with exam performance and (b) the degree to which exam performance influences subsequent post-exam emotions. Based on a sample of 102 students, results show that ability influences exam performance both directly and indirectly via pre-exam emotions. Also, ability and distraction interact to influence performance such that ability has a buffering effect. Distraction has a significant deleterious effect on performance for low ability students, but does not disrupt performance for high ability students. Moreover, positive emotions facilitate performance by decreasing distraction whereas negative emotions hinder performance by increasing it. Finally, results show that the exam itself has a significant impact on post-exam positive and negative emotions, even when controlling for pre-exam emotions. Results are discussed in terms of the emerging research on achievement emotions beyond test anxiety.     

Processes and effects of test preparation for writing tasks in a high-stakes admission test in China: Implications for test takers

This study investigated the processes and effects of test preparation for a high-stakes English admission test in the context of tertiary education. A total of 623 Chinese college students who were preparing for the writing tasks of the Graduate School Entrance English Examination (GSEEE) responded to the questionnaire survey. In terms of the processes for test preparation, five components emerged: memorization, test familiarization, comprehensive learning, skill development, and drills. With regard to the effects of test preparation, regression analysis of 161 GSEEE writing scores revealed that test takers’ language proficiency and individual preparation efforts had a significantly positive effect on test scores. The findings highlight two specific preparation activities that produce positive test outcomes and cast doubt on the effects of prevailing memorization practices, which consist of the memorization of all-purpose sentence patterns. The implications of these results for improving test preparation for test takers are discussed.     

The predicting roles of approaches to learning,L2 learning motivation,L2 learning strategies and L2 proficiency for learning outcomes: a comparison between Mainland and Hong Kong Chinese students

This study examined (1) differences in background, integrative/instrumental motivation, learning approach, leaning strategy and proficiency in second language (L2) and (2) the determinants of learning outcomes between Hong Kong and Mainland (Chinese) students. To achieve this, a questionnaire survey was distributed to 773 s language learners across four universities in Hong Kong and Mainland China to students in Bachelor of Education (English Language) programmes. The results showed that L2 proficiency was the strongest predictor of learning outcomes for Hong Kong and Mainland students, while integrative motivation was also a significant predictor of learning outcomes in both sample groups. In addition, instrumental motivation, deep approaches, and learning strategies were found to be significant predictors of learning outcomes for Mainland students. Mainland students demonstrated lower levels of motivation, learning approaches, learning strategies, L2 proficiency, as well as learning outcomes relative to Hong Kong students. Implications for curriculum design, classroom teaching and assessment, and future research are discussed in the paper.     

Quantifying participation in,and the effectiveness of,remediating assessment in a university mathematics module

In Maths for Business, a large first-year mathematics module, the continuous assessment component comprises 10 weekly quizzes which combine to contribute 40% of the final module mark. If students did not receive the full five marks on their weekly quiz, they were provided with the opportunity to resubmit their corrected weekly quiz with an explanation of their error(s) for one additional mark. We refer to this process as ‘remediation’. Of the students who had the opportunity to remediate, ～70% did. Through examining learning management system data, we show that the remediation process encouraged students to access module resources. Furthermore, by using a Bayesian hierarchical model to account for students’ level of participation, achievement and prior knowledge, we show that participation in the remediation process positively impacted the final examination marks of moderate to high-achieving students (based on initial continuous assessment marks). However, participation in the remediation process provided limited benefit to low-achieving students. We conjecture this is because these students had not achieved a level of understanding whereby participation in the remediation process could progress their knowledge.