Not playing the game: student assessment resistance as a form of agency

Within self-regulated learning, learners exercise agency by setting targets, formatively monitoring progress, and evaluating results in ways which inform their own goal attainment. However, in real-world classroom situations, assessment processes can elicit behaviours that are more ego-protective than growth-oriented. Resistance to teacher expectations in assessment can arise from the individual’s need to protect his or her own identity or ego within the psychosocial context of the classroom. In addition, resistance can arise from strategic choices learners make to cope with competing demands on their time and resources. Thus, students may exercise their agency by not following assessment expectations or protocols (e.g. lying, cheating, or failing to give their best effort). These choices seem to undermine assessment validity. This paper shares student voice data from the Measuring Teachers’ Assessment Practices (MTAP) project (n = 46 students in seven focus groups) in New Zealand and the Supporting Student-assessment Success (SSAS) Project (n = 108 first-year university students) in Australia. Both highlight the different ways students resist, subvert, or act in contention with assessment. These data show that students in both sectors do not always act in the growth-oriented ways that educators envision. Students reported exercising potentially maladaptive assessment agency via Assessment dishonesty, Purposeful underperformance, and Doing it alone. These categories were underpinned by three differing rationales: Protection, Strategic prioritisation, and Mini-max. Educators must be mindful of these potential student actions and motives, working to establish psychological safety within the learning environment, and making sure links between learning and assessment are clear.     

Students’ participation in peer-to-peer communication supported by social media

Social media (SM) support new approaches to learning that rely on voluntary, peer-to-peer communication using devices and software provided and managed by students rather than on institutional course management systems. We present one case of such an approach with first-year university students (n = 86) in Thailand using SM for asking and answering questions between peers in a face-to-face computer-programming course. Encouraging students to ask questions about course content can result in improved performance. In general, understanding how students participate and what drives them to participate can provide insights into how universities and instructors can be socially ready. Students used SM during 10 weeks of an 18-week course. Each of four sections selected one form of SM as follows: Facebook [n = 33], Instagram [n = 21], Twitter [n = 21], and Line [n = 11]. The mixed-methods case study involved quantitative measures of how students participated and quantitative and qualitative measures of students’ perceptions of what drives or discourages their participation. Results revealed patterns in participation as follows: participation and motivation; passive and active participation; participation and sample size; participation and type of SM and; participation and student demographics. Implications for practice relate to the value of instructors’ understanding of the social incentives for student participation such as social recognition, gratification of needs and convenience. Implications for research focus on the value of investigating new forms of participation available to read-only participants and ‘lurkers’ using features of SM such as ‘liking’ and sharing.     

Using new vocabulary in writing: Exploring how word and learner characteristics relate to the likelihood that writers use newly taught vocabulary

Understanding academic vocabulary is essential to student success in school. Use of academic vocabulary words in writing is considered one of the strongest measures of how well a reader understands a given word. In theory, willingness to use academic vocabulary in writing indicates the complexity of acquiring representations of the word’s orthography, phonology, and semantics based on the word’s characteristics. In addition, a learner’s overall literacy skills should relate to whether they attempt to use words. In the present study, sixth graders (n = 66), seventh graders (n = 60), and eighth graders (n = 41) learned 25 academic vocabulary words in a supplementary academic vocabulary intervention and were then asked to use those words in short persuasive essay drafts. We measured whether these students attempted to use a word (a binary uses outcome) and the number of times a student used a word (a continuous attempts outcome) and used cross-classified random effects models to examine how (a) the orthographic, phonological, and semantic characteristics of words and (b) the students’ literacy-related characteristics related to their uses and attempts. For word characteristics, students were more likely to use and attempt high frequency than low frequency words. For student characteristics, students proficient on the state exam were more likely to use and attempt the words, and students learning English were less likely to attempt the words. Implications for vocabulary intervention and writing instruction are discussed.     

Conditional cooperators: student prosocial dispositions and their perceptions of the classroom social environment

A common problem in education is getting students to cooperate effectively in groups during learning. Because interdisciplinary research has established that cooperation is sensitive to specific contextual factors such as reciprocity, friendship and benefit, similar factors could be shaping student interactions in contemporary classroom environments. The present article reports an initial investigation of this idea by examining how student perceptions of their classroom environment relate to their willingness to expend energy and resources on classmates (through helping). This was accomplished through the structural equation modeling of survey data collected from 845 undergraduate life sciences students from 41 laboratory classrooms at a research-intensive university. Characteristics of the classroom social environment previously associated with benefits in other contexts also predicted (reciprocity β = 0.576; friendship β = 0.156) the educational benefit that students perceive as coming from their classmates. This perceived benefit in turn was highly associated (β = 0.605) with student willingness to expend resources on classmates (i.e. their prosocial disposition). Also both reciprocity (β = 0.298) and perceived benefit (β = 0.403) concurrently predict a student’s support for enforcing cooperation in the classroom. Potential insights into the contribution of classroom social environment to student dispositions towards cooperation are discussed.     

Clarifying an Elusive Construct: a Systematic Review of Writing Attitudes

Although research recognizes that student attitudes toward writing have the potential to influence a variety of writing outcomes, there is no consensus as to what writing attitude signifies. Further, disparities between conceptualizations of writing attitude make the extant literature difficult to reconcile. In the present study, we systematically review writing attitude research published between 1990 and 2017. Our search procedure and quality analysis led to the retention of 46 articles examining the writing attitudes of students and teachers. Relatively few studies (n = 10) provided an explicit definition of writing attitudes. Further, although the authors of many studies (n = 16) conceptualized writing attitude as including a measure of liking/disliking writing, there was considerable variability in both conceptualization and operationalization throughout the literature, with some studies including measures of self-efficacy, perceived value, and other related constructs. Student writing attitudes were measured in a majority of the included studies (n = 33), and teacher writing attitudes were measured in substantially fewer studies (n = 6). Based on the findings of this review, we offer suggestions for researchers making inferences from studies of writing attitudes. Themes of the reviewed literature and implications for future research are also discussed.     

Developing a conceptual framework for participatory design of psychosocial and physical learning environments

The present study shows how the mixed-methods approach can be used in capturing and organising learning environment (LE) characteristics for the participatory design of psychosocial and physical LEs involving learners. Theoretical constructs were tested and further elaborated on in the analysis of two similar educational design research studies: one conducted with 7- to 14-year-old learners in Finland (n = 80); and the other in Spain (n = 76). Cross-analysis of the numeric, visuospatial and verbal data collected, combined with theoretical and practical considerations, was used to develop a conceptual framework for LE co-design, which draws attention to the importance of balancing communality with individuality, comfort with health, and novelty with conventionality. In line with other studies, in this conceptualisation, flexibility and functionality are seen as central enablers for quality twenty-first century LEs. The knowledge exchange between two countries and the constructs developed in this cross-cultural analysis contribute to the creation of shared content-related design principles for future learning environments.     

Development and Evaluation of the Diagnostic Power for a Computer-Based Two-Tier Assessment

This study adopted a quasi-experimental design with follow-up interview to develop a computer-based two-tier assessment (CBA) regarding the science topic of electric circuits and to evaluate the diagnostic power of the assessment. Three assessment formats (i.e., paper-and-pencil, static computer-based, and dynamic computer-based tests) using two-tier items were conducted on Grade 4 (n = 90) and Grade 5 (n = 86) students, respectively. One-way ANCOVA was conducted to investigate whether the different assessment formats affected these students’ posttest scores on both the phenomenon and reason tiers, and confidence rating for an answer was assessed to diagnose the nature of students’ responses (i.e., scientific answer, guessing, alternative conceptions, or knowledge deficiency). Follow-up interview was adopted to explore whether and how the various CBA representations influenced both graders’ responses. Results showed that the CBA, in particular the dynamic representation format, allowed students who lacked prior knowledge (Grade 4) to easily understand the question stems. The various CBA representations also potentially encouraged students who already had learning experience (Grade 5) to enhance the metacognitive judgment of their responses. Therefore, CBA could reduce students’ use of test-taking strategies and provide better diagnostic power for a two-tier instrument than the traditional paper-based version.     

Der Zusammenhang von Schulleitungshandeln,Unterrichtsgestaltung und Lernerfolg

Indicators and instruments for determining and measuring school quality within inspection systems are usually based on frameworks for inspection. These frameworks rely heavily upon school and teacher effectiveness research. Thus, a central assumption is that the effectiveness and improvement-oriented school conditions, as measured within an inspection, are related to student achievement. It is unclear if this assumption really holds true, as empirical evidence is still lacking. This study uses data from a random sampling of schools (n = 37) and teachers (n = 1663) and the achievement data from students (n = 23,943) to validate the interpretations and uses of school inspection results regarding the factor school leadership. The study follows Kane’s argument-based approach for validation. Results reveal that principals of schools with recurrent high student achievement very often demonstrate instructional leadership. It is evident that these principals are also leading in a fundamentally different way from principals in schools with lower achievement in that they lead with the specific school context in mind. The study demonstrates that it is possible to make inferences from scores provided by school inspections and to generalize from them. However, this generalizability does not extend to making extrapolations or decisions based on these scores. The analyses make it clear that providing feedback solely on the strengths and weakness of a school is insufficient when it comes to stimulating school improvement through inspection.     

Promoting Conceptual Change for Complex Systems Understanding: Outcomes of an Agent-Based Participatory Simulation

Components of complex systems apply across multiple subject areas, and teaching these components may help students build unifying conceptual links. Students, however, often have difficulty learning these components, and limited research exists to understand what types of interventions may best help improve understanding. We investigated 32 high school students’ understandings of complex systems components and whether an agent-based simulation could improve their understandings. Pretest and posttest essays were coded for changes in six components to determine whether students showed more expert thinking about the complex system of the Chesapeake Bay watershed. Results showed significant improvement for the components Emergence (r = .26, p = .03), Order (r = .37, p = .002), and Tradeoffs (r = .44, p = .001). Implications include that the experiential nature of the simulation has the potential to support conceptual change for some complex systems components, presenting a promising option for complex systems instruction.     

Teacher Professional Development and Student Literacy Growth: a Systematic Review and Meta-analysis

This systematic review explores the impact of teacher professional development (PD) on student reading achievement. The first part of the literature evaluates all available existing systematic reviews and meta-analyses of PD intervention studies. No quality reviews of PD and reading specifically (distinct from ‘attainment’) were found. There was a little overlap of studies in existing reviews. The second part of the systematic review focuses on the most recent intervention studies exploring PD and student reading achievement. The results of a meta-analysis of all high-quality studies are presented in the third part of the paper. This analysis showed no strong evidence of publication bias and an effect size for PD on student literacy of g = 0.225. This effect was moderated by the number of hours of PD whereby studies with fewer than 30 h of PD was significant for student reading outcomes (g = 0.367, p < 0.001) but more than 30 PD hours was not significant (g = 0.143, p > .05). Following a Weight of Evidence assessment, analysis showed that nearly all high-quality articles involved shorter PD. Weight of Evidence was a significant moderator, (g = 0.408, p < 0.001 for high-quality studies, g = 0.077, p > 0.5, n.s., for medium quality studies). Our review suggests that only high-quality studies of short teacher PD currently provide evidence of impact on student’s reading achievement.     

Exploring Flipped Classroom Instruction in Calculus III

In an undergraduate Calculus III class, we explore the effect of “flipping” the instructional delivery of content on both student performance and student perceptions. Two instructors collaborated to determine daily lecture notes, assigned the same homework problems, and gave identical exams; however, compared to a more traditional instructional approach, the flipped instructor utilized videos to communicate more procedural course content to students out-of-class, with time in-class spent on more conceptual activities and homework problems. Findings from two semesters indicate similar performance on more procedural problems and small to moderate gains for the flipped students (N = 74) over their traditional counterparts (N = 77) on more conceptual exam problems. However, student perceptions remain mixed, with flipped students reporting increased communication during class but traditional students perceiving more effective use of class time, despite the gains in performance for flipped students.     

Spelling pronunciations help college students remember how to spell difficult words

Studies have shown that children benefit from a spelling pronunciation strategy in remembering the spellings of words. The current study determined whether this strategy also helps adults learn to spell commonly misspelled words. Participants were native English speaking college students (N = 42), mean age 22.5 years (SD = 7.87). An experimental design with random assignment, pretests, training, and posttests assessed effects of the pronunciation strategy on memory for the spellings of 20 hard to spell words. Half of the participants were trained to read the words by assigning spelling pronunciations during learning (n = 21). The comparison group (n = 21) practiced reading the words normally without the strategy. Strategy trained adults recalled significantly more words, total letters, silent letters, and schwa vowel letters correctly than controls. Poor spellers benefited as much if not more from this strategy as good spellers. Results support orthographic mapping theories. Optimizing the match between spelling units and sound units, including graphemes and phonemes, syllables, and morphemes, to create spelling pronunciations when words are read enhances memory for spellings of the words. As a result, higher quality lexical representations are retained in memory. Results suggest the value of teaching college students this strategy to improve their ability to spell words correctly in their written work.     

Studying and Constructing Concept Maps: a Meta-Analysis

A concept map is a node-link diagram in which each node represents a concept and each link identifies the relationship between the two concepts it connects. We investigated how using concept maps influences learning by synthesizing the results of 142 independent effect sizes (n = 11,814). A random-effects model meta-analysis revealed that learning with concept and knowledge maps produced a moderate, statistically significant effect (g = 0.58, p < 0.001). A moderator analysis revealed that creating concept maps (g = 0.72, p < 0.001) was associated with greater benefit relative to respective comparison conditions than studying concept maps (g = 0.43, p < 0.001). Additional moderator analyses indicated learning with concept maps was superior to other instructional comparison conditions, and was effective across science, technology, engineering, and math (STEM) and non-STEM knowledge domains. Further moderator analyses, as well as implications for theory and practice, are provided.     

Problem-Centered Supplemental Instruction in Biology: Influence on Content Recall,Content Understanding,and Problem Solving Ability

To address the need for effective, efficient ways to apply active learning in undergraduate biology courses, in this paper, we propose a problem-centered approach that utilizes supplemental web-based instructional materials based on principles of active learning. We compared two supplementary web-based modules using active learning strategies: the first used Merrill’s First Principles of Instruction as a framework for organizing multiple active learning strategies; the second used a traditional web-based approach. Results indicated that (a) the First Principles group gained significantly from pretest to posttest at the Remember level (t(40) = ?1.432, p = 0.08, ES = 0.4) and at the Problem Solving level (U = 142.5, N1 = 21, N2 = 21, p = .02, ES = 0.7) and (b) the Traditional group gained significantly from pretest to posttest at the Remember level (t(36) = 1.762, p = 0.043, ES = 0.6). Those in the First Principles group were significantly more likely than the traditional group to be confident in their ability to solve problems in the future (χ² (2, N = 40) = 3.585, p = 0.09).     

The impact of student teaching experience on pre-service teachers’ readiness for technology integration: A mixed methods study with growth curve modeling

Adopting a two-phase explanatory sequential mixed methods research design, the current study examined the impact of student teaching experiences on pre-service teachers’ readiness for technology integration. In phase-1 of quantitative investigation, 2-level growth curve models were fitted using online repeated measures survey data collected from 68 pre-service teachers doing their student teaching. The results revealed significant progress in readiness for technology integration during student teaching and significant variability in individual change trajectories of readiness for technology integration. Two dummy variables, prior-teaching (0 = “having no prior teaching experience”; 1 = “having prior teaching experience”) and grade-level (0 = “elementary level”; 1 = “secondary level”), were identified as significant in predicting the shape of individual change trajectories of readiness for technology integration. In phase-2 of qualitative investigation, follow-up interview data were collected from 11 pre-service teachers among those who participated in the online surveys. The interview data was analyzed both deductively and inductively yielding clues and insights for interpreting and understanding the quantitative results from phase-1. Based on its quantitative and qualitative results, this study made recommendations for future technology integration research and for improving pre-service teachers’ technology use experience during student teaching.     

Preservice Biology Teachers’ Conceptions About the Tentative Nature of Theories and Models in Biology

In research on the nature of science, there is a need to investigate the role and status of different scientific knowledge forms. Theories and models are two of the most important knowledge forms within biology and are the focus of this study. During interviews, preservice biology teachers (N = 10) were asked about their understanding of theories and models. They were requested to give reasons why they see theories and models as either tentative or certain constructs. Their conceptions were then compared to philosophers’ positions (e.g., Popper, Giere). A category system was developed from the qualitative content analysis of the interviews. These categories include 16 conceptions for theories (n _tentative = 11; n _certain  = 5) and 18 conceptions for models (n _tentative = 10; n _certain = 8). The analysis of the interviews showed that the preservice teachers gave reasons for the tentativeness or certainty of theories and models either due to their understanding of the terms or due to their understanding of the generation or evaluation of theories and models. Therefore, a variety of different terminology, from different sources, should be used in learning-teaching situations. Additionally, an understanding of which processes lead to the generation, evaluation, and refinement or rejection of theories and models should be discussed with preservice teachers. Within philosophy of science, there has been a shift from theories to models. This should be transferred to educational contexts by firstly highlighting the role of models and also their connections to theories.     

Secondary science teachers’ implementation of CCSS and NGSS literacy practices: a survey study

Most middle and high school students struggle with reading and writing in science. This may be because science teachers are reluctant to teach literacy in science class. New standards now require a shift in the way science teachers develop students’ literacy in science. This survey study examined the extent to which science teachers report implementing science literacy practices from the Common Core Literacy in Science and Technical Subjects and the Next Generation Science Standards with their students. A survey detailing these practices was emailed to all secondary science teachers (N = 2519) in one northeastern state and 14% of them (n = 343) responded. Practices that aligned more closely with disciplinary literacy skills and strategies were implemented more often when compared to the practices aligned with intermediate literacy skills and strategies. Since the development and intermediate skills are important to support students’ literacy progression from foundational to disciplinary, secondary science teachers may not be providing enough support for their students to be competently literate in science, in a fundamental literacy sense. This, in turn, impacts students’ ability to use fundamental literacy skills toward knowledge-building in science, achieving a derived sense of science literacy.     

Interplay of formative assessment and instructional quality—interactive effects on students’ mathematics achievement

Formative assessment is considered to be a promising teaching practice for promoting teaching and learning processes. The implementation of teaching practices into instruction involves intervening with a learning environment that is characterised by certain features of instructional quality. Our study aims to contribute to the understanding of formative assessment by analysing the interplay between a formative assessment intervention and aspects of general instructional quality. In a quasi-experimental study design, 15 teachers participated in a control group (n = 361 students) and 20 teachers in the intervention classes (n = 498 students) implemented a curriculum-embedded formative assessment tool in their ninth-grade mathematics classes. No effects were found for the intervention on the assessed aspects of general instructional quality (process-oriented instruction, teacher–student relationship, effective use of instructional time). However, multilevel regression analyses revealed an interaction effect between the intervention and process-orientation and the effective use of instruction time. Our findings suggest that implementing formative assessment tools do not seem to suffice regarding changes in general instructional quality, but that an intervention with detailed material and guidelines can counterbalance effects of instructional quality, fostering students’ achievement in classes with lower degrees of process orientation and a less effective use of instructional time.