Does teaching to the test improve student learning?

A central concern surrounding test-based accountability is that teachers may narrow teaching practices to improve test performance on a curriculum-based specific knowledge test rather than student learning more broadly. Two of the most common teaching practices that “teach to the test” are providing test-specific classwork and increasing the frequency with which students take practice tests. Whether such teaching practices improve student learning—both in terms of learning the content associated with a specific knowledge test as well as more general learning—is a largely unanswered question. To approach this question, this paper uses a student fixed effects approach to analyze the impact of these kinds of narrow teaching practices on student performance on a specific test as well as a general knowledge test. We find that test-specific classwork and practice tests with specific test items tend to have little or negative impacts on curriculum specific or general knowledge test performance, except for male students, and that subject practice tests (without emphasizing test-specific items) have positive effects on student outcomes on both kinds of tests, but larger on the curriculum-specific than on the general test, and much larger on the curriculum-specific test for male students. We discuss the logic for these results and what they tell us about the effectiveness of test-focused teaching practices more generally.     

Does the accuracy matter? Accurate concept map feedback helps students improve the cohesion of their explanations

Students are often challenged by the demand of writing cohesive explanatory texts. Prior research has shown that providing students with concept map feedback that visualizes explanatory cohesion deficits helped students generate more cohesive explanations. We conducted an experiment to investigate whether the accuracy of the provided information within the concept map feedback affected students’ improvements of cohesion. Accordingly, we varied the represented accuracy of information within such concept maps: Students either received accurate concept map feedback that depicted the real relations between concepts, as well as the authentic cohesion gaps in their explanations, or students received inaccurate concept map feedback, which depicted randomly drawn relations and random cohesion gaps. Additionally, in a baseline condition, students did not receive any feedback. We found that the students in the accurate feedback condition generated more cohesive explanations than the students in the no-feedback condition, whereas the students in the inaccurate feedback condition lay in-between. Evidently, providing feedback in general can be regarded as beneficial to enhance students’ writing. However, the accuracy of the provided feedback further impacts the effectiveness of computer-generated concept maps.     

Does evaluation of teaching lead to improvement of teaching?

Abstract

Given the widespread use of student evaluation of teaching in North American colleges and universities, it is reasonable to ask whether student evaluation has accomplished one of its major intended outcomes, namely improvement of instructional quality. A review of research evidence from three independent sources (faculty surveys, field experiments and longitudinal comparisons) suggests that student evaluation does in fact contribute significantly to improvement of certain aspects of university teaching, particularly if evaluation is supplemented by expert consultation. Furthermore, there is no clear evidence that student evaluation has led to undesirable instructional side‐effects, such as grade inflation and entrenchment of traditional teaching methods.     

How can historical understanding best be assessed? Use of prediction tasks to assess how students understand the role of causal factors that produce historical events

The main objective of this research is to study the viability of using hypothetical problems that need the application of causal models for their solution, as a method for assessing understanding in Social Sciences. So, this method was used to describe how seventh grade students understand causal factors affecting the “discovery and colonization of America”. First, the causal model expected to have been understood was made explicit. Then, eight problems were designed to assess whether students were able to deduce the implications of past conditions and to use these implications to anticipate what consequences would most likely follow in each of the hypothetical problems. 51 seventh graders were interviewed with this purpose, and their answers were coded and analysed. The results have shown that 60 to 100% of seventh graders understand correctly the role of most factors that eased the discovery and the colonization. However, students often had previous ideas that caused them to make erroneous predictions The same results were found when examining whether students had a mental model integrating the different causal factors studied. Theoretical and practical implications are discussed.     

Does tagging improve the navigation of online recorded lectures by students?

Students more and more have access to online recordings of the lectures they attend at universities. The volume and length of these recorded lectures however make them difficult to navigate. Research shows that students primarily watch the recorded lectures while preparing for their exams. They do watch the full recorded lectures, but review only the parts that are relevant to them. While doing so, they often lack the required mechanisms to locate efficiently those parts of the recorded lecture that they want to view. In this paper, we describe an experiment where expert tagging is used as a means to facilitate the students' search. In the experiment, 255 students had the option to use tags to navigate 18 recorded lectures. We used the data tracked by the lecture capture system to analyze the use of the tags by the students. We compared these data to students who did not use the tagging interface (TI). Results show that the use of the TI increases in time. Students use the TI more actively over time while reducing the amount of video that they view. The experiment also shows that students who use the TI score higher grades when compared with students who use the regular interface.     

Graduate teaching assistants: how well do their students think they do?

Graduate teaching assistants (GTAs) constitute a valuable and economical teaching force in many higher education undergraduate programmes. However, student satisfaction with their teaching has attracted little attention in the research literature. This study aimed at examining students’ evaluation of teaching of GTAs in discussion groups, as well as exploring the effects of group and GTA variables on these ratings. Data were collected using a questionnaire administered online and completed by 7078 undergraduate students. Participants were enrolled in classes taught by 278 GTAs from four faculties in a major Israeli university. Results indicated that ratings assigned to clarity of instruction were the most salient predictor of students’ overall evaluation. Generally, findings were consistent with those reported in the literature for other categories of instructors. Groups taught by GTAs in exact sciences and engineering were rated higher than those in social sciences and business management. Group size and the percentage of men students were inversely correlated with student ratings, while student attendance rate was positively correlated. Women GTAs and GTAs who taught more than one group tended to receive higher ratings. Overall student attendance rate was the most prominent predictor of student ratings. The implications of the findings are discussed.     

Case study: what supports students to improve their grades?

Abstract

This case study considers students who achieved ‘borderline’ (40–45%) grades in their first assignment on a module, but went on to markedly improve their grades over the course of the module. The students were studying nursing and social work at the UK Open University, and they were all sponsored by employers. Semi-structured telephone interviews were used to explore the experiences of the students, including the way in which they reacted to assessment feedback and how this contributed to their learning and development. Other themes that emerged from the study include the emotions experienced by the students, sometimes challenging their self-confidence and evoking feelings associated with emotional vulnerability, and the tendency for students to initially approach assessment independently, but later to create and take advantage of opportunities for social learning. The role of the tutor in helping students to prepare for assessment appears to be significant, as does the fact that students are sponsored by their employers, which provides an additional incentive to complete the module.     

Investigating the effectiveness of a POE-based teaching activity on students’ understanding of condensation

This article reports on the development of a Predict–Observe–Explain, POE-based teaching strategy to facilitate conceptual change and its effectiveness on student understanding of condensation. The sample consisted of 52 first-year students in primary science education department. Students’ ideas were elicited using a test consisting of five probe questions and semi-structured interviews. A teaching activity composed of three Predict–Discuss–Explain–Observe–Discuss–Explain (PDEODE) tasks was employed, based on students’ preconceptions identified with the test. Conceptual change in students’ understanding of condensation was evaluated via a pre-, post-, and delayed post-test approach and students’ interviews. Test scores were analyzed using both qualitative and quantitative methods. The findings suggested that the strategy helps students to achieve better conceptual understanding for the concept of condensation and enables students to retain these new conceptions in their long-term memory.     

Does teachers' cognitive self-regulation increase their occupational well-being? The structure and role of self-regulation in the teaching context

Cognitive self-regulation is assumed to foster teachers' occupational well-being (their level of emotional exhaustion and job satisfaction), which directly impacts the quality of their work. We investigated (1) the factor structure of teachers' cognitive self-regulation, (2) whether self-regulation fosters teachers' job satisfaction by reducing emotional exhaustion, and (3) whether this relationship is moderated by gender and school track. Structural equation modeling (N = 664 German secondary mathematics teachers) confirmed the hypothesized second-order factor structure of teacher self-regulation. The positive effect of cognitive self-regulation on job satisfaction is mediated by emotional exhaustion and can be generalized across gender and school track.     

Explicit versus implicit understanding of teaching: Does knowing what teaching is help children to learn from it?

One hundred and sixteen Korean 3- to 5-year-olds were individually taught animal names through a game, either in a direct condition in which the instructional goal was stated or an indirect condition in which it was not. How much they learned and how well they understood the intentionality of teaching were also measured. Korean children seemed to have relatively rapid development in understanding of the intentionality of teaching, and this understanding was correlated with their identification of the goal of the game. The direct condition produced better learning for the children who had higher understanding of the intentionality of teaching.     

Does explicit teaching of critical thinking improve critical thinking skills of English language learners in higher education? A critical review of causal evidence

This paper presents the results of a systematic review of international studies to establish whether explicit teaching of critical thinking is effective in enhancing the critical thinking skills of English language learners in higher education and to identify the most promising approaches. A search of 12 electronic databases supplemented by other sources yielded more than 1794 studies. Only 36 met the pre-defined inclusion and exclusion criteria. A range of approaches were tested and almost all claimed to be effective, but only explicit instruction in general critical thinking skills was found to have the best evidence of effectiveness. However, because most of the studies were small-scale and/or methodologically flawed, the evidence is not strong enough to be conclusive. Evidence for the other approaches was even weaker. These findings suggest that research in this field is still rather immature and more large-scale, replicable robust studies are needed to advance the field.     

L1-assisted reciprocal teaching to improve ESL students’ comprehension of English expository text

A multiple-baseline design across three schools was used to investigate the effects of L1-assisted reciprocal teaching on 12 Year 7 and Year 8 (Grades 6 and 7) Taiwanese ESL students’ comprehension of English expository text. The intervention comprised the alternate use of L1 (Mandarin) and L2 (English) reciprocal teaching procedures. Through 15–20 days of instruction, students learned how to foster and monitor their comprehension by using the cognitive and metacognitive strategies of questioning, summarising, clarifying, and predicting. Students made gains on both researcher-developed and standardised tests of reading comprehension and showed evidence of qualitative changes in their comprehension processes when reading L1 and L2 texts.     

Using the multimodal affordances of the interactive whiteboard to support students’ understanding of texts

The purpose of the study reported on here was to explore ways in which the interactive whiteboard (IWB) can support students’ understanding of texts. A Year 3 and a Year 4 primary school class in New South Wales, Australia, is the focus of the research. A qualitative case study was carried out using multimodal analysis focusing on the use of an e‐book displayed via the IWB. The results of the study indicate that the IWB can support students’ understanding of a narrative to prepare them to write a whole‐class response through providing increased access to a range of resources that are multimodal in nature. The way the interactive features of the IWB can facilitate access to multimodal resources to cater for student needs is also discussed.     

Characterising the development of the understanding of human body systems in high-school biology students – a longitudinal study

ABSTRACT

Science education today has become increasingly focused on research into complex natural, social and technological systems. In this study, we examined the development of high-school biology students’ systems understanding of the human body, in a three-year longitudinal study. The development of the students’ system understanding was evaluated using the Components Mechanisms Phenomena (CMP) framework for conceptual representation. We coded and analysed the repertory grid personal constructs of 67 high-school biology students at 4 points throughout the study. Our data analysis builds on the assumption that systems understanding entails a perception of all the system categories, including structures within the system (its Components), specific processes and interactions at the macro and micro levels (Mechanisms), and the Phenomena that present the macro scale of processes and patterns within a system. Our findings suggest that as the learning process progressed, the systems understanding of our students became more advanced, moving forward within each of the major CMP categories. Moreover, there was an increase in the mechanism complexity presented by the students, manifested by more students describing mechanisms at the molecular level. Thus, the ‘mechanism’ category and the micro level are critical components that enable students to understand system-level phenomena such as homeostasis.     

Application of English cohesion theory in the teaching of writing to Chinese graduate students

The English cohesion theory proposed by Halliday and Hasan makes great contributions to the understanding of the coherence and cohesion of the English texts. It should be applicable in the teaching of English writing so as to improve the cohesion in the students＇ compositions. The present paper describes apractice of this order among non-major graduate students, and discusses its results. The conclusion is that teaching activities of this kind can indeed improve the cohesion in the students＇ compositions. Finally the paper raises a few concerning problems which remain to be further explored.     

A research‐based teaching sequence for teaching the concept of modelling to seventh‐grade students

The purpose of this study was to construct and study the impact of a research‐based sequence for teaching the concept of modelling to seventh‐grade science students. We identified students' notions of models and the aspects of school science to be addressed regarding the model concept, which were then taken into account when we planned the learning sequence. The idea of modelling in science was taught while the students were learning about the change of states of matter in seventh‐grade physics. A pre‐interview revealed that the students' notions of models were very limited, while a post‐interview showed that this improved in the course of the series of lessons. There was also a statistically significant difference in the students' understanding of modelling between our target group and a control group consisting of ninth‐grade students who had received only the normal teaching. However, a delayed post‐questionnaire completed a few months after the teaching sequence showed that the stability of learning results were dependent on whether models and modelling were used in the normal teaching conducted after the teaching sequence. Implications for teaching, teacher education and research are also addressed in this paper.     

Exploring the use of concept chains to structure teacher trainees’ understanding of science

This paper reports on a paper and pencil concept‐sorting strategy that enables trainee teachers to restructure their knowledge in any one domain of science. It is used as a self‐study tool, mainly to enable them to break down and understand the progression of concepts beyond the level at which they have to teach. The strategy involves listing key ideas in an increasingly complex and inclusive fashion such that a ‘chain’ is developed where the initial statements are simple and the final ones more complex. Evaluation of the strategy with trainees over a five‐year period revealed promising potential for the strategy as a self‐study tool, as well as an audit tool, enabling tutors to more easily identify misconceptions. There was some evidence that trainees found the strategy useful in preparing themselves to teach in the classroom, possibly by enabling meaningful learning to take place according to the Ausubel–Novak–Gowin theory.     

Does self-efficacy contribute to the development of students’ motivation across the transition from secondary to higher education?

European Journal of Psychology of Education - The transition from secondary to higher education is a challenging process, in which the development of students’ motivation plays a pivotal...     

Design and evaluation of a development portfolio: how to improve students’ self-directed learning skills

In on-demand education, students often experience problems with directing their own learning processes. A Structured Task Evaluation and Planning Portfolio (STEPP) was designed to help students develop 3 basic self-directed learning skills: Assessing the quality of own performance, formulating learning needs, and selecting future learning tasks. A case study with 10 first-year students in the domain of hairdressing was conducted to evaluate STEPP’s use, usability, and perceived effectiveness. Results from student interviews show that usability and use are influenced by several factors. Students with low prior hairdressing skills, a weakly developed personal approach to direct their own learning, and an inclination to update STEPP as part of their weekly routine, use STEPP more frequently than students without these characteristics. Both the supervisor and students who frequently used STEPP perceived its use as a positive contribution to the development of self-directed learning skills. Furthermore, this study provides guidelines for the design of development portfolios in on-demand education.     

The structure of students’ beliefs about the use of representations and their performance on the learning of fractions

Cognitive development of any concept is related with affective development. The present study investigates students’ beliefs about the use of different types of representation in understanding the concept of fractions and their self‐efficacy beliefs about their ability to transfer information between different types of representation, in relation to their performance on understanding the concept. Data were collected from 1701 students in Grade Five to Grade Eight. Results revealed that multiple‐representation flexibility, ability on solving problems with various modes of representation, beliefs about the use of representations and self‐efficacy beliefs about using them constructed an integrated model with strong interrelations in the different educational levels. Confirmatory factor analysis affirmed the existence of differential effects of multiple‐representation flexibility and problem‐solving ability in respect to cognitive performance and the existence of general beliefs and self‐efficacy beliefs about the use and the role of representations. Results suggested the invariance of this structure across primary (Grades Five and Six) and secondary education (Grades Seven and Eight). However, there are interesting differences concerning the interrelations among those cognitive and affective factors between primary and secondary education.