Does the detection of misunderstanding lead to its revision?

When dealing with complex conceptual systems, low-prior- knowledge learners develop fragmentary and incorrect understanding. To learn complex topics deeply, these learners have to (a) monitor understanding to detect flaws and (b) generate explanations to revise and repair the flaws. In this research we explored if the detection of a flaw in understanding does lead to the generation of a revising explanation or, alternatively, if there is some independence between the two processes. In two studies participants with low prior domain knowledge learned about plate tectonics from a multimedia presentation. In Study 1 participants in two conditions received support for detection and their performance was compared to that of participants in two control conditions, one receiving no support and another one receiving support for both detection and revision. Performance on retention, transfer, and distortions revealed that the conditions with support for detection were not different from that with no support. The condition with support for both detection and revision was significantly better than all others. In Study 2 participants thought aloud while studying from the presentation. Self-generated detections were not correlated with revising explanations or with performance on retention or transfer measures. Overall, the results indicate that the detection of flaws in understanding does not necessarily lead to the generation of explanations to repair the flaws, meaning that this latter process is very difficult to execute and calls for instructional support.     

An application of importance-performance analysis to students’ evaluation of teaching

Educational Assessment, Evaluation and Accountability - Students’ feedback is usually gathered in institutions of higher education to evaluate the teaching quality from the students’...     

Does teaching to the test improve student learning?

A central concern surrounding test-based accountability is that teachers may narrow teaching practices to improve test performance on a curriculum-based specific knowledge test rather than student learning more broadly. Two of the most common teaching practices that “teach to the test” are providing test-specific classwork and increasing the frequency with which students take practice tests. Whether such teaching practices improve student learning—both in terms of learning the content associated with a specific knowledge test as well as more general learning—is a largely unanswered question. To approach this question, this paper uses a student fixed effects approach to analyze the impact of these kinds of narrow teaching practices on student performance on a specific test as well as a general knowledge test. We find that test-specific classwork and practice tests with specific test items tend to have little or negative impacts on curriculum specific or general knowledge test performance, except for male students, and that subject practice tests (without emphasizing test-specific items) have positive effects on student outcomes on both kinds of tests, but larger on the curriculum-specific than on the general test, and much larger on the curriculum-specific test for male students. We discuss the logic for these results and what they tell us about the effectiveness of test-focused teaching practices more generally.     

Correction to: An application of importance-performance analysis to students’ evaluation of teaching

Educational Assessment, Evaluation and Accountability -     

Explicit versus implicit understanding of teaching: Does knowing what teaching is help children to learn from it?

One hundred and sixteen Korean 3- to 5-year-olds were individually taught animal names through a game, either in a direct condition in which the instructional goal was stated or an indirect condition in which it was not. How much they learned and how well they understood the intentionality of teaching were also measured. Korean children seemed to have relatively rapid development in understanding of the intentionality of teaching, and this understanding was correlated with their identification of the goal of the game. The direct condition produced better learning for the children who had higher understanding of the intentionality of teaching.     

A new approach to evaluation of university teaching considering heterogeneity of students’ preferences

Students’ evaluations of teaching are increasingly used by universities to evaluate teaching performance. However, these evaluations are controversial mainly due to fact that students value various aspects of excellent teaching differently. Therefore, in this paper we propose a new approach to students’ evaluations of university teaching based on data from conjoint analysis. Conjoint analysis is a multivariate technique used to analyze the structure of individuals’ preference. In particular, our approach accounts for different importance students attach to various aspects of teaching. Moreover, it accounts explicitly for heterogeneity arising from students’ preferences, and incorporates it to form comprehensive teaching evaluation score. We have conducted survey and confirmed applicability and efficiency of the proposed approach.     

Does the use of end of semester evaluation forms represent teachers’ views of teaching in a tertiary education context in Japan?

This paper considers both how the mandatory introduction of student evaluation of teaching surveys (SETs) fits into the social and political context of tertiary education in Japan, and the assumptions about teaching underlying SETs. Through interviews with English teachers, a technical–rational perspective whereby teaching is a profession only to the extent that it involves applying theoretical knowledge to the pursuit of educational ends is discussed. Teachers’ capacities to make complex judgments are not recognized so that teaching becomes indistinguishable from technical expertise. Quantitative evaluation as a measurement of effectiveness and efficiency leads to teacher exclusion from dialogue on how teaching might be improved.     

Does deafness lead to enhancement of visual spatial cognition in children? Negative evidence from deaf nonsigners

This study investigated whether deafness contributes to enhancement of visual spatial cognition independent of knowledge of a sign language. Congenitally deaf school children in India who were born to hearing parents and were not exposed to any sign language, and matched hearing controls, were given a test of digit span and five tests that measured visual spatial skills. The deaf group showed shorter digit span than the hearing group, consistent with previous studies. Deaf and hearing children did not differ in their performance on the visual spatial skills test, suggesting that deafness per se may not be a sufficient factor for enhancement of visual spatial cognition. Early exposure to a sign language and fluent sign skills may be the critical factors that lead to differential development of visual spatial skills in deaf people.     

Does teaching students how to explicitly model the causal structure of systems improve their understanding of these systems?

If students really understand the systems they study, they would be able to tell how changes in the system would affect a result. This demands that the students understand the mechanisms that drive its behaviour. The study investigates potential merits of learning how to explicitly model the causal structure of systems. The approach and performance of 15 system dynamics students who are taught to explicitly model the causal structure of the systems they study were compared with the approach and performance of 22 engineering students, who generally did not receive such training. The task was to bring a computer-simulated predator-and-prey ecology to equilibrium. The system dynamics students were significantly more likely than the engineering students to correctly frame the problem. They were not much better at solving the task, however. It seemed that they had only learnt how to make models and not how to use them for reasoning.     

Does teaching complex sentences have to be complicated? Lessons from children's online writing

This paper draws upon data from a research project, undertaken in 2 Year 6 classrooms during the 2006 World Cup, to analyse how children used complex sentence structures in their writing on a football web‐log. We explore how the confluence of a temporary, popular, global event and an online forum for communication created a moment of linguistic empowerment where pupils began to use high‐level forms of language, and we consider the implications of transience and interactivity for the teaching and learning of sentence grammar.     

Does the introduction of the graphics calculator into system-wide examinations lead to change in the types of mathematical skills tested?

The paper reports on the introduction of the graphics calculator into three centralised examination systems, which were located in Denmark, Victoria (Australia) and the International Baccalaureate. The introduction of the graphics calculator required those responsible for writing examination questions to consider how to assess mathematical skills within this new environment. This paper illustrates the types of mathematics skills that have been assessed within the graphics-calculator-assumed environment. The analysis of the examination questions indicated that only two out of the six mathematics examinations considered demonstrated any significant change in the types of skills assessed in conjunction with the introduction of the graphics calculator. The results suggest that it is possible to reduce the use of questions assessing routine procedures (mechanical skills) with a graphics calculator, but it is also evident that there have not been major changes in the way that examination questions are written nor the mathematics skills which the questions are intended to assess.     

Who wants to become a teacher? Typology of student-teachers’ commitment to teaching

Understanding student-teachers’ decisions to enter and stay in the teaching profession after graduation could help teacher educators to find appropriate procedures to enhance commitment to teaching. This study classified student-teachers based on their levels of commitment to teaching, and described these types based on student-teachers’ motivation to enter the teaching profession and their perceptions of the teaching profession and environmental aspects e.g. school condition and significant others. Thirty-seven undergraduate student-teachers from the Dar es salaam University College of Education in Tanzania were interviewed. Four student-teacher types from our results were identified: (1) committed passionate, (2) committed compromisers, (3) undecided and (4) uncommitted. Implications from the findings include the importance of designing teacher education curriculum in a way that caters for the needs of student-teachers in each type in order to enhance their commitment to teaching.     

Teachers’ perceptions of and responses to student evaluation of teaching: purposes and uses in clinical education

Student evaluation of teaching (SET) only becomes an effective tool for improving teaching and learning when the relevant stakeholders seriously consider and plan appropriate actions according to student feedback. It is common practice in medical education to provide clinical teachers with student feedback. However, there is limited evidence about how teachers in higher education, and medical education in particular, systematically apply student feedback to improve the quality of their teaching practice. The focus of this case study was to examine clinical teachers’ perceptions of and responses to SET with respect to its purposes and uses for enhancing their teaching. An explanatory sequential mixed methods approach was employed to collect both quantitative and qualitative data from the clinical coaches. These clinical coaches perceived the main purpose of student evaluation as quality assurance, and were moderately receptive to student feedback. Four key factors enabling or inhibiting their responses were revealed: institutional requirements, operational practices, personal biases and provision of support. Future research should further explore the interrelationships among the above factors as the core mechanism in influencing clinical teachers’ perceptions of and responses to student evaluation.     

Student evaluation of teaching: the use of best–worst scaling

An important purpose of student evaluation of teaching is to inform an educator’s reflection about the strengths and weaknesses of their teaching approaches. Quantitative instruments are one way of obtaining student responses. They have traditionally taken the form of surveys in which students provide their responses to various statements using item-by-item agree/disagree ratings. Previous research has identified shortcomings of such rating scales, including response bias and the associated lack of discrimination amongst the items evaluated. In this paper, best–worst scaling is proposed as a novel method for quantitative teaching evaluation. The way in which best–worst scaling can be used in this context is illustrated in three different applications. Two applications demonstrate how it can be used for evaluations in a small-size classroom environment. The third application is a broader evaluation of university courses on a larger scale. In comparison with conventional rating scales, the best–worst scaling approach enables better highlighting of the differences between evaluation items. In doing so, it can provide enhanced guidance to educators in their reflection about their teaching. Moreover, implementation and analysis of a best–worst scaling evaluation is relatively straightforward, which establishes it a feasible method for teaching practitioners and researchers.     

Is it possible to redress noninstructional biases in student evaluation of teaching surveys? Quantitative analysis in accounting and finance courses

Several studies have reported that student evaluation of teaching (SET) presents important problems. First, depending on the area, there are significant differences in the evaluations. Second, numerous noninstructional biases exist, such as when those teachers who award better grades obtain better SETs. Correcting the rankings by considering these biases (e.g., adjusting SETs according to the class grade) has been proposed. In this paper, we analyse a third problem: it is impossible to correct the biases because they are specific to each area, level, and even class. On a sample of 15,439 SETs, we compared the biases present in two very close areas (accounting and finance) and at two levels (undergraduate and postgraduate). Then, we used a procedure based on the analysis of residuals in OLS models to eliminate area- and level-specific biases. However, there are still latent biases apparently linked to each specific group of students.     

Profile of South African secondary-school teachers’ teaching quality: evaluation of teaching practices using an observation instrument

The need for quality teaching is reflected in the poor performance of students in international tests. Teachers’ practices and contextual factors could contribute to substandard quality of teaching in South Africa. Several studies indicate that successful learning is largely dependent on the teachers’ practices in class. The focus of the present research was to profile the effective teaching practices of 424 secondary-school teachers in the Gauteng Province, South Africa. Teachers were observed by trained observers using a valid and reliable observation instrument measuring six domains of effective teaching practices. Results showed that teachers find it difficult to differentiate in class and to activate learning. Additionally, teachers with more than 15 years of teaching experience scored lower than teachers with less experience, in all six teaching domains. Presumably, experienced teachers may lack motivation and/or insufficient training in implementing interactive and differentiated teaching methods that are needed for effective teaching practices.