Does assessment for learning make a difference? The development of a questionnaire to explore the student response

Assessment for learning is a widely used term and the concept forms the basis of many teaching innovations in higher education. However, the definitions and scope of assessment for learning vary considerably. We describe a conceptualisation of assessment for learning that encompasses current thinking in a holistic way and which has been trialled and extensively refined in practice. A student questionnaire is presented which has enabled us to explore the student experience. Results indicate that the overall student experience is more positive in modules where assessment for learning approaches are used and students are more likely to take a deep approach to learning. It also demonstrates that the student experience is centred on staff support and module design, feedback, active engagement and peer learning. The full questionnaire is made available and its wider use in evaluation, enhancement and research is encouraged.     

Price-induced substitution of faculty in academe: Does mission make a difference?

In an earlier paper Tuckman and Chang demonstrated that college faculty were substitutable and that differences in faculty salaries influenced the distribution of faculty by rank and sex. This paper uses a similar methodology to explore the question of whether institutions of high education with different missions have different substitution patterns and price elasticities. Our main conclusion is that price-related substitution does exist at each of the four types of colleges in our sample. However, the observed price effects are small and there is little evidence that any one college type is consistently more price responsive than any other.     

Emotional experiences during test taking: Does cognitive ability make a difference?

This study examined test-related experiences of enjoyment, anger, anxiety, and boredom in a sample of 2059 German school students (50% female) from grade 6, and how they relate to students' abstract reasoning ability (ARA). Emotions were assessed immediately before, during, and after a mathematics achievement test. Analysis of variance showed that emotions experienced during the test situation differed based on students' ARA level, with correspondence analysis revealing substantial differences between the emotional profiles of different ability groups. Enjoyment proved to be most prominent in students with high ARA, whereas anger and anxiety were predominant for students with low ARA. Boredom was found to be highest among students in the intermediate ARA group. Implications for research and practice are discussed.     

Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure?

This study examined ways in which children's risk of school failure may be moderated by support from teachers. Participants were 910 children in a national prospective study. Children were identified as at risk at ages 5-6 years on the basis of demographic characteristics and the display of multiple functional (behavioral, attention, academic, social) problems reported by their kindergarten teachers. By the end of first grade, at-risk students placed in first-grade classrooms offering strong instructional and emotional support had achievement scores and student-teacher relationships commensurate with their low-risk peers; at-risk students placed in less supportive classrooms had lower achievement and more conflict with teachers. These findings have implications for understanding the role that classroom experience may play in pathways to positive adaptation.     

Does high-quality professional development make a difference? Evidence from TIMSS

Abstract

While professional development has been emphasised in many countries, few comparative studies have examined the degree of teachers’ participation in professional development and its effect on teachers. Using the TIMSS 2007 data, this study analyses to what extent teachers participated in professional development in 50 TIMSS countries and examines the relationship among high-quality teachers’ professional development, teachers’ beliefs, attitudes and job satisfaction. The study found that the extent to which teachers have participated in professional developmental activities was surprisingly low. In particular, teachers in 47 countries have rarely participated in active learning. The study also found that high-quality teacher professional development was significantly associated with greater job satisfaction, higher expectations for student performance and more positive attitudes in teachers concerning their implementing the school’s curriculum. Policy implications for professional development are discussed.     

Written versus oral administration of a social-emotional self-report test for children: Does method of execution make a difference?

This study examined administration method (standard written administration vs. oral administration by an examiner) as a variable in influencing children's self-report test scores. Subjects included 139 students in grades 3–6, randomly assigned to one or the other administration condition. Subjects completed the Internalizing Disorders Evaluation Scale for Children (IDESC) according to the assigned administration method. Internal consistency estimates of each group were essentially similar. Mean IDESC scores of the two groups did not differ significantly from either a statistical or practical standpoint, based on t-test and effect size calculations. Results suggest that method of administration did not affect test performance. Implications for child assessment and future research are discussed.     

Full-day kindergarten and student literacy growth: Does a lengthened school day make a difference?

In the context of a quasi-experimental research design, literacy data obtained on students were examined to assess relationships between kindergarten program model (full- vs. half-day) and student literacy outcomes. Application of multilevel modeling techniques to the time series data collected from kindergarteners in economically disadvantaged school contexts in a large southwestern school district revealed that students exposed to a full day of instruction had greater literacy growth than their peers in half-day classrooms. Further examination of the program model results revealed that the relative efficacy of full-day kindergarten tended to be greater in smaller class size environments. These results, if replicated, suggest that full-day kindergarten initiatives targeted toward students from disadvantaged backgrounds may be more successful when implemented in classrooms with relatively small student enrollments. Implications for instructional policy and practice are discussed.     

School-to-work transitions in the OECD: do education systems make a difference?

High unemployment among the young is a concern in many OECD countries. A key issue for policy makers is whether the education system has a role to play in assisting the transition from education to work or whether economic issues dominate. This paper uses OECD country-level data to see whether the structure of countries’ education systems, characterised by the level of participation by age at the various ISCED education levels, affects systematically the level of unemployment for the cohorts aged 20–24 and 25–29 years who should have largely completed their transition to work. Various confounding factors, including overall labour market conditions and demographic structures, are accounted for. We find that the structure of education systems does make a difference, although the general state of the labour market is critical.     

Student Success in First-Year University Physics and Mathematics Courses: Does the high-school attended make a difference?

This paper considers school factors that contribute to a successful transition from high school to first-year university Physics courses at the University of British Columbia by employing a two-level hierarchical model. It is assumed that there is a relationship between student performance and the high school they graduated from. It is shown that school location and type affect student performance: students from public schools in the Metro Vancouver area perform better in first year compared to students from independent schools and schools in distant communities. The study also considers rankings of schools based on student performance in first-year university Physics and Calculus courses. These university-based rankings differ significantly (essentially in reverse order) from the well-known Fraser Institute rankings based on measures internal to high schools.     

Teachers’ agency: Do their values make a difference?

This research explored antecedents and outcomes of teachers’ agency. Study 1 (n = 767) tested whether teachers’ values relate to an agentic capacity. Study 2 (n = 430) tested the relations between teachers’ values, their agentic capacity and their agentic behaviours. The findings show that attributing importance to promoting the self and being open to new experiences, whilst maintaining self-independence, is positively related to agentic capacity. Further, agentic capacity mediates the relations between values and agentic behaviour. These findings start to explain the broad motivations for teachers’ agency and its translation into behaviour.     

Medicine as a calling among male and female medical students in Israel: Does it make a difference?

This study focused on the perception of medicine as a calling and its associations with medical training satisfaction, career certainty, career satisfaction, career commitment, and well-being among 176 Israeli medical students. Participants replied to an online questionnaire including the Brief Calling Scale (Duffy and Sedlacek in Career Dev Q 59:27–41, 2010) and measures related to medical training, a medical career, and well-being. Calling was positively associated with all outcome measures, and gender moderated these associations, which were stronger for female medical students in comparison with male medical students. The importance of taking these gender differences regarding calling under consideration for career counseling is discussed.     

Socio‐emotional adjustment in elementary school boys and girls: Does giftedness make a difference?

Fifty 10‐year‐old gifted children were matched with 50 pupils of average intelligence on the variables ‘gender’ and ‘socio‐economic status’. Three data sources (children, parents, and teachers) on the children's personality and socio‐emotional behavior were used.     

Transition classes: A viable alternative for the at-risk child?

Increased interest in the child “not ready” for reading has led to the use of a number of instructional options, of which the transition class is one. Efficacy of transition room programs is reviewed and importance of teacher attitudes is discussed. Educators will need to examine current educational practices in order to reduce the school failure rate.     

Do teaching innovation projects make a difference? Assessing the impact of small-scale funding

Tertiary Education and Management - This article presents the outcomes of a research study carried out during 2015–2016 at the University of Valencia (Spain) to understand the factors...     

Incorporating critical thinking in the pedagogical content of a teacher education programme: does it make a difference?

Recent educational policies, national reports, and voluminous literature stress that critical thinking (CT) is an essential skill in any stage of schooling for producing critical thinkers and ensuring better learning. The importance of teaching CT has been raised in teacher education programmes because students are supposed to teach this skill in schools in the future. This study therefore assesses the effects of a CT-based pedagogical course on student teachers’ content knowledge and CT disposition. A pre-test–post-test experimental study was carried out in a vocational pre-service teacher education programme in Turkey. Although the students who were exposed to CT-based instruction showed better progress in both academic achievement and CT disposition than in traditional instruction, this result was not statistically significant according to the Mixed Factorial ANOVA and ANCOVA results.     

How to make the neighbourhood school a school for all?

A new special education strategy was launched in Finland by the Ministry of Education in 2007. The new Basic Act was enacted in 2010 and the new national core curriculum concerning three‐tiered support for pupils in 2011. Since the 1990s, teachers across Finland have participated in developing Finnish basic education towards greater inclusion. The goal of this study was to enhance understanding of the implementation of the Finnish educational reforms. In this study, teachers' perceptions of good inclusive teaching arrangements were analysed and compared with the theories of inclusive education. There is still a lack of information available on the implementation of inclusive education practices, and especially about teachers' experiences of teaching in inclusive classrooms. In 2010, basic education teachers (N = 327) in Lapland, Finland, were asked to describe their experiences and perceptions of inclusive teaching arrangements. The results indicated that teaching practices have become more diverse, flexible and differentiated, enabling teaching of diverse groups. More and more teachers preferred teaching in teams and planning their work together, showing that changes in schools change the teacher's profession too. In this study, a framework for inclusive schools was constructed through implementing the indexes of inclusion created by Booth and Ainscow.     

Does family make a difference? Mid-term effects of a school/home-based intervention program to enhance reading motivation

This study examined the effects of a school/home-based intervention program designed to enhance the reading motivation and comprehension of Swiss fourth graders (N = 713). In order to identify the specific contribution of the home environment, the program was implemented in one group without (N = 244) and in one group with (N = 225) parental participation. The intervention was based on the principles of Self-Determination Theory (Deci & Ryan, 2002) and lasted one school year. Effects of the treatment were investigated in a pretest-posttest control group design with follow-up. Multilevel analyses showed that the school/home-based intervention had significant effects on reading enjoyment and reading curiosity. Effects on reading enjoyment were still detectable at 5-month follow-up. However, no effects were found for reading self-concept or reading comprehension. The findings highlight the potential of the family in the sustained promotion of reading motivation.     

Does principal leadership make a difference in teacher professional learning? A comparative study China and Thailand

This research explored the relationship of principal leadership and teacher professional learning in China and Thailand. The authors tested a conceptual model in which teacher trust and agency were proposed as mediators of the effects of the principal’s learning-centered leadership on teacher professional learning. Common survey measures had been used to collect data from 1259 teachers in 38 schools in mainland China and 1071 teachers in 60 schools in Thailand. Multi-group confirmatory factor analysis, multi-group structural equation modelling, and bootstrapping were employed to compare the proposed leadership and teacher learning processes in Chinese and Thai schools. The results confirmed a similar model of strong, statistically significant, ‘mediated effects’ of principal leadership on the professional learning of teachers in the two societies. These findings contribute to our understanding of leadership effects across societies and offer insight into how policymakers and practitioners can support school leadership, teacher development, and educational change.     

Does the amount of on-screen text influence student learning from a multimedia-based instructional unit?

The present study examines how changes in the amount of on-screen text will influence student learning from a multimedia instructional unit on basic concepts of coordinate geometry. The relative effectiveness of two different versions (short-text and whole-text) of the instructional unit was examined for students who differed in terms of their ability to remember symbolic units, symbolic systems and symbolic interpretations. A total of 101 seventh graders were randomly assigned to work with either the whole-text or the short-text version. Student gains were analyzed using pre-test, post-test and retention test scores. Memory ability was assessed by the sub-tests of the Structure of Intellect-Learning Abilities Test. Results indicated no significant differences between groups who worked with short-text and whole-text versions. However retention scores of high and low memory groups who worked with the whole-text version showed significant differences. The whole-text version was observed to favor students with high memory for symbolic implications. Results suggest that workability of design principles for multimedia instruction may depend on the nature of the task and characteristics of the learner.