Student learning experience as indicator of teaching quality

The purpose of the study was to develop an improved teaching evaluation questionnaire based on students’ learning experiences and selected teacher characteristics identified as indicators of teaching quality. Teaching evaluation questionnaires are commonly designed either based on agreed indicators of teaching excellence, students’ suggestions of characteristics of excellence, or dimensions identified from interviews conducted with excellent teachers. In this study, however, students’ evaluation of their own learning experiences in learner centered classes and a hypothesized framework derived from the literature were used to develop the items for the questionnaire. Students attended to courses designed in a learner centered paradigm and evaluated their learning experiences. Based on the hypothesized framework and students’ reflections of their experiences, items were designed and validated at various levels. Exploratory factor analysis resulted in a 24-item Student Evaluation of Learning and Teaching Questionnaire (SELTQ) that comprises four factors: assessment and feedback; course organization and presentation; student self evaluation; and students’ level of engagement. As opposed to the questionnaire widely used in higher education institutions in Ethiopia that focuses on the evaluation of selected teacher characteristics, the new measure enables students to evaluate teaching in terms of their own learning progress.     

Relational, structural, and semantic analysis of graphical representations and concept maps

The demand for good instructional environments presupposes valid and reliable analytical instruments for educational research. This paper introduces the SMD Technology (Surface, Matching, Deep Structure), which measures relational, structural, and semantic levels of graphical representations and concept maps. The reliability and validity of the computer-based and automated SMD Technology was tested in three experimental studies with 106 participants. The findings indicate a high reliability and validity. The discussion focuses on the development and realization of the three levels of the SMD Technology and applications for research, learning and instruction.     

Quality issues in the internationalisation of higher education

Although the quality issue has become a central preoccupation inother domains of higher education, current internationalisation policiesand practices in higher education have developed without much concernfor quality assurance. The central thesis of this paper is that we havecome to a point in the development of higher education whereinternationalisation policies and practices face the limits of theirdevelopment unless the quality challenge is addressed in all itsconsequences. The paper first provides an overview of contemporary formsof and recent developments in internationalisation in higher education.From more or less `traditional' forms such as student and teaching staffmobility, internationalisation policies and practices nowadays move intoactivities such as exporting higher education via branch campuses andinstitutional co-operation, developing transnational university networksand virtual delivery of higher education, and the harmonisation ofhigher education systems. In these recent developments several issuesand challenges arise, which in one kind or another have direct links tothe quality challenge. The quality of internationalisation policies andpractices itself is an important problem, but of more importance are theissues of the recognition of foreign diplomas and degrees and therecognition of credits and credit-transfer. This paper takes a criticalstance towards for example the ECTS, which tries to solve these issueswithout much concern for quality. The way out lies in an integration ofinternationalisation policies and general quality assurance practices atinstitutional and policy levels.     

Students’ Levels of Understanding Models and Modelling in Biology: Global or Aspect-Dependent?

It is argued that knowledge about models is an important part of a profound understanding of Nature of Science. Consequently, researchers have developed different ‘levels of understanding’ to analyse students’, teachers’, or experts’ comprehension of this topic. In some approaches, global levels of understanding have been developed which mirror the idea of an understanding of models and modelling as a whole. Opposed to this, some authors have developed levels of understanding for distinct aspects concerning models and modelling in science (i.e. aspect-dependent levels). This points to an important issue for science education research since global conceptualisations might lead to less differentiated assessments and interventions than aspect-dependent ones. To contribute to this issue, the article summarises conceptualisations of both global and aspect-dependent levels of understanding models and modelling that have been developed in science education. Further, students’ understanding of the aspects nature of models, multiple models, purpose of models, testing models, and changing models has been assessed (N?=?1,180; 11 to 19 years old; secondary schools; Berlin, Germany). It is discussed to what extent the data support the notion of global or aspect-dependent levels of understanding models and modelling in science. The results suggest that students seem to have a complex and at least partly inconsistent pattern of understanding models. Furthermore, students with high nonverbal intelligence and good marks seem to have a comparatively more consistent and more elaborated understanding of models and modelling than weaker students. Recommendations for assessment in science education research and teaching practice are made.     

Reframing and Articulating Socio-scientific Classroom Discourses on Genetic Testing from an STS Perspective

In recent decades, Science & Technology Studies (STS) have revealed the dynamic interaction between science and technology and society. Technology development is not an autonomous process and its artifacts are not socially inert. Society and technology shape each other. Technologies often have ‘soft impacts’ in terms of unpredicted side effects on individuals and society. Nevertheless, current societal discourse on technological innovations is still dominated by ‘hard impacts’ such as quantifiable risks for health, safety and the environment. Furthermore, participants in socio-scientific discourses often underestimate their agency in influencing technological innovations, and at the same time overestimate their freedom of choice to use a technology. Past debates on technological innovations have shown how these debates were framed and often caught in fruitless discourse patterns or arguments. Interventionist STS research experiments with solutions to this problem. Assuming that an STS perspective is helpful in reframing and articulating socio-scientific classroom discourses, the case of genetic testing is used to explore this. An important positive ‘hard impact’ of genetic testing is disease prevention. However, this is put into perspective by addressing ‘soft impacts’ such as limited access to certain careers based on genetic risk and changes in the conception of health and the perception of responsibility for one’s health. Discussion stoppers such as ‘playing God’ or ‘We can’t stop technological advancement’ can be challenged through uncovering underlying assumptions. The use of narratives and future scenarios in classrooms seems fruitful in provoking imagination and engaging students in public debates on technological innovations.     

The Split-Ballot Multitrait-Multimethod Approach: Implementation and Problems

Saris, Satorra, and Coenders (2004) proposed a new approach to estimate the quality of survey questions, combining the advantages of 2 existing approaches: the multitrait–multimethod (MTMM) and the split-ballot (SB) ones. Implemented in practice, this new approach led to frequent problems of nonconvergence and improper solutions. This article uses Monte Carlo simulations to understand why the SB-MTMM is working well in some cases but not in others. The number of SB groups is a crucial element: The 3-group design is performing better. However, the 2-group design can also perform well: The analyses suggest that the interaction between the absolute values of the correlations between the traits and the relative values of the different correlations between traits plays an important role.     

Teacher research and the aims of education

We report on the development of a course for experienced teachers in the Netherlands, intended to enhance their professionalism by engaging them in doing research based on reflection on the aims of their educational efforts. The course was accompanied by design-based research. The research question was whether and how the course stimulated teachers to connect doing research and taking a reflective stance; the results were used to improve the course, thus creating a cyclical design. Although the course was positively evaluated by the participants, reflection on its results made clear to us that our approach in the combination of learning to do research and reflecting on aims is not enough to make teachers into critical research-minded professionals. A more context-aware view of their learning process is necessary: the institution school limits their possibilities. The implication is that both our course and our research effort have to be critically revised. Instead of looking for causal effects, one should be aware of traces of development that may or may not be caused by the intervention.     

The contested professionalism of teachers meeting radicalising youth in their classrooms

In a diverse and unjust world, teachers experience difficulties to achieve inclusive education. In parts of the western world, including the Netherlands, the very possibility of a combination of ethnic and cultural diversity and common citizenship has come into question. Meanwhile some youngsters are in the process of radicalisation. We illustrate the problem definitions of teachers and teacher trainers with a case study of a professional learning activity in Amsterdam. This is followed by a critical discussion based on a pedagogical view on education.     

Highly innovative small technology firms,industrial clusters and firm internationalization

This study examines the role and differential impact of industrial clustering in the internationalization of small technology-based firms. Serial innovator firms are a set of small, long-lived technology-based firms with a stellar record of inventive success. In contrast, non-serial innovators are small technology-based firms with much weaker inventive capabilities. Using theoretical insights from the resource-based view and density dependence theory, we demonstrate that both serial and non-serial innovator firms benefit from rising levels of industrial clustering in their efforts to internationalize; however, non-serial innovators experience decreasing returns with increasing levels of clustering. In addition, our analysis indicates that overall serial innovator firms benefit more from industrial clustering in terms of internationalization than non-serial innovator firms. The underlying premise and contribution of this study is that all small technology-based firms are not the same and that serial innovators are more effective at leveraging cluster-based resources than non-serial innovators, even when they operate in the same industry. Policy implications for research and economic development are discussed.