The Virtual Sabbatical: A Pioneering Case Study

International exchange is an important aspect of academic life. Thus, international sabbaticals are, in general, seen as a measure of research collaboration, networking, and international standing. There are, however, a few groups who are likely to be disadvantaged by such criteria even though they may be implicit, that is, those for whom international travel is problematic. Using reflective learning, the researchers conducted a virtual sabbatical for six months as a metaphorical “ramp”—that is, a way of making international sabbaticals accessible to more people. We now present a case study of this action research project, which answers the following questions. How does the concept of a virtual sabbatical fit holistically within the context of higher education? How can the aims of the sabbatical be fulfilled in a virtual context? What are the problems and successes of the virtual sabbatical?     

Significant signs: a case study of citation practices in educational research

Citations have a central role in the dynamic process of knowledge development and as measures of research performance – yet little is known about their role in educational research or the qualities they are assumed to measure. Based on a citation context analysis, this study shows how a paradigmatic reference within classroom research has been used in 90 articles in educational research journals. Four types of content and four citation functions were identified in the immediate context of the citation symbols. Surprisingly, no critical citations or discussions of the validity of the cited study were found. The results are discussed in relation to the conditions for communication within a field without disciplinary cohesion.     

Computerized Adaptive Testing in Early Education: Exploring the Impact of Item Position Effects on Ability Estimation

Studies have shown that item difficulty can vary significantly based on the context of an item within a test form. In particular, item position may be associated with practice and fatigue effects that influence item parameter estimation. The purpose of this research was to examine the relevance of item position specifically for assessments used in early education, an area of testing that has received relatively limited psychometric attention. In an initial study, multilevel item response models fit to data from an early literacy measure revealed statistically significant increases in difficulty for items appearing later in a 20‐item form. The estimated linear change in logits for an increase of 1 in position was .024, resulting in a predicted change of .46 logits for a shift from the beginning to the end of the form. A subsequent simulation study examined impacts of item position effects on person ability estimation within computerized adaptive testing. Implications and recommendations for practice are discussed.     

Long-term stability of students' evaluations: A note on Feldman's “consistency and variability among college students in rating their teachers and courses”

Feldman (1977), reviewing research about the reliability of student evaluations, reported that while class average responses were quite reliable (.80s and .90s), single rater reliabilities were typically low (.20s). However, studies he reviewed determined single rater reliability with internal consistency measures which assumed that differences among students in the same class (within-class variance) were completely random—an assumption which Feldman seriously questioned. In the present study, this assumption was tested by collecting evaluations from the same students at the end of each class and again one year after graduation. Single rater reliability based upon an internal consistency approach (agreement among different students in the same class) was similar to that reported by Feldman. However, single rater reliability based upon a stability approach (agreement between end-of-term and follow-up ratings by the same student) was much higher (medianr=.59). These results indicate that individual student evaluations were remarkably stable over time and more reliable than previously assumed. Most important, there was systematic information in individual student ratings—beyond that implied by the class average response—that internal consistency approaches have ignored or assumed to be nonexistent.     

The relative importance of teaching evaluation criteria from the points of view of students and faculty

Abstract

The student evaluation of teaching (SET) tool is widely used to measure student satisfaction in institutions of higher education. A SET typically includes several criteria, which are assigned equal weights. The motivation for this research is to examine student and lecturer perceptions and the behaviour of the students (i.e. ratings given by them to lecturers) of various criteria on a SET. To this end, an analytic hierarchy process methodology was used to capture the importance (weights) of SET criteria from the points of view of students and lecturers; the students' actual ratings on the SET were then analysed. Results revealed statistically significant differences in the weights of the SET criteria; those weights differ for students and lecturers. However, analysis of 1436 SET forms of the same population revealed that, although students typically rate instructors very similarly on all criteria, they rate instructors higher on the criteria that are more important to them. The practical implications of this research is the reduction of the number of criteria on the SETs used for personnel decisions, while identifying for instructors and administrators those criteria that are perceived by students to be more important.     

The Poor Fit of Model Fit for Selecting Number of Factors in Exploratory Factor Analysis for Scale Evaluation

Model fit indices are being increasingly recommended and used to select the number of factors in an exploratory factor analysis. Growing evidence suggests that the recommended cutoff values for common model fit indices are not appropriate for use in an exploratory factor analysis context. A particularly prominent problem in scale evaluation is the ubiquity of correlated residuals and imperfect model specification. Our research focuses on a scale evaluation context and the performance of four standard model fit indices: root mean square error of approximate (RMSEA), standardized root mean square residual (SRMR), comparative fit index (CFI), and Tucker–Lewis index (TLI), and two equivalence test-based model fit indices: RMSEAt and CFIt. We use Monte Carlo simulation to generate and analyze data based on a substantive example using the positive and negative affective schedule (N = 1,000). We systematically vary the number and magnitude of correlated residuals as well as nonspecific misspecification, to evaluate the impact on model fit indices in fitting a two-factor exploratory factor analysis. Our results show that all fit indices, except SRMR, are overly sensitive to correlated residuals and nonspecific error, resulting in solutions that are overfactored. SRMR performed well, consistently selecting the correct number of factors; however, previous research suggests it does not perform well with categorical data. In general, we do not recommend using model fit indices to select number of factors in a scale evaluation framework.     

Relational Aggression, Overt Aggression, and Friendship

This study ( n = 315 9–12-year-olds) was conducted to assess whether the social problems that relationally and overtly aggressive children typically experience in the peer group context are also exhibited in the dyadic, friendship context. The qualities of children's friendships (e.g., levels of intimacy) and of the importance of those qualities (e.g., the importance of intimacy) were assessed with self-report instruments adapted from past research. Results indicated that the friendships of relationally aggressive children were characterized by relatively high levels of intimacy, exclusivity/jealousy, and relational aggression within the friendship context. In contrast, the friendships of overtly aggressive children were characterized by engaging together in aggressive acts toward those outside the friendship. In addition, overtly aggressive children placed relatively high importance on these coalitional acts and on companionship with their friends. Implications for our understanding of aggressive children and for our knowledge of children's friendships are discussed.     

来华留学研究生学习成效影响因素研究——基于上海九所“双一流”建设高校的实证分析

本研究从以学习者为中心理论的视角,基于“院校影响因素理论模型”构建了我国“双一流”建设高校来华留学研究生学习成效影响因素的分析模型。依据国际高等教育实践、结合质性访谈,综合设计了大学教育环境、来华留学研究生学习性投入及其学习成效量表。以上海九所“双一流”建设高校的抽样数据进行结构方程模型路径分析,探究学习成效各影响因素的相互作用机制。研究发现：大学教育环境对来华留学研究生“认知成效”的影响完全以学生的学习性投入为中介产生间接的正向预测作用;而对“情感成效”的影响,相比于其他环境变量的完全间接效应,课程教学环境发挥了更多的直接效应。尽管校园文化氛围对来华留学研究生的学习成效有显著正向预测作用,但课程教学和科研训练的环境仍是影响学习成效增值的核心。来华留学研究生在科研训练中的投入最能正向影响情感成效增值。     

Between context and comparability: Exploring new solutions for a familiar methodological challenge in qualitative comparative research

Finding the balance between adequately describing the uniqueness of the context of studied phenomena and maintaining sufficient common ground for comparability and analytical generalisation has widely been recognised as a key challenge in international comparative research. Methodological reflections on how to adequately cover context and comparability have extensively been discussed for quantitative survey or secondary data research. In addition, most recently, promising methodological considerations for qualitative comparative research have been suggested in comparative fields related to higher education. The article’s aim is to connect this discussion to comparative higher education research. Thus, the article discusses recent advancements in the methodology of qualitative international comparative research, connects them to older analytical methods that have been used within the field in the 1960s and 1970s, and demonstrates their analytical value based on their application to a qualitative small‐N case study on research groups in diverse organisational contexts in three country contexts.     

Exploring the views and beliefs of parents of typically developing children about inclusion and inclusive education

Background: The inclusion of pupils with special educational needs and disabilities (SENDs) in regular classrooms has been identified as a high priority in many policy documents published by both European and international organisations. Its implementation, however, is influenced by a number of factors, some of which are directly related to the participation and attitudes of different stakeholders, including parents of typically developing children. Parents, as a social group, can act in favour of inclusion or they can support more segregated educational environments.

Purpose: The aim of this study was to explore, in a Greek context, the views and beliefs of parents of typically developing children about different aspects of the education of children with disabilities, with a particular focus on inclusion and inclusive education.

Method: Interviews were held with 40 Greek parents representing 40 typically developing school-aged children who were educated in six different primary education schools, from the broader area of central Greece. All of the children, at the time of the study, were educated in mainstream classes, in which an in-classroom support system was applied. Open-ended interview questions focused on parents’ views and beliefs about the implementation of inclusive educational programmes. Data were analysed according to the principles of an inductive data-driven approach.

Findings: The research findings indicate that most of the participant parents did not feel informed about specific school policy practices relevant to inclusive education; they were not aware of the notion of ‘inclusion’ or approached inclusion from an integrationist point of view. Within this context, they hold positive to neutral attitudes towards inclusion, on the basis that a child with SENDs can cope with the school requirements.

Conclusions: This small-scale, exploratory research study suggests the importance of informing and involving parents of typically developing children in efforts to promote more inclusive practices.     

Estimating Classification Accuracy and Consistency Indices for Multiple Measures with the Simple Structure MIRT Model

Multiple measures, such as multiple content domains or multiple types of performance, are used in various testing programs to classify examinees for screening or selection. Despite the popular usages of multiple measures, there is little research on classification consistency and accuracy of multiple measures. Accordingly, this study introduces an approach to estimate classification consistency and accuracy indices for multiple measures under four possible decision rules: (1) complementary, (2) conjunctive, (3) compensatory, and (4) pairwise combinations of the three. The current study uses the IRT-recursive-based approach with the simple-structure multidimensional IRT model (SS-MIRT) to estimate the classification consistency and accuracy for multiple measures. Theoretical formulations of the four decision rules with a binary decision (Pass/Fail) are presented. The estimation procedures are illustrated using an empirical data example based on SS-MIRT. In addition, this study applies the estimation procedures to the unidimensional IRT (UIRT) context, considering that UIRT is practically used more. This application shows that the proposed procedure of classification consistency and accuracy could be used with a UIRT model for individual measures as an alternative method of SS-MIRT.     

A Tiered Intervention Model for Early Vocabulary Instruction: The Effects of Tiered Instruction for Young Students At Risk for Reading Disability

Vocabulary knowledge at school entry is a robust predictor of later reading achievement. Many children begin formal reading instruction at a significant disadvantage due to low levels of vocabulary. Until recently, relatively few research studies examined the efficacy of vocabulary interventions for children in the early primary grades (e.g., before fourth grade), and even fewer addressed vocabulary intervention for students at increased risk for reading failure. In more recent work, researchers have begun to explore ways in which to diminish the “meaningful differences” in language achievement noted among children as they enter formal schooling. This article provides a review of a particularly effective model of vocabulary intervention based on shared storybook reading and situates this model in a context of tiered intervention, an emerging model of instructional design in the field of special education. In addition, we describe a quasi‐experimental posttest‐only study that examines the feasibility and effectiveness of the model for first‐grade students. Participants were 224 first‐grade students of whom 98 were identified as at risk for reading disability based on low levels of vocabulary. Results of a multivariate analysis of variance revealed significant differences on measures of target vocabulary knowledge at the receptive and context level, suggesting that students at risk for reading failure benefit significantly from a second tier of vocabulary instruction. Implications for classroom practice as well as future research are provided.     

A holistic approach to international students, institutional habitus and academic literacies in an Irish third level institution

This qualitative study examines the interplay between academic staff and international students with regard to developing academic literacies at university. Higher education has traditionally responded to increasing student diversity with the expectation that students will conform to institutional norms or habitus. In this context international students arrive with cultural capital which may not fit such norms, and would benefit from developing their academic literacy, as indeed would home students given an increasingly diverse student body in Irish higher education. Findings reveal a gap between academics expectations and international students’ capabilities. Academic staff remained within the remit of the research in contrast to the 22 international students who were interviewed. They did not separate the totality of their campus experience from academic literacy practices. These ranged from uncertainty around writing in another language to a mismatch between diversity management in class and students’ own expectations. International students found difficulty to making friends on campus which could benefit their integration into the academic literacy practices of their respective disciplines. Findings point towards a whole institution response to student diversity which transcends traditional disciplinary boundaries.     

Patterns of informal reasoning in the context of socioscientific decision making

The purpose of this study is to contribute to a theoretical knowledge base through research by examining factors salient to science education reform and practice in the context of socioscientific issues. The study explores how individuals negotiate and resolve genetic engineering dilemmas. A qualitative approach was used to examine patterns of informal reasoning and the role of morality in these processes. Thirty college students participated individually in two semistructured interviews designed to explore their informal reasoning in response to six genetic engineering scenarios. Students demonstrated evidence of rationalistic, emotive, and intuitive forms of informal reasoning. Rationalistic informal reasoning described reason‐based considerations; emotive informal reasoning described care‐based considerations; and intuitive reasoning described considerations based on immediate reactions to the context of a scenario. Participants frequently relied on combinations of these reasoning patterns as they worked to resolve individual socioscientific scenarios. Most of the participants appreciated at least some of the moral implications of their decisions, and these considerations were typically interwoven within an overall pattern of informal reasoning. These results highlight the need to ensure that science classrooms are environments in which intuition and emotion in addition to reason are valued. Implications and recommendations for future research are discussed. © 2004 Wiley Periodicals, Inc. J Res Sci Teach 42: 112–138, 2005     

How well do middle school science programs measure up? Findings from Project 2061's curriculum review

The purposes of this study were to examine how well middle school programs support the attainment of key scientific ideas specified in national science standards, and to identify typical strengths and weaknesses of these programs using research‐based criteria. Nine widely used programs were examined by teams of teachers and specialists in research on teaching and learning. Reviewers found that whereas key ideas were generally present in the programs, they were typically buried between detailed or even unrelated ideas. Programs only rarely provided students with a sense of purpose for the units of study, took account of student beliefs that interfere with learning, engaged students with relevant phenomena to make abstract scientific ideas plausible, modeled the use of scientific knowledge so that students could apply what they learned in everyday situations, or scaffolded student efforts to make meaning of key phenomena and ideas presented in the programs. New middle school science programs that reflect findings from learning research are needed to support teachers better in helping students learn key ideas in science. The criteria and findings from this study on the inadequacies in existing programs could serve as guidelines in new curriculum development. © 2002 Wiley Periodicals, Inc. J Res Sci Teach 39: 522–549, 2002     

Student satisfaction,teacher internships,and the case for a critical approach to international education

In recent times distinctions between the economic and political imperatives of international education and its cultural and educational aspects have become conveniently aligned. This alignment is troubling because it allows the pursuit of profit to fit neatly and without apparent controversy into the pursuit of more lofty political cultural and educational goals. Measures of student satisfaction with international education do little to challenge this comfortable affiliation. Indeed, they appear to reinforce the view that international education as currently pursued is travelling well and yielding maximum profits and benefits for all. The discussion in this article is based on the results of a pilot study that examined international student satisfaction with a teacher education internship program in Australia. Our findings showed that students were satisfied with their international education experience and that the internship/work integrated learning experience enhanced their satisfaction. Importantly however, our pre-departure study showed that students expected study abroad to make a difference to their lives even before they left home. The study led us to consider the meaning of student satisfaction and whether assessments of satisfaction might simply confirm what students already expect. If this is the case, it is not altogether clear what student satisfaction with international education means or measures.     

Development of a survey instrument to measure TEFL academics’ perceptions about,individual and workplace characteristics for conducting research

A 30-item survey was devised to determine Chinese TEFL (Teaching English as a Foreign Language) academics’ potential for conducting research. A five-part Likert scale was used to gather data from 182 academics on four factors: (1) perceptions on teaching–research nexus, (2) personal perspectives for conducting research, (3) predispositions for conducting research and (4) workplace contexts for conducting research. Data were subjected to confirmatory factor analysis (CFA) for structural equation modelling using various fit indices. The independence model was rejected. Accordingly, the CFA model proposed that the four factors covaried and were associated with each indicated item. The hypothesized CFA model demonstrated an acceptable model fit. After statistical analysis, a revised CFA model presented more reliable fit measures, which required a reduction in survey item numbers. This instrument will require further testing but may be used to draw comparisons between past and present data and determine areas for enhancing research productivity.     

Increasing participation of adults in higher education: factors for successful policies

This article contains an analysis of policies aimed at increasing the participation of adults in higher education (HE) in seven countries (NL, DK, SE, UK, BE Flanders, DE and the state of California in the USA). In order to maintain their economic competitiveness, many countries have developed policies to increase the participation of adults in HE. However, the effectiveness of these measures has not been studied to any significant degree as yet. Therefore, the focus of this article is to assess the effectiveness of these measures within their particular context. For this purpose, the research team carried out an international comparative study based on desk research, case studies and interviews with both policy makers and academic researchers in the seven countries. The study shows that there are common ingredients for effective learning environments, such as a high degree of flexibility of HE provision. In short term, in rationalising policies there are a number of issues that need to be addressed, e.g. the issue of what is the primary objective for increasing participation. In the long run, one needs to reconsider broader HE structures within a lifelong learning perspective towards a fundamental revision of the current systems. This is both necessary in combating crises and in dealing with problems encountered by ageing societies.     

Toward a system of teacher based examinations

Yearly data are collected describing progress in inclusive education. Frequently used criteria are the percentages of students attending special schooling or percentages of students officially labelled as having special educational needs (SEN). However, both criteria have pitfalls. In this study, the social participation of students was used as a criterion. We compared the social participation of students with SEN to the social participation of typically developing students in three countries, i.e. Norway, the Netherlands and the Flemish region of Belgium. In Norway, 37 seventh-grade students with SEN and 461 classmates; in the Netherlands, 29 seventh-grade students with SEN and 187 classmates; and in Flanders, 43 seventh-grade students with SEN and 469 classmates participated in this study. Peer nominations were used to assess students' peer acceptance in class. Results indicated that, across education systems, students with SEN had more social difficulties compared to typically developing students. Contrary to our initial expectations, the social participation of students with SEN in the more inclusive Norwegian education system did not outperform the social participation of the Dutch and Belgian students with SEN. However, these outcomes are an artefact of the sampling methods used. This confirms the complexity of international comparisons.     

On the evaluation of teaching and learning in higher education: a multicultural inquiry

The aim of the study was to develop a model of positive word‐of‐mouth (WoM) intentions in a higher education context. WoM was found to be directly influenced by satisfaction levels and indirectly by antecedents of satisfaction, namely positive and negative emotions and perceptions of performance. The model provided a good fit to the data and explained 58% of the variance in WoM intentions. When the model was tested on samples of domestic and international students, significant differences were noted in that the model explained only 21% of the variance in WoM for international compared to 68% for domestic. Moreover, emotions for the international sample did not significantly influence satisfaction or WoM intentions.