Psychometric characteristics of a sexuality education survey for teachers of secondary school students with learning disabilities in Malaysia

Delivery of sexuality education to secondary school students in Malaysia started since 1989. However, this area of education was neglected for secondary students with learning disabilities. Therefore, in order to explore their needs for sexuality education, society's perceptions especially teachers’ towards this matter should be considered. To achieve this objective, it is important to conduct a needs analysis on teachers’ perceptions towards this topic. An instrument with good psychometric properties is needed to obtain consistent and reliable information. This paper describes the development and psychometric testing of the Sexuality Education Survey for Teachers of Secondary School Students with Learning Disabilities (SES). SES showed acceptable content validity, construct validity, and achieved satisfactory reliability. The instrument also has good stability (intraclass correlation coefficient = 0.95) to be adopted as an instrument for analysing the health and sexuality education needs of secondary students with learning disabilities in Malaysia.     

Using a New Learning Environment Questionnaire for Reflection in Teacher Action Research

This article reports the development, validation and use of an instrument designed to provide teachers with feedback information, based on students’ perceptions, about their classroom environments. The instrument was developed to provide teachers with feedback that they could use to reflect on their teaching practices and, in turn, guide the implementation of strategies to improve their learning environments. To determine the validity and reliability of the new instrument, data from 2043 grade 11 and 12 students from 147 classes in 9 schools were analysed. The Rasch model was used to convert data collected using a frequency response scale into interval data that are suitable for parametric analyses. During an action research process, reflective journals, written feedback, discussions at a forum and interviews with eight teachers helped to illuminate the processes used by teachers during action research. This article reports the views of these teachers in general and examines more closely how one of the teachers used student responses to the learning environment questionnaire as a tool for reflection and as a guide in transforming her classroom environment. This case study helped us to gauge the extent to which action research based on students’ perceptions of the learning environment was useful in guiding teachers’ improvements of their classroom learning environments.     

Investigating the use of student perception data for teacher reflection and classroom improvement

This article reports a study involving: (1) developing and validating a learning environment instrument, (2) investigating whether reflection on feedback generated using the instrument led to improvements in the learning environment and (3) examining how teachers used the feedback. For the new learning environment instrument, validity was supported for a sample of 10,345 secondary students over 3 years (2,042 students in 2008, 4,467 in 2009 and 3,836 in 2010). To investigate whether reflection on feedback from this instrument led to improvements in the learning environment, multivariate analysis of variance and effect sizes were used to examine pre–post differences. Statistically significant improvements in students’ views of the learning environment were found for 8 of the 11 scales. Finally, we examined how teachers used the student feedback. Of the 459 teachers, 45 focus teachers used the feedback as part of a formal action research approach involving entries in reflective journals, written reports, discussions and participation at a forum. These data were analysed to provide an overview of the ways in which the information was used, and to provide a more detailed account of the journey of one of the teachers.     

Developing an instrument to assess student readiness for online learning: a validation study

Given the continued growth in online learning as well as reports of high attrition rates in it, understanding student readiness for online learning is necessary. Over the years several surveys have been developed to assess student readiness as a predictor of success in online programs; however, a review of the literature yielded limited results of their translation and criterion‐referenced validity. The researchers of this article sought to develop a more rigorous survey instrument for students to self‐assess readiness for online learning. The authors report on findings from a three‐phase study during which the instrument was developed, evaluated, and validated. Through the process of validation, the researchers systematically engaged in an iterative process to refine the instrument, which resulted in not only a more rigorous instrument but one that more clearly defines ready and situates it within the literature on learner characteristics, digital divide, and information and communications technology (ICT) engagement.     

Mapping context-based learning environments: The construction of an instrument

The current trend in science curricula is to adopt a context-based pedagogical approach to teaching. New study materials for this innovation are often designed by teachers working with university experts. In this article, it is proposed that teachers need to acquire corresponding teaching competences to create a context-based learning environment. These competences comprise an adequate emphasis, context establishment, concept transfer, support of student active learning, (re-)design of context-based materials, and assistance in implementation of the innovation. The implementation of context-based education would benefit from an instrument that maps these competences. The construction and validation of such an instrument (mixed-methods approach) to measure the context-based learning environment is described in this paper. The composite instrument was tested in a pilot study among 8 teachers and 162 students who use context-based materials in their classrooms. The instrument’s reliability was established and correlating data sources in the composite instrument were identified. Various aspects of validity were addressed and found to be supported by the data obtained. As expected, the instrument revealed that context-based teaching competence is more prominently visible in teachers with experience in designing context-based materials, confirming the instrument’s validity.     

Construction and validation of a classroom climate scale: a mixed methods approach

Students’ perceptions of their classroom climate have been found to relate significantly to students’ learning outcomes. The purpose of the present study was to construct an instrument for assessing elementary-school students’ perceptions of classroom climate, based on a previous instrument that was being used in Chile by a public national school mental health program as a tool for aiding teachers in improving classroom management, but which showed poor psychometric properties. We used a six-staged mixed-methods approach to construct relevant items and dimensions based on this measure and by adapting previously-existing scales. Item development included participatory construction of items involving program officials, focus groups with students, and a pilot study. The final version was administered to a sample of 6813 elementary-school students. Results showed adequate reliability and construct validity, convergent validity with school climate, and divergent validity with peer victimisation. When consequential validity was explored through semi-structured interviews with program officials and school administrators, we found that the instrument was being used as a tool for helping teachers to improve their school climate and management skills. We discuss the importance of constructing instruments using a mixed-methods approach.     

Development and validation of the Place-Based Learning and Constructivist Environment Survey (PLACES)

Learning environment studies acknowledge that learning takes place within the social realm and that social conditions contribute to the quality of both learning and experience. This can be said to be especially true for environmental learning programs. To access information about students?? perceptions of their learning environment, a robust instrument for describing and measuring student perceptions of environmental education in place-based educational settings was developed and validated. Focus groups with environmental educators were formed to explore (from teachers?? perspective) the factors viewed as most important to environmental learning and as most likely to influence the unique type of learning environments fostered in place-based or community-based environmental education programs. Analysis of qualitative work resulted in the inclusion of eight scales developed/adapted from previous learning environment surveys for use in the new Place-Based Learning and Constructivist Environment Survey for use in secondary settings. In this article, validity and reliability data for this instrument are presented and the implications of these data for future research within environmental education, place-based education and teacher education programs are discussed.     

Development and Validation of an Instrument to Measure Students’ Motivation and Self‐Regulation in Science Learning

Students’ motivational beliefs and self‐regulatory practices have been identified as instrumental in influencing the engagement of students in the learning process. An important aim of science education is to empower students by nurturing the belief that they can succeed in science learning and to cultivate the adaptive learning strategies required to help to bring about that success. This article reports the development and validation of an instrument to measure salient factors related to the motivation and self‐regulation of students in lower secondary science classrooms. The development of the instrument involved identifying key determinants of students’ motivation and self‐regulation in science learning based on theoretical and research underpinnings. Once the instrument was developed, a pilot study involving 52 students from two Grade 8 science classes was undertaken. Quantitative data were collected from 1,360 students in 78 classes across Grades 8, 9, and 10, in addition to in‐depth qualitative information gathered from 10 experienced science teachers and 12 Grade 8 students. Analyses of the data suggest that the survey has strong construct validity when used with lower secondary students. This survey could be practically valuable as a tool for gathering information that may guide classroom teachers in refocusing their teaching practices and help to evaluate the effectiveness of intervention programmes.     

The Development of an Instrument to Measure the Project Competences of College Students in Online Project-Based Learning

This study sought to develop a self-report instrument to be used in the assessment of the project competences of college students engaged in online project-based learning. Three scales of the KIPSSE instrument developed for this study, namely, the knowledge integration, project skills, and self-efficacy scales, were based on related theories and the analysis results of three project advisor interviews. Those items of knowledge integration and project skill scales focused on the integration of different disciplines and technological skills separately. Two samples of data were collected from information technology-related courses taught with an online project-based learning strategy over different semesters at a college in southern Taiwan. The validity and reliability of the KIPSSE instrument were confirmed through item analysis and confirmatory factor analysis using structural equation modeling of two samples of students’ online response sets separately. The Cronbach’s alpha reliability coefficient for the entire instrument was 0.931; for each scale, the alpha ranged from 0.832 to 0.907. There was also a significant correlation (r = 0.55, p < 0.01) between the KIPSSE instrument results and the students’ product evaluation scores. The findings of this study confirmed the validity and reliability of the KIPSSE instrument. The confirmation process and related implications are also discussed.     

Early identification of primary school students with learning difficulties in Hong Kong: the development of a checklist

Early identification of children experiencing difficulties in learning is essential for timely and effective intervention. The aim of this study was to develop a screening instrument for identifying students with learning difficulties at the end of the first term of Primary 1 in Hong Kong. This paper describes the development and validation of a 27‐item checklist on 594 students. Validity testing performed included content and expert, contrasted group, concurrent and predictive validity; all were found to be satisfactory. In addition, test–re‐test reliability was assessed to be good. The checklist can be administered in 10 minutes for each student based on everyday observations of the student; no specific testing of the students would be required. A longer version with 97 items was also made available for teachers to conduct a more comprehensive evaluation of a child’s performance.     

网络环境下大学新生英语自主学习能力的实证研究

以网络环境下的大学新生为研究对象,从目标与计划、学习内容、学习策略、反思与评价和信息技术五个维度对其英语自主学习能力进行调查与分析。调查结果表明大学新生在网络环境下的英语自主学习能力并不高。针对这一现象,积极探索培养路径:整合优化网络资源,转变教师角色,培训学生的学习策略。     

Teacher–student interpersonal relationships in Indonesian lower secondary education: Teacher and student perceptions

This study investigated firstly the reliability and validity of an Indonesian version of the Questionnaire on Teacher Interaction (QTI). Second, perceptions of Indonesian secondary school teachers?? interpersonal behaviour as perceived by students and teachers were studied with the QTI. Third, differences between students?? and teachers?? perceptions regarding interpersonal teacher behaviour were compared. The QTI itself is based on the Model of Interpersonal Behaviour which maps teacher behaviour in terms of Influence (Dominance?CSubmission) and Proximity (Cooperation?COpposition). In this study, an Indonesian version of the QTI was constructed and distributed to 2,380 students of 69 teachers from 85 classes (grade 7?C9) from 12 public lower secondary schools in Indonesia. The results showed high reliability and validity for the instrument. Students?? and teachers?? average ratings on Influence were similar, while teacher??s ratings of Proximity were higher than those of students.     

Development of an instrument to evaluate the effectiveness of teachers in guiding small groups

In many student-centred curricula, teacherswork in small groups with students. Guidingsmall groups is rather complex. Teachers needto aim to stimulate students in these groupstowards constructive, self-directed, contextualand collaborative learning. It is alsoimportant that teachers demonstrate adequateinterpersonal behaviour towards students. Inthis study, an instrument was developed toprovide teachers with feedback about theirperformance to improve their behaviour. The aimof this study is to report on the development,reliability and validity of an instrument toevaluate teachers' performance in guiding smallgroups.The items of the instrument were based on fivetheoretical dimensions: constructive,self-directed, contextual and collaborativelearning and the teacher's interpersonalbehaviour. Students were asked to fill out thisinstrument and evaluate the performance of theteacher guiding the small group at the end ofseveral courses. The instrument was tested in apilot-study. Confirmatory factor analysis andgeneralizability studies indicated that theinstrument is fairly valid and reliable whensix student responses are available perteacher. Teachers receive detailed feedbackabout their performance indicating strong andweak aspects. Further research is needed todetermine whether this feedback indeed leads toimprovement of teachers' behaviour.     

A culturally-adaptive Iranian version of the Questionnaire on Teacher Interaction to investigate English teachers’ interpersonal behaviour

We investigated Iranian secondary-school English teachers’ interpersonal behaviour with a validated culturally-adaptive Iranian version of the Questionnaire on Teacher Interaction. Data were collected from 971 Iranian secondary-school students (398 students participated in the pilot study and 573 students in the main study) and 55 Iranian secondary-school English teachers (23 teachers participated in the pilot study and 32 in the main study). The construction of the instrument started with an open-ended questionnaire followed by semi-structured interviews to prepare items for the questionnaire. Next, expert judgement, pilot administration of the questionnaire and statistical analyses ensured its reliability and construct validity before final administration of the questionnaire to the main participants followed. The study supported the validity and reliability of the questionnaire and confirmed its usability in the Iranian secondary-school context. Furthermore, the results indicated that the students perceived their English teachers as being Tolerant and Authoritative, showing higher degrees of friendship, leadership and understanding behaviour and relatively low levels of uncertain and dissatisfied behaviour. The results showed a discrepancy between students’ perceptions of actual and ideal teacher interpersonal behaviour. Also students’ perceptions of their actual teachers’ interpersonal behaviour were significantly different from those of the teachers’ self-perceptions. One important implication of this study is that the QTI can be used in secondary-school contexts as a valuable feedback instrument to encourage teachers to reflect on their performance and improve their interpersonal behaviour as a part of their professional development.     

Evaluating the perception of disability and the inclusive education of teachers: the Italian validation of the Sacie-R (Sentiments,Attitudes, and Concerns about Inclusive Education – Revised Scale)

This study aimed to verify the factorial structure, internal validity, reliability, and criterion validity of The Sentiments, Attitudes and Concerns about Inclusive Education Revised Scale (SACIE-R) in an Italian sample. The SACIE-R is a useful tool to measure three aspects of teachers’ perceptions about inclusion, which are Sentiments, Attitudes and Concerns, providing valuable information to address the needs of teachers working with special students. A measure of this construct is currently not available in Italian, and a validation process is required. In order to provide an initial psychometric evaluation of the Italian adaptation, the SACIE-R was translated for use in Italian-speaking populations. Four hundred Italian teachers enrolled in educational teaching courses completed the SACIE-R. Confirmatory factor analyses demonstrated a good fit to the hypothesised 3-factor model, and adequate internal consistency for the scale was evidenced. A confirmatory factor analysis showed the same factor structural validity as the original instrument (although some items in the original version were deleted). Furthermore, taken together, the results showed a good level of reliability, and convergent and discriminant validity. Finally, the Italian version of the SACIE-R has good psychometric characteristics that can make it a useful measure of teacher attitude toward inclusion in the Italian educational context.     

Further Examination of a Curriculum-Based Value-Added Model for Teacher Preparation: Exploring the Role of Teachers’ Behavior on K–12 Student Learning

Multiple threats to validity and reliability exist when value-added models (VAMs) rely wholly on standardized assessments to measure the relationship between teachers and their K–12 students’ learning gains. Research on a curriculum-based VAM, built on evidence-based practices, continues to establish an explicit link between teacher candidates’ instruction and their K–12 students’ learning gains. Statistical tests of association were used to analyze measures of student learning and university supervisors’ ratings during classroom observations with a department instrument, the Narrative Observation Scale. Results from a sample of 23 teacher candidates revealed that (a) two measures of student learning were related and attributed to candidates’ instruction, and (b) 67.6% of the variance in the percentage of K–12 students meeting their specific learning objectives was accounted for by the teacher candidates’ mastery of specific classroom management behaviors. Limitations and directions for future research are discussed regarding continued efforts to refine a rational, curriculum-based VAM.     

Development of an instrument for assessing senior high school students’ preferred and perceived laboratory classroom environment

This study aimed to develop an instrument, named the inquiry-based laboratory classroom environment instrument (ILEI), for assessing senior high-school science students’ preferred and perceived laboratory environment. A total of 262 second-year students, from a senior-high school in Taiwan, were recruited for this study. Four stages were included in the development of the ILEI: (1) item formulation, (2) content validation, (3) construct validation and (4) reliability calculation. The study revealed that the ILEI was valid and reliable. Most students showed a preference for a student-directed and teacher-guided hybrid learning environment. The development of the ILEI is likely to help researchers and teachers to more effectively understand student views of the laboratory classroom environment. Our profound hope is to utilise ILEI to improve teachers’ assessment and students’ learning in inquiry-based laboratory classroom environments.     

Assessing student exposure to and use of computer technologies through an examination of course syllabi

A syllabus analysis instrument was developed to assist program evaluators, administrators and faculty in the identification of skills that students use as they complete their college coursework. While this instrument can be tailored for use with a variety of learning domains, we used it to assess students' use of and exposure to computer technology skills. The reliability and validity of the instrument was examined through an analysis of 88 syllabi from courses within the teacher education program and the core curriculum at a private Midwest US university. Results indicate that the instrument has good inter‐rater reliability and ratings by and interviews with faculty and students provide evidence of construct validity. The use and limitations of the instrument in educational program evaluation are discussed.     

Validation of the perceived school bullying severity scale

Research on school bullying has tended to focus on its prevalence or frequency while ignoring its perceived severity. This study attempted to construct a perceived School Bullying Severity Scale (SBSS). The original 24-item instrument, revised from the Victim Scale of the School Bullying Scales, covered the four categories of physical, verbal, relational and cyber bullying. The partial credit model was used to conduct Rasch analysis with ConQuest software on data derived from two samples of Taiwanese secondary school students. Sample 1 and sample 2 consisted of 605 and 869 students, respectively. Three items were deleted after examining the quality of the data from sample 1. The reliability and validity of the 21 items on the final scale were verified using data from sample 2. Results demonstrated the reliability and validity of information collected by the SBSS. This study also found that secondary school students rated relational and cyber bullying as more severe than physical and verbal bullying. Differences between teachers’ and students’ perspectives on the perceived severity of various bullying behaviours as well as implications for preventing and intervening in bullying are discussed.     

Cultivation in Learner Autonomy Based on Learning Styles

Learner autonomy is no easy choice for most students when they are used to having teachers do everything for them.As teach ers,it is their responsibility to help the students know how to use it and to understand that autonomy goes beyond of freedom.Learning styles play an important role because teachers need a clear picture of each student’s learning capabilities.Teachers can encourage students to reach dependence by attending their needs,taking into account learner styles.The goal of this research study is to find ways in which teach ers and students can build autonomy together.It first examines the learning styles of the sample students,and then makes discussions about fostering learner autonomy based on different learning styles.