Development and validation of a theoretically based,multidimensional questionnaire of student evaluation of university teaching

The authors describe the development and validation of a multidimensional instrument of students’ evaluation of university teaching (the Pedagogical Questionnaire of the University of Porto). The goal was to develop an instrument based on a sound psychometric analysis and simultaneously supported by the learning theory. Based on the data from 4875 questionnaires, the present study examined the fit of the proposed multidimensional model of university teaching to the whole sample and to various specific university programmes of study using confirmatory factor analysis (AMOS 5.0). Results clearly supported the applicability of the proposed model for the whole university and across programmes of study, demonstrating the validity and reliability of the instrument in evaluating several distinct dimensions of the quality of university teaching.     

Development and validation of the groupwork skills questionnaire (GSQ) for higher education

The aim of the present study was to develop and provide psychometric evidence in support of the groupwork skills questionnaire (GSQ) for measuring task and interpersonal groupwork skills. A 46-item version of the GSQ was initially completed by 672 university students. The number of items was reduced to 15 following exploratory factor analyses, and a two-factor model consisting of task and interpersonal groupwork skills was revealed. Confirmatory factor analyses with model re-specification on new data (n = 275 students) established that the best fitting model consisted of 10 items and the same two factors (task and interpersonal). Concurrent validity of the GSQ was then determined with 145 participants by demonstrating significant relationships (p < 0.05) with attitudes towards groupwork and groupwork self-efficacy. Test–retest reliability was examined over a one-week interval. Overall, the GSQ demonstrates good validity and reliability, and has potential for both research and pedagogical application.     

Development and initial validation of a questionnaire to assess the reading beliefs of undergraduate students: the Cuestionario de Creencias sobre la Lectura

The aim of this research was to develop a new questionnaire for exploring the reading beliefs of undergraduate students, because the only currently available instrument has conceptual and methodological limitations. The paper describes the process of developing the instrument and presents a range of psychometric data obtained from a sample of 558 Spanish undergraduates who were in the first or final year of a degree programme in psychology, language and literature or engineering. The results provide evidence of the psychometric quality of items and reveal a dual structure of two and six factors, both obtained through exploratory and/or confirmatory factor analyses. Adequate reliability based on internal consistency of the factors was also demonstrated. As a measure of criterion validity, differences in reading beliefs by gender, academic year and knowledge area were also explored. The findings support the psychometric adequacy of this new instrument developed through an exploratory piece of research. Overall, the process of constructing the instrument and the results from this study provide a framework for research and intervention, in addition to presenting a tool that both researchers and teaching staff could use in the context of reading and reading comprehension.     

Development and preliminary validation of the moral authorship questionnaire

Learning Environments Research - Background When novice teachers start working in a school, it is vital that they are aware of the moral aspects of the work environment and can use their moral...     

Development and validation of ageist myths in a psychotherapy questionnaire (AMPQ): professional ageism among psychology graduate students

ABSTRACT

Ageism is a problem in aging societies. Clinical psychologists and undergraduate psychology students have shown negative attitudes toward older adults. However, no speci?c measure against ageist myths in the psychotherapeutic context is available. This study aims to develop and present the psychometric properties of the Ageist Myths about Psychotherapy Questionnaire (AMPQ).

These issues were examined by surveying 222 psychology graduates at higher education institutions about their attitudes and behaviors concerning psychotherapy with older adults, negative stereotypes toward aging, and attitudes toward dementia.

Using principal components analysis, 10 items were retained and one factor was obtained with an acceptable reliability index. Signi?cant associations were found between the AMPQ and negative stereotypes toward aging, and attitudes toward dementia.

Results revealed that universities and colleges with psychology programs have an ageist bias. Implications for college formation in aging, and older adults with mental health problems, are discussed and presented.     

Development and validation of the IMEB-M,a German questionnaire for assessing topic-specific epistemic beliefs

Epistemic beliefs are individual beliefs about knowledge and knowledge acquisition. Empirical studies indicate that learners’ epistemic beliefs influence their learning processes and success (e.g. motivation, text comprehension, learning strategy selection, grades). Teachers and trainers can support their apprentices in developing preferable epistemic beliefs to facilitate learning. To do this, instructors need information on learners’ current beliefs for lesson planning and monitoring epistemic beliefs development. The following paper reports the validation of a tool for generating this kind of information: the Instrument for Measuring Epistemic Beliefs in Marketing. The instrument validation is based on three studies (Study I: 225 university trained business administration students; Study II: 531 vocationally trained retailers/wholesalers; Study III: 179 vocationally trained bank assistants). It reveals high reliabilities (α values about .700), stable factor structures, and incremental validity in comparison to general epistemic beliefs. The new questionnaire is able to predict grades in marketing and can be used to diagnose apprentices’ epistemic beliefs for adjusting instruction to learners’ preconditions. Findings based on the new instrument indicate that apprentices show partly unfavourable epistemic beliefs. As a result, supporting learners in developing preferable beliefs provides an opportunity to increase their learning success.     

Development and initial validation of a performance-based scientific reasoning test for children

Scientific reasoning encompasses the cognitive skills used when conducting a deliberate scientific investigation. As there are not that many instruments available for assessing scientific reasoning in children, a new performance-based test was developed that taps children’s command of five key scientific reasoning processes (predicting, experimenting, interpreting, evaluating data, and drawing conclusions). Results of this first validation study with 170 children age 7–10 showed that the test has good item characteristics and acceptable reliability. Initial validity evidence indicated that children’s test scores were unaffected by gender and prior domain knowledge and largely independent of language and math abilities.     

Development and use of an instrument for assessing the department-level work environment: The department-level environment questionnaire (DLEQ)

There has been little research into the work environments of teachers at the subject department level. Understanding and investigating the work environment at this level could provide insight into the type of work environment that might lead teachers to remain in the teaching profession. This article reports the development, validation and use of a work environment instrument at the subject department level. The department-level environment questionnaire (DLEQ) was developed using the school-level environment questionnaire as the parent instrument. Both Actual and Preferred Forms of the DLEQ were used. Early-career secondary school science teachers’ perceptions of the actual and preferred science department environment in New Zealand were sought. In addition, interviews with 17 % of the participants were conducted in order to find out why the teachers answered the questionnaire in the way that they did. The findings highlight the needs of this particular group of teachers. Future research opportunities for further instrument development and use of the instrument are suggested.     

Development of the digital and socio-civic skills (DIGISOC) questionnaire

Educational technology research and development - Recognizing that digital citizenship includes the capacity to foster growth opportunities and also, can help to minimize risks and divides from the...     

Development and validation of a preschool teachers’ attitudes and beliefs toward science teaching questionnaire

Little is known about preschool teachers’ attitudes and beliefs toward science teaching, in part, because the field lacks valid and reliable measures of these teacher-related factors. To address this need, the current study developed and validated a rating scale (P-TABS) using a statewide sample of Head Start teachers (N = 507). A series of exploratory and confirmatory factor analyses were conducted. Generalizability and invariance of the final factor solution was examined across important subgroups of the standardization sample (i.e., teacher ethnicity, education level, and years of teaching experience). Three distinct factors were identified (Teacher Comfort, Child Benefit, and Challenges), with strong evidence for validity found for the first two factors. The P-TABS expands the availability of reliable and valid assessment tools for measuring preschool teachers’ attitudes and beliefs toward science teaching and for examining how these teacher-related factors affect classroom practices and student outcomes.     

Development and initial validation of a trait emotional intelligence scale for Korean adults

The purpose of this study is to develop and validate a trait emotional intelligence (EI) measurement for Korean adults. This scale was developed because there is still a lack of EI measurements that consider the effects of culture on emotions. It was found that the scale has a three-factor structure, and this structure was confirmed in cross-sample validation. If the construct validity of the measurement is confirmed in further studies, scholars as well as practitioners will be able to use the instrument in designing and evaluating EI development programs. In addition, by using the scale within various cultural settings, the effects of culture on EI may be uncovered.     

Development and validation of a questionnaire for teacher effective communication in Qur’an learning

ABSTRACT

A student’s perception of teacher effective communication influences the learning atmosphere. The measurement of perception indicates how students view the quality of learning. As few studies have explored the development of an appropriate measurement tool of students’ perception of learning to read the Qur’an, this study aims to develop such a tool. Conceptual analysis and a survey using open-ended questions resulted in dimensions and items. Six experts and three instructors evaluated the content validity. The questionnaire was then administered to 421 participants – 201 for Exploratory Factor Analysis (EFA) and 220 for Confirmatory Factor Analysis (CFA). The results successfully identified four dimensions that explained 64.6% of the variation. The instrument consisted of 13 items with satisfactory reliability and validity. The dimension with the highest coefficient path was ‘understanding and friendliness’ (UF), while the dimension of ‘learning media’ (LM) was the lowest. There was a significant influence of gender on the dimension of UF, as well as verbal (V) and non-verbal (NV) communication, while there were no differences in the dimension of LM. The questionnaire can be effectively used as a measurement device of dimensions related to students’ perception of teacher effective communication in Qur’an learning.     

Development of chemistry attitudes and experiences questionnaire (CAEQ)

In this article we describe the development of the Chemistry Attitudes and Experiences Questionnaire (CAEQ) that measures first‐year university chemistry students' attitude toward chemistry, chemistry self‐efficacy, and learning experiences. The instrument was developed as part of a larger study and sought to fulfill a need for an instrument to investigate factors that influence student enrollment choice. We set out to design the instrument in a manner that would maximize construct validity. The CAEQ was piloted with a cohort of science and technology students (n = 129) at the end of their first year. Based on statistical analysis the instrument was modified and subsequently administered on two occasions at two tertiary institutions (n = 669). Statistical data along with additional data gathered from interviews suggest that the CAEQ possesses good construct validity and will prove a useful tool for tertiary level educators who wish to gain an understanding of factors that influence student choice of chemistry enrolment. © 2003 Wiley Periodicals, Inc. J Res Sci Teach 40: 649–668, 2003     

Development and validation of the meaning of work inventory among French workers

The purpose of this study was to validate a psychometric instrument among French workers for assessing the meaning of work. Following an empirical framework, a two-step procedure consisted of exploring and then validating the scale among distinctive samples. The consequent Meaning of Work Inventory is a 15-item scale based on a four-factor model, and assesses the importance, understanding, direction, and purpose of work. The results indicate that this instrument is reliable for assessing the meaning of work in the French context. Implications for career counseling practices are discussed.     

Construction and validation of a Chinese SRL-based reading instruction questionnaire

The purpose of the study is to construct and validate a Chinese self-regulated learning (SRL)-based reading instruction questionnaire (CSRIQ) and to examine the relationship between Chinese reading instruction and Hong Kong students' reading development from the SRL perspective. A total of 339 Grade 10 students completed the initial CSRIQ in Study 1. Exploratory factor analysis and reliability analyses were used to assess the psychometric quality of the questionnaire, and the original CSRIQ subscales were then revised. Study 2 comprised 1,121 Grade 10 students. The factor structure of the revised CSRIQ was supported by the findings of confirmatory factor analysis. The findings of structural equation modelling indicated significant relations between SRL-based instruction and various reading-related variables. Among the four aspects of instruction, teacher support was the most positive factor facilitating Chinese students' reading development, whereas student autonomy seemed less favourable. Cultural and curricula factors affecting Chinese reading instruction in Hong Kong were discussed.     

Development and validation of the E-learning Acceptance Measure (ElAM)

This research involves the development and validation of a survey that measures users' acceptance of e-learning. A total sample of 386 university students from a teacher training institute in an Asian country participated in this study. Comprising two studies, the first study (n = 197) initiated a generic questionnaire, and examined factorial validity and reliability. The second study (n = 189) used confirmatory factor analysis to establish factorial validity and measurement invariance by gender using a different sample. A correlated three-factor model (Tutor Quality, Perceived Usefulness, and Facilitating Conditions) was fit using maximum likelihood estimation (MLE) and found to be adequate. For the two samples, the E-learning Acceptance Measure (ElAM) was found to be a precise and internally consistent measure. Applications of the ElAM were discussed.     

Development and validation of a Supportive Learning Environment for Expertise Development Questionnaire (SLEED-Q)

Development of professional expertise is the process of continually transforming the repertoire of knowledge, skills and attitudes necessary to solve domain-specific problems which begins in late secondary education and continues during higher education and throughout professional life. One educational goal is to train students to think more like experts and approach the mastery of a subject as an expert would. Helping students to develop professional expertise and evaluating whether classrooms are conducive to the development of expertise is difficult and time-consuming. At present, there is no instrument that measures all the core classroom factors that influence specifically the development of professional expertise. This paper describes the development and validation of an instrument that measures the extent to which educators create a Supportive Learning Environment for Expertise Development, the SLEED-Q. A sample of 586 secondary school students (14–18 years-old) was used for validation. Both exploratory and confirmatory factor analyses were carried out. Examination of the fit indices indicated that the model seemed to fit the data well, with the goodness-of-fit coefficients being in recommended ranges. The SLEED-Q, consisting of seven factors with 30 items, the SLEED-Q has potential as an instrument for examining how conducive learning environments are to development of professional expertise in secondary school settings. The implications of the results and potential paths for future research are considered.     

Construction and validation of a questionnaire to study future teachers' beliefs about cultural diversity

The article presents the construction and validation process of a questionnaire designed to study student teachers' beliefs about cultural diversity. The study, beyond highlighting the complexity involved in the study of beliefs, emphasises their relevance in implementing inclusive educational processes that guarantee the right to a good education for all. The questionnaire was administered to 1464 students from the different Teacher Education specialties. The results show that the instrument has a satisfactory internal consistency and is structured in seven components that largely correspond to the theoretical proposals used as the basis for constructing the questionnaire. The actions and analyses performed in the process of elaborating this inventory represent an advance compared to other similar studies in this line of research. From a methodological point of view, they provide detailed information about the questionnaire's psychometric characteristics, reliability and validity, with particular emphasis on the empirical data stemming from its application. From a conceptual point of view, the study incorporates beliefs related to different theoretical models of attention to cultural diversity, as well as their possible practical derivations at different levels of specificity.     

Professional Learning Community Assessment-Revised (PLCA-R) questionnaire: translation and validation in Spanish context

Learning Environments Research - The analysis of professional community is a good indicator of the degree of professional and institutional development of a school. The Professional Learning...