On Meaningful Measurement: Issues of Reliability and Validity from a Humanistic Constructivist Information‐Processing Perspective

ABSTRACT

In the past decade, there has been interest in the assessment of cognitive and affective processes and products for the purposes of meaningful learning. Meaningful measurement (MM) has been proposed which is in accordance with a humanistic constructivist information‐processing perspective. Students’ responses to the assessment tasks are now evaluated according to an item response measurement model, together with a hypothesized model detailing the progressive forms of knowing/competence under examination. There is a possibility of incorporating student errors and alternative frameworks into these evaluation procedures. Meaningful measurement leads us to examine the composite concepts of “ability” and “difficulty”. Under the rubric of meaningful measurement, validity assessment (i.e. internal and external components of construct validity) is essentially the same as an inquiry into the meanings afforded by the measurements. Concepts of reliability, expressed as a group statistics which is applied in the same way to all the examinees in the sample, have to be obviated when the precision of the trait estimates stemming from the item response measurement models can be determined at each trait level. Reliability, measured in terms of standard errors of estimates needs to be within acceptable limits when internal validity is to be secured. Further evidence of validity may be provided by in‐depth analyses of how “epistemic subjects” of different levels of competence and proficiency engage in different types of assessment tasks, where affective and metacognitive behaviours may be examined as well. These ways of undertaking MM can be codified by proposing a three‐level conceptualization of MM. It is within the rubric of this conceptualization and the MM enquiry paradigm that validity and reliability of test measures are discussed in this paper.     

Teachers as Facilitators in a Computer‐supported Learning Environment

ABSTRACT

This paper argues that teachers in this technology‐rich era have a new role to play in their classrooms. As a knowledge facilitator, rather than a knowledge presenter, the job of the teacher is to create a computer‐ supported learning environment where learners are encouraged to think critically and creatively and to develop personal ownership and appreciation of the knowledge constructed. Classroom examples are given in this paper to provide evidence that the teacher's role is crucial in a successful computer‐ based learning environment. The implications of computer‐supported learning environments to teacher development and education are also discussed.     

‘Unconscious’ inclusion of students with learning disabilities in a Malaysian mainstream primary school: teachers' perspectives

The inclusion of children with special needs in mainstream regular schools has been seen as the best practice in special education provision, most markedly since the 90s. International research has provided amassing evidence towards the advantages of inclusive model over a segregation model of special education provision. However, nearly two decades after the signing of the international pledge, namely the Salamanca Statement (UNESCO) towards accepting inclusive education, Malaysia has not yet fully gained the momentum to implement inclusive education for children with special needs, especially for children identified within the category of learning disabilities. Because of the delay in policy implementation, inclusive education remains sparingly practiced in some schools without formal support. This study aims to investigate a scenario of this practice in a mainstream primary school via interviewing the regular teachers. The ultimate aim of this investigation is to identify ways to move forward from the current practice of ‘unconscious inclusion’.     

The development and validation of an information literacy model for Hong Kong students: key issues in the professional development of teachers for capacity building

An information literacy (IL) framework has been proposed for Hong Kong students to adapt to the emergence of the knowledge‐based society, digital culture and globalisation. The aims of the study reported herein were to validate the proposed IL model and collect the views of practitioners and representative stakeholders on the possibility of its successful implementation. The findings of a survey, focus group discussions and in‐depth interviews indicate that the aims and scope of the IL model were recognised as being relevant. Three key issues of professional development in the IL education—the realisation of capacity building, obtaining the consensus and support of school principals and teachers, and allowing practitioners the flexibility to organise their own development—were identified from amongst the concerns of practitioners and representative stakeholders. Nine modules for teacher professional development are proposed here to address these issues.     

The Introduction of Personal and Social Education in Secondary Schools in Hong Kong

In Hong Kong the secondary school curriculum has long been criticized for its heavy emphasis on academic performance and examination-oriented approaches to subject learning. As a consequence, pupils in Hong Kong only possess knowledge and skills that could carry them through examinations. They lack qualities and dispositions as well as related skills and understandings which will help them to make sense of this complicated society. It is noted that time has come for a reflection of the secondary curriculum and this article argues for the introduction of Personal and Social Education in secondary schools in Hong Kong which can bring relevance, breath, and balance to the curriculum from three aspects – aims of education, change in society, and nature of work.     

Going beyond textbooks: a study on seamless science inquiry in an upper primary class

This paper reports an initial study on investigating inquiry-based learning in science in an upper primary class guided by an inquiry-based learning model in a seamless learning environment. Two questions are addressed: (1) how students advanced their domain knowledge?; and (2) how students developed their inquiry skills? One teacher and 27 Grade-four students from a local primary school were involved in the study. Six inquiry-based learning lessons focusing on a scientific “rustproofing” learning unit were conducted in a seamless learning environment, initiated in a digital classroom and extended to online discussions on a social network platform. Qualitative data were collected and analysed over two weeks. The results show ways that the students advanced their domain knowledge and developed their inquiry skills.     

UPCC: A model of plagiarism-free inquiry project-based learning

Plagiarism is a common problem among students, and if unaddressed, it may lead to severe consequences for students' academic integrity and education, and even for their career advancement. It is therefore essential to incorporate comprehensive anti-plagiarism intervention at an early stage of education. This study introduces UPCC (Understanding, Paraphrasing, Citations, and Checks), a pedagogical model of plagiarism-free project-based learning (PjBL), to provide a basis for plagiarism prevention for secondary school students aged 11–13. The UPCC model incorporates (U)nderstanding plagiarism, learning about (P)araphrasing and related skills, generating proper (C)itations with an online citation tool and conducting originality (C)hecks with an online tool. Evaluation of the model shows that this pedagogy effectively enables students to avoid plagiarism in behavioural, cognitive and affective aspects. The positive and negative factors affecting plagiarism are also outlined. This study may provide practical guidance for secondary teachers to implement the UPCC model in their teaching of avoiding plagiarism; it may also contribute to future research committed to students' changes in behaviour, cognition and emotion.     

Short report Further efforts in validating a 'spurning scale' for teachers

The present study represents our continuing effort to validate a 'spurning scale' for teachers, based on a model on spurned helpers' reactions. Three approaches were used to examine the validity of the scale: the spurning scores of teachers working with more achieving students vs the scores of teachers teaching less achieving students. The relationships between the spurning scores and job satisfaction and turnover scores; and the relationships between the spurning scores and scores indicative of stress arising from interactions with one's students and supervisor. Serving teachers in Hong Kong responded to a questionnaire that contained the variables of interest. The results provided further evidence for the validity of the scale.     

Audio-based versus text-based asynchronous online discussion: two case studies

The main objective of this paper is to examine the use of audio- versus text-based asynchronous online discussions. We report two case studies conducted within the context of semester-long teacher education courses at an Asian Pacific university. Forty-one graduate students participated in Study I. After the online discussions (both audio-based as well as text-based) had ended, qualitative data via student reflections were collected. Results revealed that audio-based discussions have six distinct perceived affordances compared to text-based ones. Interestingly, despite the reported affordances, more than half of the students reported that they preferred to use a text-based discussion if given a choice. The main reasons for their preference were explored. In Study II, 42 undergraduate students took part. Similar to Study I, participants in Study II also indicated that they felt more comfortable using a text-based discussion. The reasons for their preference were also discussed. Directions for future research are proposed.