Photovoice as a research method for higher education research

ABSTRACT

Higher education (HE) research often draws on a range of qualitative research approaches. However, some methods developed in other fields are underutilised in HE research, even though they could be of great use for answering particular kinds of research questions, or for involving students more actively in the research process. In this article, we draw on a study that piloted different methodological approaches to explore students’ conceptions of good teaching and effective learning at university. The participants in our study included 33 high achieving international, Māori, Pacific Island, and (other) local students enrolled in Humanities subjects. Our study used photovoice as a visual data collection approach in conjunction with more traditional methods of data collection: open-ended focus group questions and critical incident technique. In this article, we review the photovoice literature, which is mostly from outside HE. Then, we describe our study, discussing the students’ responses to photovoice, and the different kinds of data it elicited. We note that, while most students expressed appreciation of the photovoice approach, some also found it restrictive and challenging in some respects. We conclude, photovoice offers a useful methodological addition to HE research, while noting, as with all data collection approaches, researchers need to be mindful of its limitations.     

Internationalisation and the validity of knowledge in religious education as a field of research

ABSTRACT

Building on the notion of validity claims within the discussion on international knowledge transfer in religious education as a field of research, three views on the contextuality of knowledge are discussed. From a classical perspective in the sociology of science, the issue of validity must be treated irrespective of matters of context. Secondly, from the perspective of postcolonial studies, this naïve view is criticised as a veiled form of Eurocentrism. Thirdly, these two general views are concretised in light of a reception process bridging the Global South and the Global North. To this end, exemplary factors contributing to the inclusion of Paulo Freire’s pedagogical work in discourses on religious education are analysed. What emerges through these analyses is a differentiated view of validity resting on the de- and recontextualisation of knowledge that allows for it to oscillate between different contexts.     

The assessment of lesson plans in teacher education: a case study in assessment validity and reliability

This paper forms part of an exploration of assessment on one part‐time higher education (HE) course: an in‐service, professional qualification for teachers and trainers in the learning and skills sector which is delivered on a franchise basis across a network of further education colleges in the north of England. This paper proposes that the validity and reliability of portfolio‐based assessment, a key component of many HE programmes in addition to the course being researched here, is contestable. Analysis of the processes of compiling portfolios for assessment, through the conceptual framework of the New Literacy Studies, suggests that the ways in which portfolios are assessed and the ways in which the crucial requisites of validity and reliability are assigned to them, mask complexities and contradictions in their creation by the student. This paper argues for a new, critical analysis of portfolio production and raises a number of questions about the validity, reliability and authenticity of the assessment process that the portfolios reify.     

Reliability and validity in qualitative research within education in Africa

This article discusses the problems of validity and reliability in qualitative research within education and relates this discussion to Africa. A main concern is the posing of the right research questions. The article attempts to bring into focus the voice of Africans, showing that the African researcher knows his/her environment better than any expatriate and will be more likely to ask the right questions provided that s/he is allowed to ask them and is not forced to work with questions of concern to Western donors, and provided that s/he trusts her/his own experiences and uses those to form concepts instead of merely transferring concepts formed in the West and based on experiences in the northern hemisphere. It argues for the need of secondary research to reanalyze from an Afro-centric viewpoint many of the accounts written by Western travellers and anthropologists. It further argues for the use of an autobiographical approach to secure data of high ecological validity. Validity is looked at as a more important concept than reliability and a mixing of qualitative and quantitative methods argued for.

---

Zusammenfassung Dieser Artikel befaßt sich mit Problemen der Gültigkeit und zuverlässigkeit der Qualitativen Forschung innerhalb der Bildung in Bezug auf Afrika. Ein Hauptanliegen ist die richtige Fragestellung hinsichtlich der Forschung. Der Artikel versucht die Stimme der Afrikaner in den Vordergrund zu stellen und zeigt damit, daß afrikanische ForscherInnen ihr Umfeld besser als irgendein Außenstehender kennen und somit mit größerer Wahrscheinlichkeit die richtigen Fragen stellen. Dies setzt voraus, daß sie die richtigen Fragen stellen dürfen und nicht gezwungen sind, für westliche Geldgeber richtig erscheinende Fragen zu stellen. Eine weitere Voraussetzung ist, daß sie ihren eigenen Erfahrungen trauen können und sie für die Ausarbeitung von Konzepten nutzen, anstatt im Westen erstellte und auf Erfahrung in der nördlichen Hemisphäre basierende Konzepte weiterzugeben. Der Artikel befürwortet die Notwendigkeit einer zweiten Untersuchung, um vom afrikanischen Standpunkt aus die zahlreichen Berichte neu zu analysieren, die von westlichen Reisenden und Anthropologen geschrieben wurden. Weiterhin wird für die Sicherstellung von Daten hochwertiger ökologischer Gültigkeit die Anwendung eines autobiographischen Ansatzes empfohlen. Gültigkeit wird gegenüber der Zuverlässigkeit als wichtigeres Konzept angesehen und sowohl qualitative als auch quantitative Methoden gemeinsam befürwortet.

---

Resumen Este artículo se ocupa de los problemas de la validez y fiabilidad del estudio cualitativo dentro de la educación y relaciona esta discusión con Africa. Uno de los temas principales es el planteamiento de los interrogantes de investigación correctos. El artículo pone su énfasis central en la voz de los africanos, mostrando que el/la investigador/a africano/a conoce mejor su entorno que cualquier otro extranjero o expatriado, y que es más probable que formule las preguntas correctas, siempre que esté autorizado/a a hacerlo y que no se vea obligado/a a trabajar con asuntos que conciernen a los donantes occidentales, y siempre que él o ella confíe en sus propias costumbres y experiencias para formar los conceptos, en lugar de transferir meramente conceptos formados en el mundo occidental y basados en experiencias del hemisferio norte. Aboga por la necesidad de la investigación secundaria a efectos de analizar desde un punto de vista afrocéntrico muchos de los informes escritos por viajeros y antropólogos occidentales. Además, sostiene la aplicación de un enfoque autobiográfico para asegurar datos de alto valor ecológico. El trabajo considera que la validez es un concepto más importante que la fiabilidad, y aboga por la mezcla de métodos cualitativos y cuantitativos.

---

Résumé Cet article aborde les problèmes soulevés par la validité et la fiabilité de la recherche qualitative en éducation et remplace la question dans le contexte du continent africain. Un point important concerne la juste formulation des questions qui feront l'objet de recherches. L'auteur tente de faire entendre l'opinion africaine en exposant que le personnel de recherche africain connaît mieux son environnement que toute personne expatriée et qu'il sera plus susceptible de poser les questions appropriées, à la condition qu'on lui permette de les poser et qu'il ne soit pas obligé de travailler sur des questions qui importent aux commanditaires occidentaux, à la condition aussi qu'il se fie à ses propres expériences et les mette á profit pour former des concepts, au lieu de se borner à transférer ceux établis par l'Occident, et qui se fondent sur des expériences vécues dans l'hémisphère nord. Il démontre donc la nécessité d'une recherche secondaire pour procéder à une nouvelle analyse d'un point de vue africain de nombre de récits écrits par des voyageurs ou anthropologues occidentaux. Il plaide également pour le choix d'une approache autobiographique pour protèger des données d'une importante validité écologique. La validité est posée comme concept plus important que celui de la fiabilité, et il est conseillé d'appliquer conjointement des méthodes qualitatives et quantitatives.

---

. . , , - / - , , / / , / , / , , , . , , , . , , . .

     

Student evaluation of instruction in higher education: exploring issues of validity and reliability

Many personnel committees at colleges and universities in the USA use student evaluation of faculty instruction to make decisions regarding tenure, promotion, merit pay or faculty professional development. This study examines the construct validity and internal consistency reliability of the student evaluation of instruction (SEI) used at a large mid‐western university in the USA for both administrative and instructional purposes. The sample consisted of 73,500 completed SEIs for undergraduate students who self‐reported as freshman, sophomore, junior or senior. Confirmatory factor analysis via structural equation modelling was used to explore the construct validity of the SEI instrument. The internal consistency of students' ratings was reported to provide reliability evidence. The results of this study showed that the model fits the data for the sample. The significance of this study as well as areas for further research are discussed.     

The Watch-and-Wait Task: On the reliability and validity of a new method of assessing self-control in preschool children

A preschooler's ability to delay gratification in the waiting task is predictive of several developmental outcomes, despite this task's relatively low reliability level. Success in this task depends on the use of distraction strategies. The new Watch-and-Wait Task (WWT) has been developed to enhance reliability and to investigate whether the waiting situation is equally predictive if distraction from the reward is inhibited. To prevent distraction in the WWT, children were instructed to watch an hourglass run out during the waiting period. In a reliability analysis (n = 31) the WWT showed acceptable retest reliability. In a second study (n = 61), the time preschoolers spent waiting in the WWT was associated with later academic achievement and behavioral problems diagnosed at the end of grade 1, even after controlling for intelligence, gender and age. Overall, the WWT proved to be a reliable instrument predictive of children's behavioral and academic development.     

The concept map as a research and evaluation tool: Further evidence of validity

This study sought further evidence of the concurrent validity of concept mapping as a research and evaluation tool in science education. Specifically, the study examined the extent to which differences exist in the concept maps of advanced college biology majors (N = 25) and beginning nonmajors (N = 25) in the domain of mammals. Furthermore, it explored whether these differences are reflected in the way subjects assign class membership as revealed in a card sorting task. The results indicate that concept maps of biology majors are structurally more complex than those of nonmajors and that differences in the structural complexity and organizational patterns depicted in concept maps are reflected in the underlying dimensions used to assign class membership. Together, these findings suggest that the concept map provides a theoretically powerful and psychometrically sound tool for assessing conceptual change in experimental and classroom settings.     

Judging quality in peer research: a comparison of adult- and peer-led focus groups in a Kenyan context

Peer research has been recognized as an important strategy. As with other qualitative approaches, one issue that is often raised is how do we judge the quality of such methods? This paper argues that one of the ways we can do this is by comparing the data collected through participatory methods with that collected with other research strategies within the same research context. This was done through a qualitative study which investigated student's attitudes towards ethnicity and politics in two secondary schools in Kenya. A research design was developed using focus-group discussions where half of the focus groups were led by an adult researcher and the other half by a student researcher. The paper will compare the data collected from these two kinds of focus groups using the framework method in order to illustrate that peer research produces high-quality data comparable to that collected using other means. Moreover, the paper will use reflections from the process to show that one other way that we can judge the quality of peer research is through the benefits that accrue not only to the peer researchers such as skills development but also to the adult researchers, for example greater reflexivity.     

The eye of the beholder: metaphor in adult education research

Important workforce competencies for managers and professionals were identified separately for males and females through a sequence of interviews, content analysis, accessing expert opinion and statistical factoring procedures. Interviews of thirty‐two professionals and managers and a subsequent content analysis led to the development of a list of important skills, knowledge and attitudes which formed the basis for separate male and female competencies questionnaires. Principal components analyses were performed separately for male and female questionnaires, with samples of 310 women and 249 men. Seven important competencies were identified for each gender. Competencies for women were: maintenance of job skills; orientation to innovation and change; affective and cognitive efficacy; self determination and stability; presentation skills; interpersonal communication skills; and office politics skills. Competencies for men were: leadership ability; self‐determination; interpersonal ability; task management; job skill maintenance; office politics skills; and tolerance and open‐mindedness. Results suggest that acquiring competence in the workforce involves a combination both of learning and of overcoming constraints, and that individual experience influences important competencies.     

The construct validity and predictive validity of a self-efficacy measure for student teachers in competence-based education

This study intends to investigate the validity of a self-efficacy measure which is developed for predictive and diagnostic purposes concerning student teachers in competence-based education. CFA results delivered converging evidence for the multidimensionality of the student teacher self-efficacy construct and the bi-factor model as underlying structure, reflecting a teacher competence framework. Factor loadings of the bifactor model evidenced the theoretical assumption that incipient student teachers enter the programme with a global undifferentiated sense of teacher self-efficacy, having teaching experiences a further differentiation takes place to a partly differentiated sense of teacher self-efficacy. Logistic regression analysis revealed that the measure succeeds in predicting students’ first-year outcomes and delivered evidence for the diagnostic value of the scale.     

The introduction of nurture groups in Maltese schools: a method of promoting inclusive education

Against the background of increasing stress and pressures in young people's lives and their apparent manifestation in social, emotional and behavioural problems in schools, there has been a renewed interest in nurture groups as an educational intervention. Nurture groups are designed to address the unmet social and emotional needs of young children and provide them with the necessary skills and competencies for productive engagement in schooling. This article written by Carmel Cefai and Paul Cooper, who are, respectively, the Director and Visiting Professor at the European Centre for Emotional Resilience and Socio Emotional Health at the University of Malta, discusses the recent introduction of nurture groups in the primary sector in Malta, showing how they both extend the capacity of primary schools to become more inclusive, and to develop into resource centres for emotional literacy and parental education. A challenge perceived to lie ahead is to develop an intervention model that is adapted to the needs and values of the local educational context while remaining faithful to the theoretically sound principles and practices of therapeutic education.     

Contemporary trends in adult education research in Yugoslavia

While several have written about the connection between life experience and learning, there is little in the literature that explicitly deals with how a particular life experience can become a significant learning experience for one person, but not another. This qualitative study examines the underlying structure of the significance of life‐experience learning. Open‐ended responses to a question about one's significant learning experiences were collected from 405 adults. In addition, 19 interviews were conducted to probe more deeply about individuals’ learning experiences and the significance they held for the learner. Findings suggest that for learning to be significant: (1) it must personally affect the learner, either by resulting in an expansion of skills, sense of self, or life perspective, or by precipitating a transformation; and (2) it must be subjectively valued by the learner.     

Nationalistic education as the focus for civics and citizenship education : The case of Hong Kong

Civic education has been assigned the mission of preparing critical thinking, responsible, participating, multidimensional citizens and is also used to serve the function of instilling a sense of national identity, loyalty to the nation state and patriotism In 1996, before the return of sovereignty of Hong Kong to China, the Hong Kong Education Department published theGuidelines in Civic Education for School (1996), which includes education for democracy, human rights education, global education and nationalistic education This survey adopted an amalgamate framework of five types of nationalistic education to study the understanding of nationalistic education of civic educators in secondary schools in Hong Kong The initial findings showed that the civic educators were basically strongly eclectic in terms of education for cosmopolitan, civic, and cultural nationalism and moderately eclectic in terms of anti colonial nationalism but rejected education for totalitarian nationalism This eclectic understanding can be said to be heading towards a more liberal, rational, open and inclusive type of nationalistic education, which is compatible with a cosmopolitan and pluralistic society such as Hong Kong     

The reliability and validity of an interactive arithmetic test

A sample of 331 primary school children from seven primary schools, from Years 3 through 7, participated in this study to determine the reliability of a computer resident interactive arithmetic test, using both the method of a single sitting and that of parallel forms. Reliability coefficients up to .96 were calculated for scoring rates by the single sitting methods and up to .87 by the method of parallel forms. The study also attempted to determine the validity of the interactive test by comparing it with the arithmetic subtests of the Key Math Test (KMT, Connolly et al ., 1971). Positive, but weak, correlations up to .65 were recorded, reflecting differences in the medium of administration and assessment methodology of the two tests.     

影响普通话水平测试信度与效度因素的研究

普通话水平测试是一种口语考试,是测评人对应试人的作答情况进行主观测试的考试,所以在实际的在普通话水平测试工作中,多种人为的因素都会对测试的分数产生消极影响,进而影响了普通话水平测试的信度与效度。本文主要从试题难易度、测评员的因素和应试者的临场表现三个方面分析了对普通话水平测试的信度与效度形成的影响。     

成人教育心理研究的回顾与前瞻

成人教育心理研究是成人教育研究的基本组成部分，其发展既关系到成人教育理论研究的丰富和完善，也会对成人教育实践运作产生重要影响。本文对成人教育心理研究的历史沿革，主要内容及发展趋势进行了初步探讨。     

The mathematics teacher in shadow education: a new area of focus in teacher education

Journal of Mathematics Teacher Education - This paper presents a discussion on a new focus area in mathematics teacher education, namely the mathematics teacher in shadow education (SE mathematics...     

生态翻译学的研究焦点与理论视角研究

生态翻译学主要是运用生态理性原理,结合生态学视角对翻译内容进行整合性的分析和研究。生态翻译学视角下的翻译内容更加富含条理,结合具体的环境、具体的事物以及相应的关联进行全面的分析和正确的翻译。本篇文章主要从生态范式;关联序链;生态理性;译有所为;翻译生态环境;适应、选择;三维转换七个方面,对生态翻译学的研究焦点与理论视角进行分析。