Methodological challenges in researching threshold concepts: a comparative analysis of three projects

Threshold concepts were introduced nearly 10 years ago by Ray Land and Jan Meyer. This work has spawned four international conferences and hundreds of papers. Although the idea has clearly gained traction in higher education, this sub-field does not yet have a fully fledged research methodology or a strong critical discourse about methodology. This paper seeks to begin such a dialogue by analysing three projects carried out by the authors, each focused broadly on identifying and understanding threshold concepts in engineering. Each of the projects used interviews with students and academics, but differed in six main ways that seem to make a difference to the research outcomes. This paper considers the gaps in the research and why they matter, briefly outlines the methods used in each of the three case study projects, and then discusses differences in project goals, researchers’ backgrounds, curricular context, participants’ experiences, negotiated or independent knowledge and degree of comprehensiveness sought in the studies. The implications of these six differences are explored. The authors argue that research in this sub-field of higher education pedagogical research needs to be clearer and more explicit about the methods that are used They conclude that the field would benefit from bringing together researchers who have been developing complementary research methods to compare and contrast these approaches and to develop more rigorous protocols for research on threshold concepts.     

Conceptual change: a discussion of theoretical, methodological and practical challenges for science education

Conceptual change views of teaching and learning processes in science, and also in various other content domains, have played a significant role in research on teaching and learning as well as in instructional design since the late 1970s. An important issue is whether conceptual change can provide a powerful framework for improving instructional practice in such a way that students’ levels of scientific literacy are significantly increased. In this article, the first section provides an overview on the development of conceptual change perspectives. In sections two to six, we examine the different ways that researchers have facilitated the collection of data and empirically evaluated learning as conceptual change based on these different theoretical perspectives. In section seven, we identify key issues of conceptual change with a deliberate emphasis on their contribution to improve instructional practice and conclude the article by posing challenges at theoretical, methodological and practical levels. We contend that conceptual change perspectives still have the potential to significantly improve instructional practice. However, it becomes also evident that actual practice is far from what conceptual change perspectives propose and that change of this practice will be a rather difficult and long-lasting process.

The complexities and challenges of regional education hubs: focus on Malaysia

The race to establish regional education hubs is a recent development in cross-border higher education. This article briefly examines the rationales and strategies used by three countries in the Middle East and three in South East Asia which are working towards positioning themselves as regional education hubs. The different approaches and purposes among the six countries highlight the need for a typology of education hubs. Three types are proposed: the student hub, the training and skilled workforce hub, and the knowledge/innovation hub. The final section of the paper takes a closer look at Malaysia??s cross-border education initiatives and its actions to establish itself as a competitive education hub in a region where Singapore and Hong Kong have similar intentions. Whether Malaysia has the ability to make a quantum leap from being a student hub to becoming a knowledge/innovation hub remains to be seen and appears to be an optimistic outlook.     

Gender studies: some methodological and theoretical issues

In the first part of this paper, studies are reviewed which suggest that gender differences in science achievement can be explained entirely in terms of social factors, and which also suggest that these differences could be eliminated, or even reversed, by changing the social environment. For the studies examined, it is suggested that research workers may not have taken sufficient account of confounding variables in their work, and that the apparent changes in gender differential reported may be explained in terms of these confounding variables.

In the second part of the paper, studies are reviewed which seek explanation of gender differences in science achievement in terms of unequal treatment of boys and girls by science teachers in the classroom. It is concluded that the quality of the research work which has been undertaken is disappointing, and that the research evidence provided by these studies for the differential treatment of boys and girls by science teachers is far from convincing.

It is concluded that real gender differences in science achievement do exist, and that they cannot be explained fully in terms of the social environment. It is suggested that both biological and sociological theoretical perspectives on gender differences in science achievement are inadequate, and that further progress in understanding gender differences in science achievement will require a new theoretical synthesis. It is suggested that sociobiology may provide the required new theoretical synthesis by allowing for the recognition of both biological and environmental influences on science achievement.     

Researching shadow education: methodological challenges and directions

Research on shadow education has considerably increased in volume and has helped to improve understanding of the scale, nature, and implications of the phenomenon. However, the field is still in its infancy. Literature on shadow education reflects confusion over terms and parameters, and data suffer from challenges in securing evidence from actors who may be unwilling or unable to respond to enquiries in a clear manner. Particular care is needed in cross-national and cross-cultural comparisons. Nevertheless, the trajectory of improvement in both conceptualisation and instrumentation gives ground for confidence that shadow education will be progressively better documented and better understood.     

Speaking back to the deficit discourses: a theoretical and methodological approach

The educational attainment of Aboriginal and Torres Strait Islander students is often presented within a deficit view. The need for Aboriginal and Torres Strait Islander researchers to challenge the societal norms is necessary to contribute to the struggle for self-determination. This paper presents a theoretical and methodological approach that has enabled one researcher to speak back to the deficit discourses. Exemplification of how Indigenous Critical Discourse Analysis (in: Hogarth, Addressing the rights of Indigenous peoples’ in education: A critical analysis of Indigenous education policy, Queensland University of Technology, Brisbane, 2016) identifies the power of language to maintain the inequitable positioning of Aboriginal and Torres Strait Islander peoples within Australian society is provided. Particular focus is placed on the Aboriginal and Torres Strait Islander Education Action Plan 2010–2014 (in: MCEECDYA, Aboriginal and Torres Strait Islander Education Action Plan (2010–2014), 2011) and how policy discourses ignore the historical, political, cultural and social factors that influence the engagement and participation of Indigenous peoples in education today. The paper argues for the need to personalise methodological approaches to present the standpoint of the researcher and, in turn, deepens their advocacy for addressing the phenomenon. In turn, the paper presents the need to build on existing Indigenous research frameworks to continue advocating for the position of Indigenous research methodologies within the Western institution.     

Studying activities that take place in speech interactions: a theoretical and methodological framework

The paper proposes a theoretical and methodological framework based on a pluralistic, concerted approach to the study of activities that take place in and through speech interactions. The framework has a general scope, applying to any collective activity taking form through language interactions. It contributes to a fuller understanding of the dynamics of activity and the emergence of the phenomena observed. The framework fits a constructivist and interactionist paradigm. It allows an approach to different dimensions of the activity: communicational, functional, discursive and interlocutory. The theories, models, concepts and methods chosen to address each of the dimensions are presented. From the study of a collaborative philosophical inquiry produced in the first year of a French primary school, we illustrate the use of the framework and show how it can be enriched according to the nature of the activity studied and researchers’ aims.     

Complexity and action research: exploring the theoretical and methodological connections

Complexity theory is essentially a formal attempt to question how coherent and purposive wholes emerge from the interactions of simple and sometimes non-purposive components. Explicit recognition of complexity can provide a fresh and enlightening perspective on action research. Through an expository discussion of the foundational postulates of complexity theory this article demonstrates the theoretical and methodological connections between complexity and action research, with particular emphasis on the relevance of complexity in educational and workplace contexts. Complexity is an emerging theoretical perspective, which presents possibilities for revolutionizing approaches to action research, as well as strengthening arguments promoting the value of action research in a wide range of contexts. Complexity, it is argued, can provide a valuable theoretical underpinning for action research. Furthermore, action research provides a valid methodological approach to the study of complexity. This article is primarily theoretical and attempts to demonstrate the application of complexity to a specific action research project will be left to future publication(s). Rather, this article explores the general applicability of complexity as both theory and metaphor in action research. The article begins with a brief exploration of the theory, particularly focusing on its application in the social sciences. The theoretical and methodological connections between complexity and action research are discussed through several of the foundational postulates of complexity, how these manifest in action research and how they add to our understanding of action research itself.     

Learning in the liminal space: a semiotic approach to threshold concepts

The threshold concepts approach to student learning and curriculum design now informs an empirical research base comprising over 170 disciplinary and professional contexts. It draws extensively on the notion of troublesomeness in a ‘liminal’ space of learning. The latter is a transformative state in the process of learning in which there is a reformulation of the learner’s meaning frame and an accompanying shift in the learner’s ontology or subjectivity. Within the extensive literature on threshold concepts, however, the notion of liminal space has remained relatively ill-defined. This paper explores this spatial metaphor to help clarify the difficulties that some teachers observe in the classroom in regard to their students’ understanding. It employs a novel and distinctive approach drawn from semiotic theory to to provide some explanatory insight into learning within the liminal space and render it more open to analysis. The paper develops its argument through four distinct phases. Firstly it explores the spatial metaphor of liminality to gain further purchase on the nature of this transformative space. The second section introduces semiotic theory and indicates how this will be used through a series of graphical and visual devices to render the liminal space more open to analysis. The third section then employs semiotic analysis to nine dimensions of pedagogical content knowledge to gain further insight into what may characterise student conceptual difficulty within the liminal state. The fourth and concluding section emphasises the role of context in conceptual discrimination before advocating a transactional curriculum inquiry approach to future research in this field.     

Emotion regulation as a scientific construct: methodological challenges and directions for child development research

Emotion regulation has emerged as a popular topic, but there is doubt about its viability as a scientific construct. This article identifies conceptual and methodological challenges in this area of study and describes exemplar studies that provide a substantive basis for inferring emotion regulation. On the basis of those studies, 4 methods are described that provide compelling evidence for emotion regulation: independent measurement of activated emotion and purported regulatory processes; analysis of temporal relations; measurement across contrasting conditions; and multiple, convergent measures. By offering this perspective, this article aims to engage thoughtful debate and critical analysis, with the goal of increasing methodological rigor and advancing an understanding of emotion regulation as a scientific construct.     

Measuring instructional congruence in elementary science classrooms: Pedagogical and methodological components of a theoretical framework

This article is situated within a theoretical framework, instructional congruence, articulating issues of student diversity with the demands of academic disciplines. In the context of a large‐scale study targeting elementary school science, the article describes a research instrument that aims to combine the strengths of both quantitative and qualitative approaches to classroom data. The project‐developed classroom observation guideline is a series of detailed scales that produce numerical ratings based on qualitative observations of different aspects of classroom practice. The article's objectives are both pedagogical and methodological, reflecting the dual functionality of the instrument: (a) to concretize theoretical constructs articulating academic disciplines with student diversity in ways that are useful for rethinking classroom practice; and (b) to take advantage of the strengths of qualitative educational research, but within a quantitative analytical framework that may be applied across large numbers of classrooms. © 2006 Wiley Periodicals, Inc. J Res Sci Teach 44: 424–447, 2007     

Researching policy borrowing: Some methodological challenges in comparative education

This article considers some of the methodological challenges involved in investigating, within the traditions of comparative research in education, the complex issue of educational ‘policy borrowing’. It discusses notions of ‘borrowing’ and ‘influence’ and refers to a model previously proposed by the authors for the analysis of what are seen as four stages in the policy borrowing process which can be tested empirically. These are identified as cross‐national attraction, decision, implementation, and internalization/indigenization. The problems involved in researching each stage of this process are considered, in particular in relation to the authors’ previous work on the attractiveness to British observers of educational policy in Germany over a long historical period.     

Lonergan's insight and threshold concepts: students in the liminal space

Threshold concepts are a widely used idea, particularly in curriculum design and evaluation of student learning. However they can be criticised as being hard to identify, vague and teacher imposed. Using the cognitive theory of Bernard Lonergan we argue that his epistemology enables us to reframe threshold concepts by adding a learner focussed understanding. We extend this to include considerations of liminality and ‘stuckness’, as well as the multiple paths to the threshold learners may take. Adding an understanding of cognitive process to the idea of threshold concepts also enables us to understand how they can be identified in disparate subjects.