Applying LDA Topic Modeling in Communication Research: Toward a Valid and Reliable Methodology

ABSTRACT

Latent Dirichlet allocation (LDA) topic models are increasingly being used in communication research. Yet, questions regarding reliability and validity of the approach have received little attention thus far. In applying LDA to textual data, researchers need to tackle at least four major challenges that affect these criteria: (a) appropriate pre-processing of the text collection; (b) adequate selection of model parameters, including the number of topics to be generated; (c) evaluation of the model’s reliability; and (d) the process of validly interpreting the resulting topics. We review the research literature dealing with these questions and propose a methodology that approaches these challenges. Our overall goal is to make LDA topic modeling more accessible to communication researchers and to ensure compliance with disciplinary standards. Consequently, we develop a brief hands-on user guide for applying LDA topic modeling. We demonstrate the value of our approach with empirical data from an ongoing research project.     

Juggling competing activities: academic staff as doctoral candidates

ABSTRACT

This article explores the experiences of a group of established academic staff in New Zealand and the UK, as they undertake a doctorate in their home institutions. Our interest is in how individuals negotiate this dual status from a cultural-historical activity theory (CHAT) stance that explores how rules, tools, community and divisions of labour, and interacting activity systems, shape doctoral experiences. The focus in this article, having analysed their detailed narrative accounts, is on how academics experience three interdependent activity systems: those surrounding the thesis, the institutional context, and the home-life spheres. Issues related to time, workload and supervision issues, variability in collegial support and impact on personal priorities and time emerged. There is a range of particularities – from easy access to resources/supervisors to inflexible institutional regulations – applicable to this group of doctoral candidates. Negotiating life as an academic with concurrent doctoral candidature provides positive outcomes in terms of teaching, research confidence and general personal and professional development. However, a range of difficulties can also be encountered, particularly in relation to personal and professional relationships, and workload management.     

Finding the common ground: Teachers' and employers' representations of English in an assessment context

There has been a long‐standing debate about how ‘English’ can be defined. Educational policy changes have typically been driven by differing representations of the subject, and have ranged from broad ‘aesthetic’ definitions to more narrow ‘functional’ views. The present study aims to analyse areas of consensus and contention in stakeholders' discourse regarding English. A questionnaire‐based survey and focus groups were used to explore how teachers and employers viewed English as a subject. Their views were conceptualised into three themes: the importance of functional English; English as atomistic versus holistic study; and English as critical thought. These themes are discussed in relation to historical definitions of ‘English’, and their implications for the future reform of English qualifications.     

A Campus-Wide Investigation of Clicker Implementation: The Status of Peer Discussion in STEM Classes

At the University of Maine, middle and high school teachers observed more than 250 university science, technology, engineering, and mathematics classes and collected information on the nature of instruction, including how clickers were being used. Comparisons of classes taught with (n = 80) and without (n = 184) clickers show that, while instructional behaviors differ, the use of clickers alone does not significantly impact the time instructors spend lecturing. One possible explanation stems from the observation of three distinct modes of clicker use: peer discussion, in which students had the opportunity to talk with one another during clicker questions; individual thinking, in which no peer discussion was observed; and alternative collaboration, in which students had time for discussion, but it was not paired with clicker questions. Investigation of these modes revealed differences in the range of behaviors, the amount of time instructors lecture, and how challenging the clicker questions were to answer. Because instructors can vary their instructional style from one clicker question to the next, we also explored differences in how individual instructors incorporated peer discussion during clicker questions. These findings provide new insights into the range of clicker implementation at a campus-wide level and how such findings can be used to inform targeted professional development for faculty.