Applying LDA Topic Modeling in Communication Research: Toward a Valid and Reliable Methodology

ABSTRACT

Latent Dirichlet allocation (LDA) topic models are increasingly being used in communication research. Yet, questions regarding reliability and validity of the approach have received little attention thus far. In applying LDA to textual data, researchers need to tackle at least four major challenges that affect these criteria: (a) appropriate pre-processing of the text collection; (b) adequate selection of model parameters, including the number of topics to be generated; (c) evaluation of the model’s reliability; and (d) the process of validly interpreting the resulting topics. We review the research literature dealing with these questions and propose a methodology that approaches these challenges. Our overall goal is to make LDA topic modeling more accessible to communication researchers and to ensure compliance with disciplinary standards. Consequently, we develop a brief hands-on user guide for applying LDA topic modeling. We demonstrate the value of our approach with empirical data from an ongoing research project.     

Effects of a rubric for mathematical reasoning on teaching and learning in primary school

Rubrics are assessment tools that help students gain complex competencies. Our quasi-experimental study aimed to evaluate whether rubrics help teachers teach and assess mathematical reasoning in primary school and whether such an instrument might support student learning. In two Swiss cantons, 762 students in 44 5th- and 6th-grade primary classes worked on their reasoning competencies, and half of them additionally employed our standards-based rubric. All of the teachers received a 1-day training and participated in the final project evaluation. To standardise and support the teachers during the implementation phase, they received a detailed curriculum. An achievement test and questionnaires for students and teachers were administered before and at the end of the intervention. The results of our quantitative longitudinal analyses indicate that the rubric fosters the teachers’ perceived diagnostic skills but only indirectly impacts their use of formative feedback. Based on the students’ perceptions, however, we observed a direct effect of the rubric on formative feedback and student self-assessment. Effects on students’ outcomes could not be observed, but there are indications of effects mediated by self-regulation and self-efficacy.     

Search tactics used in solving everyday how-to technical tasks: Repertoire,selection and tenacity

With greater access to computational resources, people use search to address many everyday challenges in their lives, including solving technology problems. Although there are now many useful ‘how-to’ resources online (especially videos on YouTube), it can still be difficult to identify, understand, and resolve certain kinds of technical problem. While research tasks have been studied for many years and we know the tactics people use, we know far less about searchers’ tactics for how-to technical tasks that involve actually being able to apply found information to resolve a problem. Crucial to our study was developing and studying a highly realistic, how-to technical task, for which there was no single guidance resource: making a phone safe for a child. After providing 39 participants with an actual phone to fix, and a search engine to perform the task, we analysed their search tactics using retrospective cued think aloud interviews. Our primary contribution is a set of 77 tactics used, in three categories, along with detail of how common they were. We conclude that people had a lot of tactics in their repertoire. Although it was not hard for participants to find relevant information, what was hard was for participants to find information they could use; indeed only 23% of participants successfully completed the entire task. Domain knowledge affected the choice of tactics used (although not necessarily towards better task success). We discuss these influences and make design recommendations for how future search systems can support those in resolving how-to technical tasks.     

Erstsprachförderung bei Migrantenkindern in Kindergärten

This contribution reports on an investigation into the importance of supporting first language for the command of first and second language skills using a quasi-experimental longitudinal study of migrant children in kindergarten. For two years the development of both first and second language skills was coordinated through the treatment of the same topics and stories during lessons. Furthermore, parents were asked to read their children a story or play an audio book in the first language three times a week. This extensive intervention neither had statistically significant effects on the development of language competency in the first nor the second language, German. The transfer effects between first and second language expected by the interdependency hypothesis of Cummins were only in evidence to a very limited extent.     

加拿大英语的保守性特点及其成因

加拿大英语除了具有鲜明的创新性特点以外,其保守性特点也很突出。18世纪末英国殖民者将当时的英语带到北美。随着时代的变迁,英语在祖国发生了变化,但大洋彼岸因种种因素没有发生同样的变化。因此在今天的加拿大英语中却仍可寻到昔日英国英语的痕迹。这在语音、词汇和语法方面均有体现。加拿大英语保守性特点的成因主要有语言接触因素、社会因素和移民源的心理因素。通过对加拿大英语保守性特点及其成因的分析,有助于英语的学习与传播。     

Modelling home advantage in the Summer Olympic Games

Home advantage in team games is well proven and the influence of the crowd upon officials' decisions has been identified as a plausible cause. The aim of this study was to assess the significance of home advantage for five event groups selected from the Summer Olympic Games between 1896 and 1996, and put home advantage in team games in context with other sports. The five event groups were athletics and weightlifting (predominantly objectively judged), boxing and gymnastics (predominantly subjectively judged) and team games (involving subjective decisions). The proportion of points won was analysed as a binomial response variable using generalized linear interactive modelling. Preliminary exploration of the data highlighted the need to control for the proportion of competitors entered and to split the analysis pre- and post-war. Highly significant home advantage was found in event groups that were either subjectively judged or rely on subjective decisions. In contrast, little or no home advantage (and even away advantage) was observed for the two objectively judged groups. Officiating system was vital to both the existence and extent of home advantage. Our findings suggest that crowd noise has a greater influence upon officials' decisions than players' performances, as events with greater officiating input enjoyed significantly greater home advantage.     

An Examination of the Relationship Among Academic Stress,Coping, Motivation,and Performance in College

Empirical evidence suggests that a domain-specific coping style may play an important role in the way students manage stressful academic events and perform at college. The purpose of this research was to examine the extent to which college students' academic coping style and motivation mediate their academic stress and performance. A structural equation analysis showed that the relationship between college students' academic stress and course grade was influenced by problem-focused coping and motivation but not emotion-focused coping. As expected, greater academic stress covaried with lower course grades; however, students who engaged in problem-focused coping were more likely to be motivated and perform better than students who engaged in emotion-focused coping. Strategies for promoting more effective coping in college students are discussed.     

Decreasing students’ stress through time management training: an intervention study

The aim of this study was to examine the effects of a time management training program on perceived control of time and perceived stress in the context of higher education. Twenty-three undergraduate students attended a time management training intervention and reported demands, perceived stress and perceived control of time directly before 2 and 4 weeks after training. We used a “non-equivalent dependent variable design” (Cook and Campbell, Quasi-experimentation: design and analysis for field settings, p. 118, 1979) with perceived stress and perceived control of time as dependent variables, which should be influenced by the training, and demands as control variable, which should not be changed. As expected, perceived stress decreased and perceived control of time increased after training, whereas demands did not change. Therefore, time management training might be beneficial for undergraduate students’ well-being. Nevertheless, more intervention studies in this field are necessary, especially with lager samples, to contribute to more robust results and conclusions.