Self-regulated learning with hypermedia: The role of prior domain knowledge

Think-aloud and pre-test data were collected from 49 undergraduates with varying levels of prior domain knowledge to examine the relationship between prior domain knowledge and self-regulated learning with hypermedia. During the experimental session, each participant individually completed a pretest on the circulatory system, and then one 40-min hypermedia learning task during which he or she learned about the circulatory system. Think-aloud data were collected during the 40-min learning task to measure each participant’s use of specific self-regulated learning processes related to planning, monitoring, and strategy use. Results indicate that prior domain knowledge is significantly related to how the participants self-regulated their learning during the 40-min learning task with hypermedia. Specifically, prior domain knowledge is positively related to participants’ monitoring and planning and negatively related to their use of strategies during the hypermedia learning task.     

Honesty on student evaluations of teaching: effectiveness,purpose, and timing matter!

Student evaluations of teaching (SETs) are an important point of assessment for faculty in curriculum development, tenure and promotion decisions, and merit raises. Faculty members utilise SETs to gain feedback on their classes and, hopefully, improve them. The question of the validity of student responses on SETs is a continuing debate in higher education. The current study uses data from two universities (n = 596) to determine whether and under what conditions students are honest on in-class and online SETs, while also assessing their knowledge and attitudes about SETs. Findings reveal that, while students report a high level of honesty on SETs, they are more likely to be honest when they believe that evaluations effectively measure the quality of the course, the results improve teaching and benefit students rather than the administration, and when they are given at the end of the term. Honesty on evaluations is not associated with socio-demographic characteristics.     

Identifying pedagogy and teaching strategies for achieving nationally prescribed learning outcomes

With the globalisation of university education, national frameworks are commonly used to prescribe standardised learning outcomes and achieve accountability. However, these frameworks are generally not accompanied by guiding pedagogy to support academics in adjusting their teaching practices to achieve the set outcomes. This paper reports the results of a scoping review of health science literature aimed at identifying pedagogy and teaching strategies relevant to achieve the learning outcomes specified by the Australian Qualifications Framework at a master's degree level. Eight practical teaching messages emerged from the review and three broad pedagogical trends were identified: the need to use authentic disciplinary-based learning activities; ensure that students are able to discover different perspectives about future practice and bring student reflection about their own knowledge into curricula. More critically, the review highlights that academics attempting to translate national learning outcome frameworks into their teaching practices face a complex and time-consuming task which may involve searching beyond their own disciplinary focus to identify practical teaching strategies to meet prescribed learning outcomes.     

A systematic review and meta-analysis of implicit theory research in sport,physical activity,and physical education

The purpose of this systematic review and meta-analysis was to gather, catalogue, assess, and evaluate the available evidence examining implicit beliefs about ability in the sport, physical activity, and physical education contexts. A total of 43 studies were found, of which 39 were subjected to meta analyses. With only 7 experimental studies, the strength of evidence is moderate, and the field would benefit from greater experimental work. Overall, incremental beliefs were moderately associated with a small group of theoretically derived correlates, while entity beliefs were only weakly associated. The field would benefit from expanding these outcomes to include a wider range of pertinent outcomes. Researchers should focus their efforts on systematically exploring the most powerful ways of inducing adaptive implicit beliefs with the aim of providing solutions to significant problems such as preventing dropout from organised sports, improving academic grades in and beyond physical education, and increasing levels of physical activity.     

Implementing Quality Service-Learning Programs in Community Colleges

This cross-case comparative study at Western Community College and the University of the Coast explored through a constructive lens the characteristics that lead to sustainable, high quality service-learning programs and how they are implemented at institutions of higher education. The researchers determined that both Western Community College and the University of the Coast (a) have diverse collaborative partnerships that promote excellent communication between all of the entities, (b) offer a wide variety of service-learning courses to connect curricular and cocurricular experiences, (c) have a stable funding base, (d) provide the necessary resources, (e) have continuity in staffing, and (f) incorporate feedback and assessment into their respective service-learning programs. The findings from this study, based on one-on-one interviews, focus groups, observations, and document analysis, serve as a model on how to create quality and sustainable service-learning programs that combine academic scholarship, off-campus learning discoveries, reflection, civic engagement, and meaningful community service. The research may be applicable for educators at community colleges at various stages in developing service-learning programs, or who are transforming faltering programs, trying to make them sustainable.     

Early prediction of student knowledge in game-based learning with distributed representations of assessment questions

Game-based learning environments hold significant promise for facilitating learning experiences that are both effective and engaging. To support individualised learning and support proactive scaffolding when students are struggling, game-based learning environments should be able to accurately predict student knowledge at early points in students' gameplay. Student knowledge is traditionally assessed prior to and after each student interacts with the learning environment with conventional methods, such as multiple choice content knowledge assessments. While previous student modelling approaches have leveraged machine learning to automatically infer students' knowledge, there is limited work that incorporates the fine-grained content from each question in these types of tests into student models that predict student performance at early junctures in gameplay episodes. This work investigates a predictive student modelling approach that leverages the natural language text of the post-gameplay content knowledge questions and the text of the possible answer choices for early prediction of fine-grained individual student performance in game-based learning environments. With data from a study involving 66 undergraduate students from a large public university interacting with a game-based learning environment for microbiology, Crystal Island , we investigate the accuracy and early prediction capacity of student models that use a combination of gameplay features extracted from student log files as well as distributed representations of post-test content assessment questions. The results demonstrate that by incorporating knowledge about assessment questions, early prediction models are able to outperform competing baselines that only use student game trace data with no question-related information. Furthermore, this approach achieves high generalisation, including predicting the performance of students on unseen questions.

Practitioner notes

What is already known about this topic

• A distinctive characteristic of game-based learning environments is their capacity to enable fine-grained student assessment.
• Adaptive game-based learning environments offer individualisation based on specific student needs and should be able to assess student competencies using early prediction models of those competencies.
• Word embedding approaches from the field of natural language processing show great promise in the ability to encode semantic information that can be leveraged by predictive student models.

What this paper adds

• Investigates word embeddings of assessment question content for reliable early prediction of student performance.
• Demonstrates the efficacy of distributed word embeddings of assessment questions when used by early prediction models compared to models that use either no assessment information or discrete representations of the questions.
• Demonstrates the efficacy and generalisability of word embeddings of assessment questions for predicting the performance of both new students on existing questions and existing students on new questions.

Implications for practice and/or policy

• Word embeddings of assessment questions can enhance early prediction models of student knowledge, which can drive adaptive feedback to students who interact with game-based learning environments.
• Practitioners should determine if new assessment questions will be developed for their game-based learning environment, and if so, consider using our student modelling framework that incorporates early prediction models pretrained with existing student responses to previous assessment questions and is generalisable to the new assessment questions by leveraging distributed word embedding techniques.
• Researchers should consider the most appropriate way to encode the assessment questions in ways that early prediction models are able to infer relationships between the questions and gameplay behaviour to make accurate predictions of student competencies.

     

BioOne and SPIE: A reflection on the first 3 years of the nonprofit platform partnership

• There is great potential for organizations to form collaborative partnerships, particularly in the nonprofit environment, which can reduce costs and aid in strategic development.
• Regular and transparent communication with internal and external stakeholders is critical to the health of any partnership, especially when doing something new or novel.
• Reciprocal service-level agreements with clear expectations and ongoing evaluation ensure the collaboration keeps pace with commercial alternatives.
• The SPIE-BioOne partnership was built to scale and incorporate future collaborators to further reduce costs and bring new ideas to the user group.