‘Computer games can get your brain working’: student experience and perceptions of digital games in the classroom

There is considerable enthusiasm in many quarters for the incorporation of digital games into the classroom, and the capacity of games to engage and challenge players, present complex representations and experiences, foster collaborative learning, and promote deep learning. But while there is increasing research documenting the progress and outcomes of game-based learning, relatively little attention is paid to student perceptions and voice. In order to effectively target game-based learning pedagogy, it is important to understand students' previous experience, if any, of the use of games in the classroom, and what they made of these. In this paper, we present findings from a survey of 270 primary and secondary school students in Year Levels 4–9 (aged 9–14) in 6 Queensland schools at the start of a 3-year Australian Research Council project researching the use of digital games in school to promote literacy and learning.     

Professional development for scaling pedagogical innovation in the context of game-based learning: teacher identity as cornerstone in “shifting” practice

A dominant discourse on “scaling-up” small-scale innovations based on a limited number of successful classroom trials pervades the educational literature. We view this discourse as insensitive to the professional work of teachers and the human side of school change. Our research investigated how teacher professional development could be conceived and conducted to support take up of digital game-based learning in the context of a 3-week social studies unit on governance and citizenship. Students played a mobile game in their own time. In the classroom, teachers enacted dialogic pedagogy to facilitate students’ meaning-making of their gameplay experience. Our findings indicate that teacher identity, constituted by their interwoven knowing–doing–being–valuing is central to any effort to scale pedagogical and technological innovation. We modified our original model for the appropriation of innovation uptake by teachers to one that places teacher identity as the centrepiece of the model and cornerstone in “shifting” teacher practice.     

Student Perception and the Effectiveness of Kahoot!: A Scoping Review in Histology,Anatomy, and Medical Education

The impact of the Covid-19 pandemic has presented challenges in medical education particularly, with development of online learning in a short time period. Notably there has been a significant increase in the use of digital technology applications to meet this challenge. For instance, in the first quarter of 2020 the game-based software Kahoot! reported a threefold increase in players and a fivefold increase in asynchronous learning globally. However, there is limited research into the use of game-based digital technology applications such as Kahoot! and the associated learning theories, particularly in histology, anatomy, and medical education. This scoping review explored the utilization, outcome scores, and student perceptions of learning with the application of Kahoot! in histology, anatomy, and medical education. Online databases were used to identify articles published between 2013 and 2021 from which 12 articles were included in the review. The majority of articles supported positive student outcomes including improved collaborative learning, improved knowledge of content, attendance, and participation. Minor negative aspects included increased time on task, overwhelming learning content, and distractions due to gadgets. None of the articles included a control group. The main educational theories identified were active learning followed by social and constructivism learning theory. In light of the Covid-19 pandemic a rapid and fundamental shift in how digital applications are being used in educational institutions has evolved. Further research on learning frameworks and studies with control groups is required to evaluate Kahoot! as a potentially valuable online application in histology, anatomy, and medical education.     

Teachers as game designers: using a game in formal learning in a Singapore primary school

Researchers have offered, in recent years, compelling reasons for considering the potential of digital games to support learning and in response policy-makers and educators around the world have demonstrated a commitment to exploring their practical use in school. There remain, however, many questions about how games can best support learning, particularly in formal education. This paper examines the implications of formal game-based learning for teachers developing their own digital learning games, exploring two guiding overarching research questions. What strategies are employed by teachers to manage intergenerational, technological, operational and pedagogic tensions in the classroom? And to what extent is the notion of being a “designer” visible in their professional practice? The paper suggests that there are multiple ways of “being a designer” for teachers, and that the notion of “designer” may be a more problematic representation of teacher agency and identity than currently visible in the literature.     

Learning analytics application to examine validity and generalizability of game-based assessment for spatial reasoning

Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.

Practitioner notes

What is already known about this topic:

• Digital games can be a powerful context to support and assess student learning.
• Games as assessments need to meet certain psychometric qualities such as validity and generalizability.
• Learning analytics provide useful ways to establish assessment models for educational games, as well as to investigate their psychometric qualities.

What this paper adds:

• How a digital game can be coupled with learning analytics practices to assess spatial reasoning skills.
• How to evaluate psychometric qualities of game-based assessment using learning analytics techniques.
• Investigation of validity and generalizability of game-based assessment for spatial reasoning skills and the interplay of the game-based assessment with enjoyment.

Implications for practice and/or policy:

• Game-based assessments that incorporate learning analytics can be used as an alternative to pencil-and-paper tests to measure cognitive skills such as spatial reasoning.
• More training and assessment of spatial reasoning embedded in games can motivate students who might not be on the STEM tracks, thus broadening participation in STEM.
• Game-based learning and assessment researchers should consider possible factors that affect how certain populations of students enjoy educational games, so it does not further marginalize specific student populations.

     

Authentic game-based learning and teachers’ dilemmas in reconstructing professional practice

Teachers who attempt pedagogical innovation with authentic digital games face significant challenges because such games instantiate open systems of learner activity, inviting enquiry learning rather than knowledge acquisition. However, school environments are normatively sanctioned cultural spaces where direct instruction and high-stakes tests are de riguer. In this paper, we draw on the conceptual frame of dilemmatic spaces to illuminate the dilemmas teachers encounter when attempting to reconstruct professional practice in the classroom. We worked with nine teachers who enacted the Statecraft X social studies curriculum. Drawing on coded interview data, our findings suggest that teachers are forced to wrestle with tensions engendered by misalignments that emerge from the innovation's tacit requirement for change and the system's inherent gravitation towards maintaining the status quo. A school culture that cultivates innovative practice based on greater teacher agency is needed for authentic game-based learning to find traction in the classroom.     

Rethinking Assessment Design: Evidence-Informed Strategies to Boost Educational Impact in the Anatomical Sciences

University assessment is in the midst of transformation. Assessments are no longer designed solely to determine that students can remember and regurgitate lecture content, nor in order to rank students to aid with some future selection process. Instead, assessments are expected to drive, support, and enhance learning and to contribute to student self-assessment and development of skills and attributes for a lifetime of learning. While traditional purposes of certifying achievement and determining readiness to progress remain important, these new expectations for assessment can create tensions in assessment design, selection, and deployment. With the recognition of these tensions, three contemporary approaches to assessment in medical education are described. These approaches include careful consideration of the educational impact of assessment—before, during (test or recall enhanced learning) and after assessments; development of student (and staff) assessment literacy; and planning of cohesive systems of assessment (with a range of assessment tools) designed to assess the various competencies demanded of future graduates. These approaches purposefully straddle the cross purposes of assessment in modern health professions education. The implications of these models are explored within the context of medical education and then linked with contemporary work in the anatomical sciences in order to highlight current synergies and potential future innovations when using evidence-informed strategies to boost the educational impact of assessments.     

A review of five African board games: is there any educational potential?

Studies of African indigenous games often focus on a specific game or on games from different regions. This article, rather, examines five popular African board games in order to find the similarities and differences among these games. The analysis shows similarities among them. However, these similarities do not necessarily mean that these games are identical. The review of the games indicates that these games are different when elements such as rules and play are used to study them. This article also demonstrates that these board games are tools that can be integrated into the curriculum through a discussion of the educational affordance of each game. The article is an invitation to educators and game researchers to broaden the definition and exploration of game-based learning.     

Computational support for teachers’ design thinking: its feasibility and acceptability to practitioners and institutions

A significant area of learning design research has been the development of software applications that guide teachers’ thinking as they plan, construct and revise learning events for their students. In this paper, we review conceptualisations of, and approaches to, the activity of pedagogic design and highlight the implications for the provision of computational support for this activity. We then outline different ways in which that support has been implemented in three digital tools: Phoebe, the LAMS Activity Planner and the Learning Designer. We consider the challenges to, and implications of, deploying these tools from the perspectives of three groups of stakeholders: developers, teachers and institutions. Our findings suggest that, while such tools are acceptable in principle, they face a number of technological and socio-cultural challenges to their acceptability from teachers’ perspectives and to their deployment within institutional strategies for teaching and learning in a digital age.     

Designing Science Learning with Game-Based Approaches

Given the growing popularity of digital games as a form of entertainment, educators are interested in exploring using digital games as a tool to facilitate learning. In this study, we examine game-based learning by describing a learning environment that combines game elements, play, and authenticity in the real world for the purpose of engaging students’ learning of science and enhancing student motivation. We discuss the design of the environment and present research conducted. Our findings demonstrate that the design of an engaging, interactive environment using a game-based approach can help students have fun while learning.     

Workplace educators’ interpretations of their assessment practices: a view through a critical practice lens

In this paper, we examine workplace educators’ interpretations of their assessment practices. We draw on a critical practice lens to conceptualise assessment practice as a social, relational and situated practice that becomes critical through critique and emancipation. We conducted semi-structured interviews followed by roundtable discussions with physiotherapy clinical educators in the workplace. Employing a critical hermeneutic approach, data was scrutinised to understand relational and critical dimensions of assessment practices. Findings revealed that participants were socialised into assessment practices. They were aware of the challenges, and they grappled with the tension between their practice-based judgments and documentation of competence. Despite this tension, there was a reluctance to move their awareness of practice tensions towards emancipatory action which could relieve these tensions. We conclude that it is important to acknowledge the judgements which inform assessment practice and the tensions assessors feel between objective and subjective assessments. Assessors who deliberately engage with these tensions can emancipate their assessment practices towards a critical, wise and self-defining practice that nurtures lifelong learning in students and assessors alike.     

Early prediction of student knowledge in game-based learning with distributed representations of assessment questions

Game-based learning environments hold significant promise for facilitating learning experiences that are both effective and engaging. To support individualised learning and support proactive scaffolding when students are struggling, game-based learning environments should be able to accurately predict student knowledge at early points in students' gameplay. Student knowledge is traditionally assessed prior to and after each student interacts with the learning environment with conventional methods, such as multiple choice content knowledge assessments. While previous student modelling approaches have leveraged machine learning to automatically infer students' knowledge, there is limited work that incorporates the fine-grained content from each question in these types of tests into student models that predict student performance at early junctures in gameplay episodes. This work investigates a predictive student modelling approach that leverages the natural language text of the post-gameplay content knowledge questions and the text of the possible answer choices for early prediction of fine-grained individual student performance in game-based learning environments. With data from a study involving 66 undergraduate students from a large public university interacting with a game-based learning environment for microbiology, Crystal Island , we investigate the accuracy and early prediction capacity of student models that use a combination of gameplay features extracted from student log files as well as distributed representations of post-test content assessment questions. The results demonstrate that by incorporating knowledge about assessment questions, early prediction models are able to outperform competing baselines that only use student game trace data with no question-related information. Furthermore, this approach achieves high generalisation, including predicting the performance of students on unseen questions.

Practitioner notes

What is already known about this topic

• A distinctive characteristic of game-based learning environments is their capacity to enable fine-grained student assessment.
• Adaptive game-based learning environments offer individualisation based on specific student needs and should be able to assess student competencies using early prediction models of those competencies.
• Word embedding approaches from the field of natural language processing show great promise in the ability to encode semantic information that can be leveraged by predictive student models.

What this paper adds

• Investigates word embeddings of assessment question content for reliable early prediction of student performance.
• Demonstrates the efficacy of distributed word embeddings of assessment questions when used by early prediction models compared to models that use either no assessment information or discrete representations of the questions.
• Demonstrates the efficacy and generalisability of word embeddings of assessment questions for predicting the performance of both new students on existing questions and existing students on new questions.

Implications for practice and/or policy

• Word embeddings of assessment questions can enhance early prediction models of student knowledge, which can drive adaptive feedback to students who interact with game-based learning environments.
• Practitioners should determine if new assessment questions will be developed for their game-based learning environment, and if so, consider using our student modelling framework that incorporates early prediction models pretrained with existing student responses to previous assessment questions and is generalisable to the new assessment questions by leveraging distributed word embedding techniques.
• Researchers should consider the most appropriate way to encode the assessment questions in ways that early prediction models are able to infer relationships between the questions and gameplay behaviour to make accurate predictions of student competencies.

     

A digital game-based assessment of middle-school and college students’ choices to seek critical feedback and to revise

A major goal of contemporary education is to teach students how to learn on their own. Assessments have largely lagged behind this goal, because they measure what students have learned and not necessarily their learning processes. This research presents Posterlet, an assessment that collects evidence regarding the strategies that students choose while learning on their own. Posterlet is an educational game-based assessment that measures two design thinking choices: students’ choices to seek critical (ie, negative) feedback and to revise their work while they learn graphic design principles through creating posters. This research also presents an examination of students’ choices to seek feedback and to revise, as well as of students’ learning outcomes based on these choices. This game-based assessment approach is empirically validated with three research studies sampling nearly 300 middle-school and college students who played Posterlet and completed a posttest. Results show that the game helps students learn, as students who play the game before completing the posttest learn more graphic design principles than students who only complete the posttest. Moreover, the choices to seek critical feedback and to revise can predict learning and can be used as valid outcome measures for learning. Findings can be used in developing and evaluating models of instruction and assessment that may help students make informed learning choices. A discussion of present and future trends in theory regarding digital feedback environments is also included.     

Citizen science in digital worlds: the seduction of a temporary escape or a lifelong pursuit?

There is a vast terrain of emerging research that explores recent innovations in digital games, particularly as they relate to questions of teaching and learning science. One such game, Citizen Science, was developed to teach players about the practice of citizen science as well as lake ecology. Citizen science is a pedagogy that has a long history within the scientific community, engaging the public in ongoing community and environmental surveys to collect data for existing small-scale studies. More recently, citizen science has gained traction as an educational context for teaching and learning science in ways that connect to students?? lives and interests. By placing citizen science within the realm of digital worlds, Matthew Gaydos and Kurt Squire invite new possibilities for knowledge to become more kinetic, moving in multiple directions. In this article we discuss some of the tensions we experienced as we explored the digital game, Citizen Science. We highlight questions about narrative and complexity, emergent game play and transfer to encourage thinking about the development and implementation of games such as Citizen Science.     

Assessment innovation and student experience: a new assessment challenge and call for a multi-perspective approach to assessment research

The impact of innovative assessment on student experience in higher education is a neglected research topic. This represents an important gap in the literature-given debate around the marketisation of higher education, international focus on student satisfaction measurement tools and political calls to put students at the heart of higher education in the UK. This paper reports on qualitative findings from a research project examining the impact of assessment preferences and familiarity on student attainment and experience. It argues that innovation is defined by the student, shaped by diverse assessment experiences and preferences, and therefore its impact is difficult to predict. It proposes that future innovations must explore assessment choice mechanisms which allow students to shape their own assessments. Cultural change and staff development will be required to achieve this. To be accepted, assessment for student experience must be viewed as a complementary layer within a complex multi-perspective model of assessment, which also embraces assessment of learning, assessment for learning and assessment for lifelong learning. Further research is required to build a meta-theory of assessment to enhance the synergies between these alternative approaches and minimise the tensions between them.     

Using a video game to teach supply chain and logistics management

This study used OpenTTD, a video game that supports in-depth experiential learning, to evaluate undergraduate students’ opinions regarding supply chain and logistics management learning. The 101 undergraduate participants were assigned to either an experimental group or a control group. From the post-test questionnaires, the analytical results suggested that students had more positive attitudes toward video game-based learning than toward traditional education. Additionally, video game-based learning yielded more positive learning experiences than did traditional instruction. In summary, video game-based learning was found to have positive effects on the instruction of undergraduate courses on supply chain and logistics management.     

‘But this isn’t school’: exploring tensions in the intersection between school and leisure activities in classroom game design

While there are several positive outcomes from implementing game design in a formal learning context, there are also challenges that have to be considered in order to improve game-based learning. This is explored in the article, using the concepts of activity frames and stancetaking, focusing on the social organization of the game design activity. Building on video data from one 6th grade class and one 7th grade class designing computer games based on their social studies curriculum, this article shows that tensions arise when students fail to agree on what the activity they are doing is really about: The academic content and what students commonly perceive as school activities, or a game design activity informed by their leisure time. The main argument is that the students position themselves as students, game designers or characters, and that this may cause tensions in the students’ social interactions.     

Drivers and barriers to the utilisation of gamification and game-based learning in universities: A systematic review of educators' perspectives

While gamification and game-based learning have both been demonstrated to have a host of educational benefits for university students, many university educators do not routinely use these approaches in their teaching. Therefore, this systematic review, conducted using the PRISMA guidelines, sought to identify the primary drivers and barriers to the use of gamification and game-based learning by university educators. A search of multiple databases (Web of Science, Scopus and EBSCO (Business Source Complete; ERIC; Library, Information Science & Technology Abstracts)) identified 1330 articles, with 1096 retained after duplicates were removed. Seventeen articles (11 quantitative, two mixed-methods and four qualitative) were included in the systematic review. The primary drivers described by the educators that positively influenced their gamification and game-based learning usage were their beliefs that it encourages student interactions and collaborative learning; provides fun and improves engagement; and can easily be used by students. Alternatively, the university educators' major barriers included a lack of time to develop gamification approaches, lack of proven benefits and classroom setting issues. Many of these and other less commonly reported drivers and barriers can be categorised as attitudinal, design-related or administrative in nature. Such categorisations may assist university educators, teaching support staff and administrators in better understanding the primary factors influencing the utilisation of gamification and game-based learning and develop more effective strategies to overcome these barriers to its successful implementation.

Practitioner notes

What is already known about this topic

• Gamification and game-based learning may have many benefits for university students.
• The majority of university educators do not routinely use gamification and game-based learning in their teaching.

What this paper adds

• University educators' major drivers that positively influence the use of gamification and game-based learning include their perceptions that it encourages student interactions and collaborative learning, provides fun and improves engagement and can easily be used by students.
• University educators' major barriers that negatively influence the use of gamification and game-based learning include their perceptions of a lack of time to develop gamification approaches, lack of proven benefits and classroom setting issues.
• These drivers and barriers may be classified as attitudinal, design-related and administrative, with these categories providing a useful way for universities to develop strategies to better support educators who wish to use these approaches in their teaching.

Implications for practice and policy

• Attitudinal factors such as university educators' intention to use gamification and game-based learning are influenced by a host of their perceptions including attitude, perceived usefulness and ease of use.
• A range of design-related and administrative barriers may need to be overcome to increase the use of gamification and game-based learning in the university sector.

     

Simulating Oppression: Digital Gaming,Race and the Education of African American Children

Educational game designers and educators are using digital games as a platform for teaching academic content, including multicultural curriculum. However, it is unclear how well digital game-based learning can coexist with the goals of multicultural education for the purpose of meeting the needs of African American children. In this essay, we raise serious questions about the use of digital games to teach about social oppression in ways that privilege the psychological well-being of African American children. We argue that digital games that intend to recreate histories of racial oppression can be harmful to African American children if they reproduce popular and problematic notions of indigenous lives and experiences. We illuminate some of the dangers of such digital games through a preliminary exploration of one digital game designed to teach about facets of African American enslavement. Our essay concludes with recommendations for culturally relevant digital game-based learning design and instruction.     

Multilevel Assessment for Discourse,Understanding, and Achievement

Evaluating the impact of instructional innovations and coordinating instruction, assessment, and testing present complex tensions. Many evaluation and coordination efforts aim to address these tensions by using the coherence provided by modern cognitive science perspectives on domain-specific learning. This paper introduces an alternative framework that uses emerging situative assessment perspectives to align learning across increasingly formal levels of educational practice. This framework emerged from 2 design studies of a 20-hr high school genetics curriculum that used the GenScope computer-based modeling software. The 1st study aligned learning across (a) the contextualized enactment of inquiry-oriented activities in GenScope, (b) “feedback conversations” around informal embedded assessments, and (c) a formal performance assessment; the 2nd study extended this alignment to a conventional achievement test. Design-based refinements ultimately delivered gains of nearly 2 SD on the performance assessment and more than 1 SD in achievement. These compared to gains of 0.25 and 0.50 SD, respectively, in well-matched comparison classrooms. General and specific assessment design principles for aligning instruction, assessment, and testing and for evaluating instructional innovations are presented.