Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming

New high-frequency, automated data collection and analysis algorithms could offer new insights into complex learning processes, especially for tasks in which students have opportunities to generate unique open-ended artifacts such as computer programs. These approaches should be particularly useful because the need for scalable project-based and student-centered learning is growing considerably. In this article, we present studies focused on how students learn computer programming, based on data drawn from 154,000 code snapshots of computer programs under development by approximately 370 students enrolled in an introductory undergraduate programming course. We use methods from machine learning to discover patterns in the data and try to predict final exam grades. We begin with a set of exploratory experiments that use fully automated techniques to investigate how much students change their programming behavior throughout all assignments in the course. The results show that students’ change in programming patterns is only weakly predictive of course performance. We subsequently hone in on 1 single assignment, trying to map students’ learning process and trajectories and automatically identify productive and unproductive (sink) states within these trajectories. Results show that our process-based metric has better predictive power for final exams than the midterm grades. We conclude with recommendations about the use of such methods for assessment, real-time feedback, and course improvement.     

The Use of Simulators in Teaching Computer Science

Should a computer science student be able to write a simple interrupt‐answering routine? Can we have students write simple interrupt‐answering routines? What programming assignment can be given to help students understand how “system service calls” work (i.e., how do we get from nonprivilege mode to privilege mode)? Our machines with vendor‐supplied operating systems limit our assignments in some areas. Hence, we must use a “virtual machine.” Virtual machines can be produced using simulators and can be used to reinforce basic concepts by giving programming assignments on them.     

Using learning analytics in the Amazonas: understanding students’ behaviour in introductory programming

Tools for automatic grading programming assignments, also known as Online Judges, have been widely used to support computer science (CS) courses. Nevertheless, few studies have used these tools to acquire and analyse interaction data to better understand the students’ performance and behaviours, often due to data availability or inadequate granularity. To address this problem, we propose an Online Judge called CodeBench, which allows for fine-grained data collection of student interactions, at the level of, eg, keystrokes, number of submissions, and grades. We deployed CodeBench for 3 years (2016–18) and collected data from 2058 students from 16 introductory computer science (CS1) courses, on which we have carried out fine-grained learning analytics, towards early detection of effective/ineffective behaviours regarding learning CS concepts. Results extract clear behavioural classes of CS1 students, significantly differentiated both semantically and statistically, enabling us to better explain how student behaviours during programming have influenced learning outcomes. Finally, we also identify behaviours that can guide novice students to improve their learning performance, which can be used for interventions. We believe this work is a step forward towards enhancing Online Judges and helping teachers and students improve their CS1 teaching/learning practices.     

Development,Implementation, and Outcomes of an Equitable Computer Science After-School Program: Findings From Middle-School Students

Current policy efforts that seek to improve learning in science, technology, engineering, and mathematics (STEM) emphasize the importance of helping all students acquire concepts and tools from computer science that help them analyze and develop solutions to everyday problems. These goals have been generally described in the literature under the term computational thinking. In this article, we report on the design, implementation, and outcomes of an after-school program on computational thinking. The program was founded through a partnership between university faculty, undergraduates, teachers, and students. Specifically, we examine how equitable pedagogical practices can be applied in the design of computing programs and the ways in which participation in such programs influence middle school students' learning of computer science concepts, computational practices, and attitudes toward computing. Participants included 52 middle school students who voluntarily attended the 9-week after-school program, as well as four undergraduates and one teacher who designed and implemented the program. Data were collected from after-school program observations, undergraduate reflections, computer science content assessments, programming products, and attitude surveys. The results indicate that the program positively influenced student learning of computer science concepts and attitudes toward computing. Findings have implications for the design of effective learning experiences that broaden participation in computing. (Keywords: computational thinking, programming, middle school, mixed methods)     

A Conceptual Framework for Assessment Literacy: Opportunities for Physical Education Teacher Education

ABSTRACT

Although more nuanced understandings of assessment have been proposed in the physical education literature, assessment practices remain relatively underdeveloped, and when used, tend to focus on traditional, summative evaluations of learning. However, physical education teacher education programs can be used as an intervention to help pre-service teachers develop assessment knowledge and skill. Toward this end, the purpose of this article is to propose an evidence-based framework for helping pre-service teachers develop assessment literacy that is rooted in occupational socialization theory. The framework provides a four-phase approach to integrating assessment into teacher education, and includes suggestions for how physical education teacher educators can progressively help build pre-service teachers’ assessment knowledge in line with the focus given to instruction and planning. These suggestions acknowledge the technical and sociocultural aspects of learning to use assessment. Implications are discussed along with the need to help graduating pre-service teachers transfer lessons learned into the workplace.     

Analysis of Students’ learning of computer programming in a computer laboratory context

ABSTRACT

Previous research shows that many students find it difficult to learn computer programming. To learn computer programming includes both gaining theoretical understanding and learning to develop programmes in practice. To this end, teachers commonly design programming exercises for the students in the computer laboratory. To be able to improve the process of designing such exercises, there is a need of a more detailed understanding of the interaction between learning of theory and learning of practice in laboratory sessions. In this paper, an approach for investigating this interaction is proposed. Theoretically, the approach is based on phenomenography and variation theory. To illustrate the approach, it is demonstrated in detail how it was applied to a small but rich case of empirical data from a computer laboratory session. The main result presented here is the new approach for analysing data. In addition, the results of the case study shed preliminary light on the interaction between learning of practice and learning of theory when students work with programming assignments in the laboratory.     

The Future Curriculum and Information Technology

Abstract

Programmes for teacher training should train (aspiring) teachers to be able to make use of information and communications technology as mindtools. Mindtools are not pieces of specialised software that‘teach’ a subject, but computer programs and applications that facilitate meaningful professional thinking and working. Teachers can use these programs and applications to engage their students in critical thinking and to help further their own professional development. In the latter case mindtools can be applied for cooperation (between teachers, teacher educators and student teachers) and collaboration (with other teachers, experts, designers, etc. on pedagogical projects). In this article we focus on electronic networking technologies (conversation tools) as mindtools in communities of practice for teacher professional development. Examples of good practice from teacher training institutions in Europe illustrate how to prepare (aspirant) teachers for working with mindtools that enhance teacher professional development     

遗传算法在自动组卷中的应用

自动组卷策略是利用计算机自动完成试卷生成的一种方案,整个过程的人工投入少,在很大程度上解放了教师,提高了工作效率。能否自动组出满足用户要求的试卷,与组卷使用的算法紧密相关。采用遗传算法,按照选择编码方式、产生初始种群、计算自适应函数、进行遗传操作、试卷生成的过程,可完成自动组卷操作。     

Developing teachers’ capacities in assessment through career-long professional learning

Abstract

In a context of increasing demand for quality and equity in education and a sharp focus on accountability, classroom teachers are also expected to support and improve learning outcomes for pupils in response to their individual needs. This paper explores three issues: how teachers understand assessment in relation to their students’ learning, the curriculum and their pedagogical choices; how teachers’ capacity to use assessment to improve students’ learning can be developed through career-long professional learning (CLPL); and how teachers’ learning can be implemented and sustained in schools, both locally and nationally. In considering these issues, recent thinking about learning and assessment and CLPL are considered alongside empirical evidence from the development and implementation of assessment processes and approaches to professional development in Scotland. The paper emphasises the importance of a dynamic framework of CLPL that recognises the individuality of teachers’ learning needs and the consequent need for tailored professional learning opportunities with different combinations of support and challenge at school, local and national levels.     

Preparing for the Plunge: Preservice Teachers�� Assessment Literacy

Using a framework of assessment literacy that included principles, tools, and purposes, this study explored the assessment literacy of 11 secondary preservice teachers. Participants?? journals, teaching philosophies, and inquiry-based science units served as data sources. We examined how the preservice teachers understood assessment tools as well as their reasons for using assessment. Additionally, we investigated how the preservice teachers incorporated assessments into inquiry-based science units. Analysis of these documents indicated that preservice teachers recognize the need to align assessments with learning goals and instructional strategies and are using a variety of assessments. They understood several ways to use assessment for learning. However, the inclusion of assessments contained within the science units did not fully align with the views of assessment the preservice teachers presented in their teaching philosophies or journals. Instead of using a variety of assessments that reflect science reforms, the preservice teachers reverted to traditional forms of assessment in their science units. Teacher education programs need to place more emphasis on developing preservice teachers?? assessment literacy so that they are better able to select and implement a variety of appropriate assessments to foster student learning.     

Data-driven assessment of teacher candidates during their internships in deaf education

Deaf education teacher training programs have received criticism for graduating students with gaps in knowledge and skills required for specific placements. The National Council for Accreditation of Teacher Education (NCATE) requires that accredited programs engage in self-study, and NCATE guidelines require programs to collect valid, reliable evidence of teacher candidate performance and candidates' effect on student learning. In the present study, an ecobehavioral assessment computer program, MS-CISSAR (Mainstream Code for Instructional Structure and Student Academic Response), was used in evaluations of 8 teacher candidates during internship experiences. Results were mixed. Some of the instructional arrangements, teaching behaviors, and student responses resembled those found in studies using in-service teachers as subjects; however, some data revealed a need for changes in instruction. Data gathered with MS-CISSAR could be added to evaluations to help training programs meet NCATE requirements for evidence on teacher candidate performance and candidates' effect on student learning.     

Defining Family-centered Early Education: Beliefs of Public School, Child Care, and Head Start Teachers

Reform efforts in early childhood education include recommendations to adopt more family-centered approaches to practice, including greater family support functions. In this study the beliefs of 280 early childhood teachers regarding aspects of family-centered programming were assessed using the written Family Involvement Survey (FIS). Teacher beliefs were compared across public school, child care, and Head Start settings. Results revealed that public school early childhood teachers reported significantly less positive beliefs about parents' childrearing interests and abilities, along with lower self-perceived competence in relating to families, than either child care or Head Start teachers. As compared to Head Start teachers, both public school and child care teachers reported significantly more conflict about providing support services to families through their early education programs. These results were interpreted, in part, as evidence of the need for more in-depth knowledge about the separate professional cultures that characterize various sectors of the early education field.     

Formative peer assessment in a CSCL environment: a case study

In this case study our aim was to gain more insight in the possibilities of qualitative formative peer assessment in a computer supported collaborative learning (CSCL) environment. An approach was chosen in which peer assessment was operationalized in assessment assignments and assessment tools that were embedded in the course material. The course concerned a higher education case‐based virtual seminar, in which students were asked to conduct research and write a report in small multidisciplinary teams. The assessment assignments contained the discussion of assessment criteria, the assessment of a group report of a fellow group and writing an assessment report. A list of feedback rules was one of the assessment tools. A qualitative oriented study was conducted, focusing on the attitude of students towards peer assessment and practical use of peer assessment assignments and tools. Results showed that students’ attitude towards peer assessment was positive and that assessment assignments had added value. However, not all students fulfilled all assessment assignments. Recommendations for implementation of peer assessment in CSCL environments as well as suggestions for future research are discussed.     

论教师的教育立场

教师的教育立场,就是教师在面对教育问题时,能自觉地从教育的视阈出发,以相应的思维方式分析和处理教育问题。教育的原点、过程和结果决定了教师教育立场的内在结构包括教育的人性假设、内在逻辑和价值追求三要素。由此,教师基本的教育立场体现为生命立场、过程立场和意义立场。为了提升教师的教育立场,需要教师优化教育思维,坚定教育责任,修炼教育智慧。     

Fostering multicultural appreciation in pre-service teachers through multicultural curricular transformation

Schools today represent students from diverse racial, linguistic, and other cultural backgrounds. Teacher-preparation institutions have the responsibility of providing prospective teachers with the skills necessary to meet the intellectual, social, and personal needs of these diverse learners. This article examines the rationale for a multicultural curricular transformation in Teacher Education programs. The author maintains that contrary to the single-subject approach that obtains in many institutions, pedagogical approaches should be re-conceptualized to embrace diverse perceptions in content, methods and assessment tools across all disciplines. The leadership in teacher training institutions also has the responsibility of creating positive environments where multicultural initiatives can thrive. Such transformative approaches will foster multicultural appreciation in pre-service teachers and provide them with the competences necessary to effectively meet the challenges of the changing school demographics.     

Learning Outcome Testing Program: Standardized Classroom Testing in West Virginia Through Item Banking, Test Generation, and Curricular Management Software

What conditions stimulated the Learning Outcome Testing Program and what approaches were adopted? What issues need to be addressed in the selection of computer software? What steps should be taken to train teachers to develop item banks and use testing software?     

Computer literacy of Turkish preservice teachers in different teacher training programs

This paper reports on an investigation into the sophomore and senior preservice teachers’ computer literacy in different teacher training programs and to determine relationship between grades and the teacher training programs in terms of their computer literacy. The study used case study research methodology, and the sample consisted of 276 preservice teachers. The ‘Computer Literacy Scale’ comprising 24 likert-type questions was employed. The inferential statistical tests were used to analyze obtained data for comparing groups on the scores collected in multiple subtests. The results suggest that there was no difference between sophomore and senior preservice teachers’ computer literacy. For computer literacy, the order of rank is basic skills, application software skills, computer awareness and programming skills, respectively. Undergraduate programs only have developed basic skills of preservice students and have not had the impact on other skills or sophisticated computer literacy. The MANOVA inferential statistics findings proved these results. It is suggested that content of the computer literacy skills and computer course(s) should be improved and re-designed by including computer literacy skills.     

Learning to Balance Assistance With Assessment: A Scholarship of Field Instruction

In this self-study, the author focuses on ways of embracing and managing a central dilemma of student teaching supervision: balancing assistance with assessment. Drawing on his practice as a field supervisor, the author chronicles conversations with student teachers over a 2-year period in the context of two distinct teacher education programs. Through qualitative methods of data analysis, the author finds that supervisors have access to specific discursive tools and strategies that allow them to balance support with assessment of their student teachers. In this article, he describes and explains five key strategies and concludes with implications for the preparation and support of supervisors that can help them engage in critical dialogue with their student teachers to push their practice forward.     

Defining Family-centered Early Education: Beliefs of Public School,Child Care,and Head Start Teachers

Reform efforts in early childhood education include recommendations to adopt more family-centered approaches to practice, including greater family support functions. In this study the beliefs of 280 early childhood teachers regarding aspects of family-centered programming were assessed using the written Family Involvement Survey (FIS). Teacher beliefs were compared across public school, child care, and Head Start settings. Results revealed that public school early childhood teachers reported significantly less positive beliefs about parents' childrearing interests and abilities, along with lower self-perceived competence in relating to families, than either child care or Head Start teachers. As compared to Head Start teachers, both public school and child care teachers reported significantly more conflict about providing support services to families through their early education programs. These results were interpreted, in part, as evidence of the need for more in-depth knowledge about the separate professional cultures that characterize various sectors of the early education field.     

Authentic assessment of teaching in context

The demands of teaching more challenging content to more diverse learners suggest a need for teacher education that enables teachers to become more sophisticated in their understanding of the effects of context and learner variability on teaching and learning. Instead of implementing set routines, teachers need to become ever more skillful in their ability to evaluate teaching situations and develop teaching responses that can be effective under different circumstances. This article examines how a growing number of teacher education programs are using authentic assessments of teaching – cases, exhibitions, portfolios, and problem-based inquiries (or action research) – as tools to support teacher learning for these new challenges of practice. Using specific teacher education programs as examples, the article examines how and why these strategies appear to provide support for teacher learning and avenues for more valid assessment of teaching. The authors also discuss circumstances in which these strategies may be less effective and suggest features of the assessments and programmatic contexts that are associated with more and less successful use.