Evolution of Novice Programming Environments: The Structure Editors of Carnegie Mellon University

Abstract

Beginning in the early 1980s, the Computer Science Department at Carnegie Mellon University developed and used three generations of novice programming environments. The focus of these systems was to apply, advance and tune structure editor technology in support of the teaching and learning of computer programming. The use of these pedagogical systems in Carnegie Mellon's introductory programming courses provided feedback and inspiration to guide the projects. This paper tracks the evolution of the programming environments and courses, documenting important lessons and discoveries about novice programmers and the environments that support them.     

A theory of instruction for introductory programming skills

ABSTRACT

Background and Context: Current introductory instruction fails to identify, structure, and sequence the many skills involved in programming.

Objective: We proposed a theory which identifies four distinct skills that novices learn incrementally. These skills are tracing, writing syntax, comprehending templates (reusable abstractions of programming knowledge), and writing code with templates. We theorized that explicit instruction of these skills decreases cognitive demand.

Method: We conducted an exploratory mixed-methods study and compared students’ exercise completion rates, error rates, ability to explain code, and engagement when learning to program. We compared material that reflects this theory to more traditional material that does not distinguish between skills.

Findings: Teaching skills incrementally resulted in improved completion rate on practice exercises, and decreased error rate and improved understanding of the post-test.

Implications: By structuring programming skills such that they can be taught explicitly and incrementally, we can inform instructional design and improve future research on understanding how novice programmers develop understanding.     

Teaching computer programming with PRIMM: a sociocultural perspective

ABSTRACT

Background and Context: Vygotsky's sociocultural theory emphasises the importance of language, mediation, and the transfer of skills and knowledge from the social into the cognitive plane. This perspective has influenced the development of PRIMM (Predict, Run, Investigate, Modify, Make), a structured approach to teaching programming.

Objective: The objective of the study was to find out if using PRIMM to teach programming had an impact on learner attainment in secondary school, and the extent to which it was valuable for teachers.

Method: We evaluated the use of PRIMM in 13 schools with 493 students aged 11-14 alongside a control group, using a mixed-methods approach. Teachers delivered programming lessons using the PRIMM approach for 8-12 weeks. Data were collected via a combination of a baseline test, a post-test to compare control and experimental groups, and teacher interviews.

Findings: Learners performed better in the post test than the control group. Teachers reported several benefits of the PRIMM approach, including that PRIMM helped them to teach effectively in mixed-ability classes, enabling all learners to make progress.

Implications: PRIMM makes a contribution to programming education research by building on previous work in effective pedagogy for teachers, and encouraging the use of language and dialogue to facilitate understanding.     

Concepts before coding: non-programming interactives to advance learning of introductory programming concepts in middle school

ABSTRACT

Background and Context: Learners struggle with conceptual understanding of introductory programming concepts such as variables, expressions, and loops.

Objective: We examine whether and how designed activities for conceptual exploration support preliminary engagement with and learning of foundational and often hard-to-grasp programming concepts for students in grades 6–8.

Method: Drawing on principles from dynamic mathematics, we developed a suite of non-programming digital and unplugged activities embedded in a curriculum before students engage in Scratch block-based programming. We conducted empirical research in three middle school classrooms in diverse urban US schools and examined student performance through mixed qualitative and quantitative methods.

Findings: Learning gains were significant and not predicted by grade, gender or prior academic preparation. Free-choice projects of students showed statistically greater (correct) use of key concepts compared to those not in the study.

Implications: Our work demonstrates the promise of novel approaches such as interactive non-programming activities for deeper understanding of programming concepts.     

Cognitive and Affective Outcomes in School Effectiveness Research

ABSTRACT

School effectiveness research has traditionally focused on basic cognitive pupil outcomes such as language and mathematics achievement. In this article however we address a research question that goes beyond this limited scope by studying both cognitive and affective outcomes of education in combination with each other. By looking at cognitive and affective outcomes at two different levels, i.e. school and the individual pupil, it is possible to make assertions about the relationship between the two outcome types at these levels. The main question in this study with respect to school effectiveness research is: ‘Can schools be both cognitive and affective effective?’

To answer this question a sample of 7,000 pupils in 212 primary schools in the Netherlands was used, providing information about cognitive, affective and pupil background variables. Firstly the relationship between affective and cognitive outcomes at pupil level is shown, using a LISREL model to show how these variables interact. Secondly the relative positions of schools with respect to their effectiveness in the cognitive and affective outcomes are compared in order to show the degree of consistency in the effectiveness of both outcome domains. These correlations appear to be small, but positive.     

EvoBuild: A Quickstart Toolkit for Programming Agent-Based Models of Evolutionary Processes

Extensive research has shown that one of the benefits of programming to learn about scientific phenomena is that it facilitates learning about mechanisms underlying the phenomenon. However, using programming activities in classrooms is associated with costs such as requiring additional time to learn to program or students needing prior experience with programming. This paper presents a class of programming environments that we call quickstart: Environments with a negligible threshold for entry into programming and a modest ceiling. We posit that such environments can provide benefits of programming for learning without incurring associated costs for novice programmers. To make this claim, we present a design-based research study conducted to compare programming models of evolutionary processes with a quickstart toolkit with exploring pre-built models of the same processes. The study was conducted in six seventh grade science classes in two schools. Students in the programming condition used EvoBuild, a quickstart toolkit for programming agent-based models of evolutionary processes, to build their NetLogo models. Students in the exploration condition used pre-built NetLogo models. We demonstrate that although students came from a range of academic backgrounds without prior programming experience, and all students spent the same number of class periods on the activities including the time students took to learn programming in this environment, EvoBuild students showed greater learning about evolutionary mechanisms. We discuss the implications of this work for design research on programming environments in K-12 science education.     

Interpersonal process recall: a novel approach to illuminating students’ software development processes

Background and Context: Encouraging undergraduate programming students to think more about their software development processes is challenging. Most programming courses focus on coding skill development and mastering programming language features; subsequently software development processes (e.g. planning, code commenting, and error debugging) are undervalued. Moreover, many of these processes involve tacit thinking that is often seemingly invisible, meaning it can be difficult for teachers to identify and address shortcomings in student processes.

Objective: In this paper, we employ a novel approach called Interpersonal Process Recall (IPR) to encourage students to think more about their software development processes.

Method: We conducted IPR sessions with five undergraduate programming students—we screen captured them working on programming assignments, and then used the screen captures to stimulate reflection. IPR is hallmarked by several key features, namely its developmental (rather than evaluative) focus, and the use of a facilitator to guide reflection in a structured way.

Findings: We found IPR was useful for both the teaching staff and the students, revealing incongruence between the value students placed on certain development processes and what they actually do in practice.

Implications: IPR is a novel approach for shining a light on student software development processes. We hope this paper encourages other practitioners to consider adding IPR to their toolbox of approaches for encouraging students to reflect on their software development processes.     

SCIENCE TEACHERS’ VOICE ON HOMEWORK: BELIEFS,ATTITUDES, AND BEHAVIORS

Homework (HW) is an integral part of the learning process. Currently, there is renewed interest and controversy about its effectiveness. The present study explores the voices of the science teachers on this matter. Adopting the view that reporting both teachers’ views and actual classroom practices is necessary for obtaining a more complete view of the phenomena, the present study addressed teachers’ views relating to the cognitive, affective, and pedagogical aspects of HW, their in-class practices and behaviors related to HW, and if the views and practices differ. The research was conducted in 3 stages: (a) teachers’ (n = 25) behaviors were examined based on classroom observations of 3 – 5 consecutive lessons, (b) these teachers were interviewed about their beliefs about and attitudes toward HW, and (c) the data from both the observations and interviews were processed into categories and subcategories. The findings revealed a wide range of teachers’ beliefs, attitudes, and behaviors and that teachers hold both positive and negative views simultaneously. In addition, the views for some categories expressed in the interviews concurred with the teacher’s actual classroom behavior; for other categories, disagreements were identified. This research broadens the contemporary horizons regarding HW and may contribute to those who wish to work with teachers making HW more effective.

     

Programming and Mathematics in an Upper-Level University Problem-Solving Course

We discuss teaching and learning situations that surfaced when computer programming and mathematics were brought together in a course where students write computer code to explore mathematics problems. Combining programming and mathematics creates a rich ecosystem which, on top of traditional mathematics activities (writing solutions, proofs, etc.), offers simulation and experimentation, invites discussions about structure, requires logic and testing strategies, and handles mathematics objects with an added feeling of reality. Focusing on novice and inexperienced programmers, we look for answers to the practice-oriented question, “How do students reason through their difficulties when using programming to explore a mathematics problem?” Following literature review and methodology, we build the programming model, which we use to study students' experiences as they approach a mathematical problem by writing computer code. Our research is based on analyzing students' in-class work and class notes, author's observations of students working on their computers, and his interactions with students in class and elsewhere. In the four case studies that we present we touch upon students' difficulties in working with complex conditional statements and recurrence relations. As well, we discuss cases where resolving a programming issue demands posing and answering mathematical questions.     

A Randomized Experiment of a Cognitive Strategies Approach to Text-Based Analytical Writing for Mainstreamed Latino English Language Learners in Grades 6 to 12

Abstract

This study reports Year 1 findings from a multisite cluster randomized controlled trial of a cognitive strategies approach to teaching text-based analytical writing for mainstreamed Latino English language learners (ELLs) in 9 middle schools and 6 high schools. There were 103 English teachers stratified by school and grade and then randomly assigned to the Pathway Project professional development intervention or control group. The Pathway Project trains teachers to use a pretest on-demand writing assessment to improve text-based analytical writing instruction for mainstreamed Latino ELLs who are able to participate in regular English classes. The intervention draws on well-documented instructional frameworks for teaching mainstreamed ELLs. Such frameworks emphasize the merits of a cognitive strategies approach that supports these learners’ English language development. Pathway teachers participated in 46 hrs of training and learned how to apply cognitive strategies by using an on-demand writing assessment to help students understand, interpret, and write analytical essays about literature. Multilevel models revealed significant effects on an on-demand writing assessment (d = .35) and the California Standards Test in English language arts (d = .07).     

Relations between Risk for Sleep-Disordered Breathing,Cognitive and Executive Functioning,and Academic Performance in Six-Year-Olds

ABSTRACT

Research Findings: Optimal sleep is important for children’s learning and development. Sleep disordered breathing (SDB) refers to a spectrum of conditions from simple snoring to obstructive sleep apnea that is common in childhood and interrupts sleep. We examined pathways between SDB and academic performance of children (N = 163, M age = 6.2 years) one year after school entry. Measures included parent questionnaire and clinical assessment of SDB, standardized tests and rating scales of cognitive and executive functioning, researcher-administered literacy and numeracy tasks, and teacher-reported academic performance. Structural equation modeling (SEM) revealed direct and indirect paths between SDB and poorer academic performance. In indirect models, children’s SDB severity score was significantly linked to poorer executive functioning (β = .38, p < .01) and negatively associated with nonverbal reasoning (β = ?.21, p < .01). Poorer executive functioning, in turn, was negatively related to the verbal composite (β = ?.61, p < .01), with verbal and nonverbal composites associated with academic performance (βs = .56, .27, respectively, p’s < .01). Practice or Policy: These findings point to the need for attention to SDB and its links to potential cognitive sequelae across early development. Practitioners equipped with knowledge of SDB symptoms can facilitate referral for appropriate consultation and evaluation.     

Memory training program for older adults

ABSTRACT

Objective: Memory loss affects a large proportion of older adults. Research indicates a positive association between memory training and better memory performance as people age. However, studies on specific memory training using an experimental design are limited. This study explored whether memory training has improved memory performance in a group of older adults.

Method: A convenience sample of 48 participants was recruited from two communities. Disregarding dropouts, this left 23 experimental (mean age = 65.4 ± 6.0, range = 56–80) and 19 control participants (mean age = 64.5 ± 4.9, range: 57–72). The intervention consisted of 60-min classes held on a weekly basis continuing for 8 weeks. The class session was held after a 1-h exercise class and before a 1-h session of cognitive games. The pre–post objective memory performances, including associative, list, text, place, grocery learning, and transfer-effect of daily event memory (ecology validity), were examined to determine whether the intervention was effective.

Results: Intragroup: With Wilcoxon test, the findings showed that the intervention of both the list and place learning had significant differences for the experimental group, but not for the control group. Intergroup: The main effects were found for the associative and text learning. The mixed design ANOVA indicated that there is an interaction (time x group) on the dependent variable of the place learning test. Daily events memory: We found within group that the pre–post differences were significant for the experimental group but not for the control group.

Conclusion: The study showed that memory training can help older adults to ameliorate memory loss problems and these findings deserve more attention.     

Protective Factors and Compensation in Resolving Dyslexia

ABSTRACT

Two explanations for resolving dyslexia were investigated, one assuming resolving underlying deficits and another assuming compensatory mechanisms based on cognitive strengths. Thirty-six Dutch gifted secondary-school students with either persistent (n = 18) or resolving (n = 18) dyslexia participated. Groups, matched on IQ, were assessed on dyslexia- and intelligence-related cognitive risk and protective factors. Findings for the risk factors showed support for both the resolving-deficit and compensatory-mechanism theories: Resolving and persistent groups were comparable on phoneme deletion and nonalphanumeric rapid automatized naming, but resolvers outperformed students with persistent dyslexia on spoonerisms and alphanumeric rapid automatized naming. For the protective factors, resolvers consistently showed more pronounced cognitive strengths in verbal areas relevant for literacy development, which is in line with the compensatory-mechanism theory. We conclude that, besides underlying deficits resolving to some extent, compensation is a plausible explanation for resolving literacy difficulties in gifted students.     

Cognitive load imposed by ultrasound‐facilitated teaching does not adversely affect gross anatomy learning outcomes

Ultrasonography is increasingly used in medical education, but its impact on learning outcomes is unclear. Adding ultrasound may facilitate learning, but may also potentially overwhelm novice learners. Based upon the framework of cognitive load theory, this study seeks to evaluate the relationship between cognitive load associated with using ultrasound and learning outcomes. The use of ultrasound was hypothesized to facilitate learning in anatomy for 161 novice first‐year medical students. Using linear regression analyses, the relationship between reported cognitive load on using ultrasound and learning outcomes as measured by anatomy laboratory examination scores four weeks after ultrasound‐guided anatomy training was evaluated in consenting students. Second anatomy examination scores of students who were taught anatomy with ultrasound were compared with historical controls (those not taught with ultrasound). Ultrasound's perceived utility for learning was measured on a five‐point scale. Cognitive load on using ultrasound was measured on a nine‐point scale. Primary outcome was the laboratory examination score (60 questions). Learners found ultrasound useful for learning. Weighted factor score on “image interpretation” was negatively, but insignificantly, associated with examination scores [F (1,135) = 0.28, beta = ?0.22; P = 0.61]. Weighted factor score on “basic knobology” was positively and insignificantly associated with scores; [F (1,138) = 0.27, beta = 0.42; P = 0.60]. Cohorts exposed to ultrasound had significantly higher scores than historical controls (82.4% ± SD 8.6% vs. 78.8% ± 8.5%, Cohen's d = 0.41, P < 0.001). Using ultrasound to teach anatomy does not negatively impact learning and may improve learning outcomes. Anat Sci Educ 10: 144–151. © 2016 American Association of Anatomists.     

The effects of first programming language on college students’ computing attitude and achievement: a comparison of graphical and textual languages

Background and Context: The relationship between novices’ first programming language and their future achievement has drawn increasing interest owing to recent efforts to expand K–12 computing education. This article contributes to this topic by analyzing data from a retrospective study of more than 10,000 undergraduates enrolled in introductory computer science courses at 118 U.S. institutions of higher education.

Objective: We explored the relationship between students’ first programming languages and both their final grades in an introductory computer science course and their attitudes about programming.

Method: Multiple matching techniques compared those whose first language was graphical (e.g., Scratch), textual (e.g., Java), or absent prior to college.

Findings: Having any prior programming experience had positive effects on both attitudes about programming and grades in introductory computer science courses. Importantly, students whose first language was graphical had higher grades than did students whose first language was textual, when the languages were introduced in or before early adolescent years.

Implications: Learning any computer language is better than learning none. If programming is to be taught to students before early adolescence, it is advised to start with a graphical language. Future work should investigate the transition between different types of programming languages.     

Training Outcomes of Field Instructors in the Evidence-Based Practice Process Model

ABSTRACT

This study evaluated a continuing education training program designed to increase field educators’ capacities to support students in their application of the evidence-based practice (EBP) process. A cohort of social work field instructors and task supervisors from agency-based settings (N = 186) attended a 1-day interactive skill-based training. Pre- and postsurveys assessed learning outcomes. Findings reveal a significant improvement from pre- to posttraining in the social work educators’ familiarity, t(179) = 22.8; attitude, t(180) = 12.73; and intentions, t(178) = 11.89, regarding EBP. Results indicate that skill-based training in the EBP process model via continuing education is feasible and acceptable.     

A comprehensive approach to managing school safety: case studies in Catalonia,Spain

Background: Schools should be safe spaces for students, teaching staff and non-teaching staff. For the concept of ‘safety’ to be meaningful, it must be interpreted broadly to encompass well-being in its widest sense. A common challenge for schools and educational authorities is, therefore, to manage school safety appropriately not only to prevent physical accidents and incidents, but also with the purpose of creating an environment that promotes physical, emotional and social well-being, both individually and collectively.

Purpose: The aim of this research paper is twofold: (a) to explore the concept of safety as it is interpreted by schools and analyse the extent to which schools are committed to the goal of creating safe and healthy school environments; and (b) to identify organisational and management practices that promote the safety of school staff and users.

Design, sample and methods: The research was carried out from a qualitative perspective, based on a study of multiple cases carried out in Catalonia, Spain. The case studies (N = 9 schools) were selected by means of a purposive sampling process in order to obtain a selection of schools covering different education stages and under different types of ownership. The data collection process involved carrying out semistructured interviews (N = 39) with school principals, health and safety officers, teaching staff and non-teaching staff; focus groups with families (N = 2) and a review of general documentation and specific safety documents (N = 58). The data collected were completed and verified by means of interviews with experts (N = 3). The interviews, focus groups and notes arising from the document review were transcribed literally and analysed thematically, following a cross-case analysis structure.

Results: The data analysis indicated that creating safe and healthy environments was not always an explicitly endorsed principle or goal for schools. However, all members of the educational community were involved in ensuring adequate levels of school safety; and diverse management and organisational actions and measures were implemented to ensure physical, emotional and social safety.

Conclusions: We conclude that according to a broad interpretation of safety, which encompasses well-being in its widest sense, a comprehensive school safety management approach had not been fully adopted by schools in the studied sample. Whilst involvement in safety practices was evident, many actions appeared to be carried out without full consideration of the wider promotion of school safety. The study suggests the importance of training and awareness activities for education professionals in order to build and promote safety culture and to facilitate the introduction of a comprehensive school safety approach in the day-to-day management of schools.     

The relationship between young children’s enjoyment of learning to read,reading attitudes,confidence and attainment

Background: While there is a considerable body of research exploring the relationship between older primary school children’s reading attitudes, confidence and attainment, there is a noticeable lack of research with younger children. Furthermore, there is relatively little research exploring the extent to which children’s reading attitudes, confidence and attainment are related to their enjoyment of learning to read.

Purpose: To understand the relationship between young children’s reading attitudes, reading confidence, enjoyment of learning to read and reading attainment.

Sample: Two hundred and three children (103 boys) with an average age of 6 years and 9 months (.32 years standard deviation) participated in this study. Children were from 11 primary schools in England, located within a wide range of socio-economic neighbourhoods.

Design and methods: All children completed questionnaires examining their attitudes to reading, reading confidence (using Progress in International Reading Literacy Study items) and enjoyment of learning to read. Children also completed an assessment of word reading. All assessments were administered individually.

Results: Children’s attitudes to reading, reading confidence and enjoyment of learning to read correlated with their word reading skill; however, only reading attitudes and reading confidence predicted variance in reading success. With regard to gender differences, girls reported more positive reading attitudes than boys, even after controlling for differences in reading skill.

Conclusions: Results highlight that the relationship between children’s reading skills and the affective aspects of learning to read develops from a young age. Therefore, methods of reading instruction need to foster affective aspects of reading, in addition to developing cognitive skills to best support young children’s reading development.     

A Meta-Analytic Review of Naming-Speed Deficits in Developmental Dyslexia

ABSTRACT

This study presents a meta-analytic review of serial rapid automatized naming (RAN) deficits in individuals with dyslexia relative to typical readers (based on 216 effect sizes comprising 8335 dyslexic readers, 14,083 age-matched controls, and 921 reading-matched controls). A random-effects model analysis indicated a large impairment in speeded RAN in individuals with dyslexia compared with age-matched controls (d = 1.19) but a similar performance when compared with reading-matched controls (d = 0.13). In addition, dyslexic readers presented a deficit in discrete-naming formats (d = 0.74), although the deficit in serial RAN was notably larger; hence, adding seriality is particularly detrimental for these readers. The deficit appears to span all stimulus types (alphanumeric and nonalphanumeric), indicating that processes beyond letter processing are responsible for the delays and are independent of set size. Poor RAN is a long-term and universal symptom of dyslexia, and the transparency of the writing system does not influence its severity.