A Case Study of Systemic Aspects of Assessment Technologies

Current designs and classroom uses of assessment technology do not adequately reflect or support human practices that produce meaningful information about student learning. We base this argument on findings from a study of the diverse practices making up an assessment system in a fifth-grade mathematics classroom where students have extensive access to personal computing. Videotaped records of classroom activities, reflecting both teachers' and students' perspectives on the classroom, are analyzed with teachers to develop a grounded theoretical framework for describing assessment practices. We present the framework, use it to compare different examples of assessment activities, and propose new criteria for designing systemically valid assessments as kinds of technology that support and extend existing classroom practices.     

Causes of Educational Failure among Elementary School Students in Brunei Darussalam as Perceived by Mathematics and Science Teachers

This study investigated causes of school failure among elementary school students in Brunei Darussalam. Fifty-two specialist mathematics and science teachers were involved in the investigation using a questionnaire. The student factor identified to be the most important was related to students' poor command of the English language. Lack of interest in learning was another important influencing factor in students' failure. Parental factors perceived to be the most important were lack of supervision of their children's activities at home and reluctance to make school visits to see teachers about their children's academic progress. The influence of teacher factors on educational failure was perceived to be less important.     

Project-based learning and student knowledge construction during asynchronous online discussion

Project-based learning engages students in problem solving through artefact design. However, previous studies of online project-based learning have focused primarily on the dynamics of online collaboration; students' knowledge construction throughout this process has not been examined thoroughly. This case study analyzed the relationship between students' levels of knowledge construction during asynchronous online discussions with respect to engagement in project-based learning. Graduate students' online postings in a course that comprised both project-based and non-project learning activities were coded and counted for knowledge construction, teaching, and social interaction moves using computer-mediated discourse analysis. Chi-square analyses found that the instructor's teaching discourse remained fairly consistent during project-based and non-project learning. Despite this, students' online discussions during project-based learning were characterized by more advanced levels of knowledge construction, where ideas were rationalized and integrated into plausible solutions. In contrast, students' online postings outside project-based learning rarely moved beyond the lower levels of information sharing and idea exploration. Based on these results, guidelines for designing and facilitating online project-based learning are presented and discussed.     

The Wheels of the Bus: Children designing in an early years classroom

Many claims have been made for the value of design in the school curriculum. This case study, of young children's designs in an early years design, make and appraise (DMA) classroom, examined several issues related to these claims, including the connection between designing and making, the purpose of drawing for young children, children's understandings about the design process, types of images used by young children and children's attitudes to designing. The role of the teacher in the children's understanding of the design / drawing process was explored. The study revealed that design for young children is a complex topic requiring a range of sophisticated teaching and learning strategies.     

Finding the optimal guidance for enhancing anchored instruction

This study investigated the effect of different methods of guidance with anchored instruction on students' mathematical problem-solving performance. The purpose of this research was to iteratively design a learning environment to find the optimal level of guidance. Two iterations of the software were compared. The first iteration used explicit instruction upfront followed by practice problems, and the second iteration provided structured problem-solving guidance as needed to solve the problems within the software. Pilot testing was conducted with 32 fifth-grade students from two inclusive classrooms observed a year apart within a small Midwestern, urban school. A parametric analysis of covariance was used to compare the problem-solving performance of the students who used the two different iterations. Enhancing anchored instruction with structured problem-solving guidance on an as-needed basis significantly improved students' problem-solving performance on conceptually easy problems, but not for more complex problems. The implications of this research illustrate the importance of iteratively designing and developing learning environments to take into consideration the needs of a particular situation.     

Making Meaningful: Intention in Children's Art Making

Children's art work has often been the subject of study by researchers seeking to gain insight into the role of art making in children's learning and development. However, rarely are children's own explanations of their art making used to inform these studies. Children's perceptions of their own art making are important for research and practice in art education, because their artistic experiences and motivations determine how they will engage in and respond to art making activities. This study used ethnographic methods to learn about the art making that took place over the course of one year in an elementary school art room, and to gain insight into the students' experiences and perceptions of art‐making activity. Data were analysed using a socio‐cultural framework. By asking children why they made art and exploring children's own explanations of their art making, this study reveals some of the important intentions that children bring to their artistic activity, and some of the ways that children make meaning through art making.     

The Purchasing Practice of Low-Income Students: The Relationship to Mathematical Development

The purpose of this 2-part study was to explore the mathematical and purchasing competencies present in students' engagement in shopping practices in a low-income African American neighborhood. Study 1 consisted of in situ analyses of children's shopping activities at a local store, revealing the variety of arithmetic tasks that emerged in relation to varied artifacts, shopping routines, social norms, and clerk support. In an effort to reveal competencies that could not be measured through observation alone, Study 2 consisted of individual interviews of 30 first and second graders about tasks that required them to purchase items at a mock store. Analyses revealed both strategies that were frequently and infrequently associated with successful purchasing and the relationship between children's strategy choices and the demands of particular purchases. This research documents the many mathematical competencies children present that may not be captured in traditional school assessments and considers how this prior knowledge might be used to inform instruction and treatments of sociocultural frameworks.     

Epistemological framing and novice elementary teachers' approaches to learning and teaching engineering design

As engineering learning experiences increasingly begin in elementary school, elementary teacher preparation programs are an important site for the study of teacher development in engineering education. In this article, we argue that the stances that novice teachers adopt toward engineering learning and knowledge are consequential for the opportunities they create for students. We present a comparative case study examining the epistemological framing dynamics of two novice urban teachers, Ana and Ben, as they learned and taught engineering design during a four-week institute for new elementary teachers. Although the two teachers had very similar teacher preparation backgrounds, they interpreted the purposes of engineering design learning and teaching in meaningfully different ways. During her own engineering sessions, Ana took up the goal not only of meeting the needs of the client but also of making scientific sense of artifacts that might meet those needs. When facilitating students' engineering, she prioritized their building knowledge collaboratively about how things work. By contrast, when Ben worked on his own engineering, he took up the goal of delivering a product. When teaching engineering to students, he offered them constrained prototyping tasks to serve as hands-on contexts for reviewing scientific explanations. These findings call for teacher educators to support teachers' framing of engineering design as a knowledge building enterprise through explicit conversations about epistemology, apprenticeship in sense-making strategies, and tasks intentionally designed to encourage reasoning about design artifacts.     

Social Construction of Computer Experience in a First-Grade Classroom: Social Processes and Mediating Artifacts

Based on a Vygotskian perspective, as well as a broader socio-cultural perspective, we propose a transactional model of social processes and artifacts to investigate young children's social construction of their computer experience. An ethnographic study was conducted in a first-grade classroom at a public school located in a Midwest town. A grounded-theory approach was used to analyze video, field notes, interviews, and artifacts. The results indicate that young children constantly negotiate between their own individual and collective goals in the classroom and the affordances of the environment, as they create their own definition of computer use while simultaneously conforming to the rules set by the teacher. The artifacts students use—the computer, a timer, and waiting lists—both enable and challenge children's social negotiation. In this negotiation process, children socially construct not only their computer experience, but also their early school experience on a whole. The transactional model provides a useful theoretical framework to study children's social practice as well as practical suggestions for teachers to optimize students' collaborative interaction.     

The relationship between personal epistemology and self-regulation among Turkish elementary school students

The purpose of the study was to determine the level of the relationship among Turkish elementary school students' personal epistemologies, motivation, learning strategies, and achievements in science. A total of 322 fifth-grade students participated in the study. Results from the structural equation modeling showed that students' personal epistemologies influence both their motivation and metacognitive strategies in science learning. Viewing scientific knowledge as constructed by the learner contributes to the students having high motivations, high science achievement, and the ability to engage metacognitively in learning tasks.     

Engineering design in the primary school: applying stem concepts to build an optical instrument

Internationally there is a need for research that focuses on STEM (Science, Technology, Engineering and Mathematics) education to equip students with the skills needed for a rapidly changing future. One way to do this is through designing engineering activities that reflect real-world problems and contextualise students’ learning of STEM concepts. As such, this study examined the learning that occurred when fifth-grade students completed an optical engineering activity using an iterative engineering design model. Through a qualitative methodology using a case study design, we analysed multiple data sources including students’ design sketches from eight focus groups. Three key findings emerged: first, the collaborative process of the first design sketch enabled students to apply core STEM concepts to model construction; second, during the construction stage students used experimentation for the positioning of lenses, mirrors and tubes resulting in a simpler ‘working’ model; and third, the redesign process enabled students to apply structural changes to their design. The engineering design model was useful for structuring stages of design, construction and redesign; however, we suggest a more flexible approach for advanced applications of STEM concepts in the future.     

The role of temperament in children's affective and behavioral responses in achievement situations

Although students' affects and behaviors in achievement situations have been shown to be influenced by their previous learning experiences, less is known about how they relate to students' dispositional characteristics, such as temperament. This study examined to what extent children's temperament is related to their affective and behavioral responses in achievement situations. Teachers rated first-graders' (n = 153) temperamental characteristics in the Fall semester. Children's active task avoidance, anxiety, and helplessness were rated in test situations in the Fall and Spring semesters. The results showed that the more easily distracted the children were, the more task avoidance they showed, and the more their task avoidance increased during the first grade. Moreover, children's high level of inhibition was related to high levels of anxiety and helplessness. The findings suggest that characteristics that are related to students' behavioral regulation and inhibition are particularly important for their affective and behavioral responses in achievement situations.     

Assessing students' understanding of inquiry: What do prospective science teachers notice?

The theoretical construct of teacher noticing has allowed mathematics teacher educators to examine teacher thinking and practice by looking at the range of activities that teachers notice in the classroom. Guided by this approach to the study of teacher thinking, the central goal of this exploratory study was to identify what prospective science teachers notice when evaluating evidence of student understanding in another teacher's inquiry‐based unit. Our results are based on the qualitative analysis of 43 prospective teachers' evaluations of assessment evidence presented to them in the form of a video case and associated written artifacts. Analysis of our data revealed two major categories of elements, Task‐General and Task‐Specific, noticed by our study participants. Task‐General elements included attention to learning objectives, independent student work, and presentation issues and they often served to guide or qualify the specific inquiry skills that were evaluated. Task‐Specific elements included the noticing of students' abilities to perform different components of an investigation. In general, study participants paid attention to important general and specific aspects of student work in the context of inquiry. However, they showed preferential attention to those process skills associated with designing an investigation versus those practices related to the analysis of data and generation of conclusions. Additionally, their interpretations of assessment outcomes were largely focused on the demonstration of general science process skills; much less attention was paid to the analysis of the epistemological validity or scientific plausibility of students' ideas. Our results provide insights into the design of meaningful learning experiences for prospective teachers that elicit, challenge, and enrich their conceptions of student understanding in the context of inquiry. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50:189–208, 2013     

Listening to Student Concerns: An Instructional Strategy to Expand Student Perspectives

It is well documented in the literature that relationships influence the lives of young children (birth to second grade). Consequently, it is essential that young children's caregivers and teachers build professional relationships with children's parents, because these relationships influence the children's present and later learning environments both at home and in school. While listening to parents is a well-established value in the field of Early Childhood Care and Education, details about what “listening to parents” means seem less clear in the literature, research, and our own pedagogy as early childhood educators. Incidentally, teacher candidates and advanced teacher students (hereafter referred to as “our students”) sometimes voice concerns related specifically to listening to parents. Yet, answers to such concerns also seem limited in the literature and the research. Therefore, the intent of this reflective position paper is threefold: to provide my fellow teacher educators with three literature-based reasons to share with our students about why it is important to listen to parents; to indentify familiar comments, concerns, and feelings that our students have voiced about listening to parents; and to provide five practical cooperative-learning activities that will potentially influence our students' practices.     

Science teachers' sensemaking of the use of epistemic tools to scaffold students' knowledge (re)construction in classrooms

This study explores the process of teacher scaffolding student engagement in epistemic tools from the critical sensemaking perspective. Epistemic tools are contextual artifacts manipulated to investigate and evaluate ideas to construct knowledge within the constraints of a disciplines' representational means. The main sources of our data are ~50 min-long semistructured, responsive interviews with the 14 secondary school science teachers who participated in our professional learning environment (PLE) and implemented the activities from the PLE in their classrooms. We utilized the tools of discourse analysis to explore teacher sensemaking while they learned to teach science with epistemic tools. We then looked at intertextualities of meaning across multiple sets of data such as students' artifacts, pre/postsurveys, audio and video recordings of the workshops, and teachers' written implementation feedback forms. As a result, we recognized a pattern across different classrooms. Teachers would begin with a contextualized goal, and use a pedagogical strategy to scaffold their students as they worked to achieve that goal. Then, all teachers reported they faced some sort of ambiguity (such as grappling with failure, different levels of students). When faced with an ambiguity, teachers would then revise either their contextualized goal or their initial pedagogical strategy to help their students to reach their goals. Finally, we utilized constant-comparative analysis to identify themes for teachers' contextualized goals. Four major themes emerged, including communicating connections to core ideas of science, making sense of how science works, assessing students' learning process outcomes, and fostering students' epistemic agency. The findings of the study have implications for future research and professional development activities on the use of epistemic practices and tools in classrooms with unique contextual characteristics.     

The role of design ethics in maintaining students' privacy: A call to action to learning designers in higher education

Maintaining students' privacy in higher education, an integral aspect of learning design and technology integration, is not only a matter of policy and law but also a matter of design ethics. Similar to faculty educators, learning designers in higher education play a vital role in maintaining students' privacy by designing learning experiences that rely on online technology integration. Like other professional designers, they need to care for the humans they design for by not producing designs that infringe on their privacy, thus, not causing harm. Recognizing that widely used instructional design models are silent on the topic and do not address ethical considerations such as privacy, we focus this paper on how design ethics can be leveraged by learning designers in higher education in a practical manner, illustrated through authentic examples. We highlight where the ethical responsibility of learning designers comes into the foreground when maintaining students' privacy and well-being, especially in online settings. We outline an existing ethical decision-making framework and show how learning designers can use it as a call to action to protect the students they design for, strengthening their ethical design capacity.

Practitioner notes

What is already known about this topic

• Existing codes of ethical standards from well-known learning design organizations call upon learning designers to protect students' privacy without clear guidance on how to do so.
• Design ethics within learning design is often discussed in abstract ways with principles that are difficult to apply.
• Most, if not all, design models that learning design professionals have learned are either silent on design ethics and/or do not consider ethics as a valid dimension, thus, making design ethics mostly excluded from learning design graduate programs.
• Practical means for engaging in ethical design practice are scarce in the field.

What this paper adds

• A call for learning designers in higher education to maintain and protect students' privacy and well-being, strengthening their ethical design capacity.
• A demonstration of how to use a practical ethical decision-making framework as a designerly tool in designing for learning to maintain and protect students' privacy and well-being.
• Authentic examples—in the form of vignettes—of ethical dilemmas/issues that learning designers in higher education could face, focused on students' privacy.
• Methods—using a practical ethical decision-making framework—for learning design professionals in higher education, grounded in the philosophy of designers as the guarantors of designs, to be employed to detect situations where students' privacy and best interests are at risk.
• A demonstration of how learning designers could make stellar design decisions in service to the students they design for and not to the priorities of other design stakeholders.

Implications for practice and/or policy

• Higher education programs/institutions that prepare/employ learning designers ought to treat the topics of the designer's responsibility and design ethics more explicitly and practically as one of the means to maintain and protect students' privacy, in addition to law and policies.
• Learning designers in higher education ought to hold a powerful position in their professional practice to maintain and protect students' privacy and well-being, as an important aspect of their ethical design responsibilities.
• Learning designers in higher education ought to adopt a design thinking mindset in order to protect students' privacy by (1) challenging ideas and assumptions regarding technology integration in general and (2) detecting what is known in User Experience (UX) design as “dark patterns” in online course design.

     

Comprehension in disciplinary learning: An examination of elementary readers' processing and recall

The authors explored elementary students' comprehension of informational text in disciplinary learning. Forty on-grade-level readers in Grades 2–5 participated. A priori and emergent coding was used to analyze 120 verbal protocols and 120 oral recalls. Analyses of variance and correlations showed students' processing and recall of procedural text contrasted with their processing and recall of biography or persuasive text. Also, second-grade students did not process informational text as actively or recall informational text as well as third- through fifth-grade students did. An expanded focus on students' comprehension of informational text in disciplinary learning and further study of the relationships among students' text use, text processing and recall, and development are warranted.     

A mixed methods approach to the assessor's targeting behavior during online peer assessment: effects of anonymity and underlying reasons

This study examined the effects of identity revelation and concealment on the number of times students' work was assessed in an online peer assessment context. It also examined the underlying reasons guiding the assessor's targeting behavior. Two fifth-grade classes participated. The one-group pretest–posttest experimental research design coupled with qualitative research method was adopted. The results from social network analysis (SNA) showed a high redundancy rate for both high- and low-targeted assessees in identity-revealed and identity-concealed conditions for both classes. Moreover, the density metrics indicated that all sociograms were similarly sparse. The Wilcoxon tests further confirmed that there were no significant differences in the assessees' ranking in the two conditions for both classes. Finally, analysis of students' self-reflective data revealed that the features/content of the work to be assessed, rather than who the question-author was, was the determining factor when it came to deciding the target for online peer assessment.     

An online adaptive learning environment for critical‐thinking‐infused English literacy instruction

Critical thinking (CT) and English literacy are two essential 21st century competencies that are a priority for teaching and learning in an increasingly digital learning environment. Taking advantage of innovations in educational technology, this study empirically investigates the effectiveness of CT‐infused adaptive English literacy instruction using a Moodle system. A one‐group pretest–posttest design was employed to evaluate the effect of the treatment on students' acquisition of CT skills (CTS) and English literacy. A total of 83 students enrolled in two sections of a general studies course at a large university in Taiwan participated in the semester‐long experiment. Adaptive learning was achieved through the use of an online Moodle system for (1) online grouping (based on pretest English literacy scores), (2) delivery of specifically designed adaptive learning materials for each group and (3) provision of individualised feedback. CT‐infused language activities based on social constructivist principles were designed for each level of adaptive instruction, whereas direct instruction for fostering CTS was provided in class and practiced or reflected upon in groups. Empirical results demonstrate that CT‐enhanced adaptive English literacy instruction simultaneously improved students' CTS and English literacy and that students' online discussions developed towards higher levels of interaction. This paper illustrates an effective blended learning model for adaptive instruction and offers recommendations for designing CT‐infused language learning activities that can successfully foster both CT and English literacy outcomes.