Identifying patterns of students' performance on simulated inquiry tasks using PISA 2015 log-file data

Previous research has demonstrated the potential of examining log-file data from computer-based assessments to understand student interactions with complex inquiry tasks. Rather than solely providing information about what has been achieved or the accuracy of student responses (product data), students' log files offer additional insights into how the responses were produced (process data). In this study, we examined students' log files to detect patterns of students' interactions with computer-based assessment and to determine whether unique characteristics of these interactions emerge as distinct profiles of inquiry performance. Knowledge about the characteristics of these profiles can shed light on why some students are more successful at solving simulated inquiry tasks than others and how to support student understanding of scientific inquiry through computer-based environments. We analyzed the Norwegian PISA 2015 log-file data, science performance as well as background questionnaire (N = 1,222 students) by focusing on two inquiry tasks, which required scientific reasoning skills: coordinating the effects of multiple variables and coordinating theory and evidence. Using a mixture modeling approach, we identified three distinct profiles of students' inquiry performance: strategic, emergent, and disengaged. These profiles revealed different characteristics of students' exploration behavior, inquiry strategy, time-on-task, and item accuracy. Further analyses showed that students' assignment to these profiles varied according to their demographic characteristics (gender, socio-economic status, and language at home), attitudes (enjoyment in science, self-efficacy, and test anxiety), and science achievement. Although students' profiles on the two inquiry tasks were significantly related, we also found some variations in the proportion of students' transitions between profiles. Our study contributes to understanding how students interact with complex simulated inquiry tasks and showcases how log-file data from PISA 2015 can aid this understanding.     

Knowledge Integration in Science Learning: Tracking Students' Knowledge Development and Skill Acquisition with Cognitive Diagnosis Models

In scientific literacy, knowledge integration (KI) is a scaffolding-based theory to assist students' scientific inquiry learning. To drive students to be self-directed, many courses have been developed based on KI framework. However, few efforts have been made to evaluate the outcome of students' learning under KI instruction. Moreover, finer-grained information has been pursued to better understand students' learning and how it progresses over time. In this article, a normative procedure of building and choosing cognitive diagnosis models (CDMs) and attribute hierarchies was formulated under KI theory. We examined the utility of CDMs for evaluating students' knowledge status in KI learning. The results of the data analysis confirmed an intuitive assumption of the hierarchical structure of KI components. Furthermore, analysis of pre- and posttests using a higher-order, hidden Markov model tracked students' skill acquisition while integrating knowledge. Results showed that students make significant progress after using the web-based inquiry science environment (WISE) platform.     

Prediction of the science inquiry skill of seventeen-year-olds: A test of the model of educational productivity

The study was designed to investigate the influence of student characteristics and classroom characteristics on students' inquiry skill. The sample consisted of a national stratified random sample of 1955 17-year-olds who were assessed as part of the 1981-1982 national assessment in science. The dependent variable was a 17-item measure of students' inquiry skill. The independent variables were selected from the available data using the Model of Educational Productivity as a guide in the selection of the variables. The first purpose of the study was to test the effectiveness of the Model of Educational Productivity for predicting the inquiry skill of 17-year-olds. The results of this study indicate that this model was capable of accounting for between 24 and 32% of the variance in inquiry skill for the general population of 17-year-olds. More specifically, students' reporting of their general ability alone accounted for between 17 and 22% of the variance. The second question posed by this study asked whether the prediction of inquiry skill differed for males and females. While there was some difference in the contribution of the minor predictors, there was very little difference in the prediction of inquiry skill for males and females using the Model of Education Productivity. The third question posed by this study asked whether the prediction of inquiry skill differed for white and nonwhite students. For nonwhite students, the Model of Educational Productivity accounted for only 18% of the variance in science inquiry skill. Thus, it would appear that there is a great deal that is not known about the factors that contribute to the science inquiry skill of nonwhite students.     

Teacher epistemology and scientific inquiry in computerized classroom environments

A 20-week classroom-based study was conducted to investigate the extent to which a computerized learning environment could facilitate students' development of higher-level thinking skills associated with scientific inquiry. In two classes students' interactions with a scientific data base—Birds of Antarctica—were closely monitored, and the mediating roles of the teachers' epistemologies were examined. Interpretive data were generated and analyzed in relation to a constructivist perspective on learning. In the class where the teacher implemented a constructivist-oriented pedagogy, students took advantage of enhanced opportunities to generate creative questions and conduct complex scientific investigations. These higher-level thinking skills were much less evident in the class in which a more transmissionist-oriented pedagogy prevailed. The results of the study suggest that it is not the computer itself that facilitates inquiry learning; the teacher's epistemology is a key mediating influence on students' use of the computer as a tool of scientific inquiry.     

A systematic review of empirical studies using log data from open-ended learning environments to measure science and engineering practices

Technology-based, open-ended learning environments (OELEs) can capture detailed information of students' interactions as they work through a task or solve a problem embedded in the environment. This information, in the form of log data, has the potential to provide important insights about the practices adopted by students for scientific inquiry and problem solving. How to parse and analyse the log data to reveal evidence of multifaceted constructs like inquiry and problem solving holds the key to making interactive learning environments useful for assessing students' higher-order competencies. In this paper, we present a systematic review of studies that used log data generated in OELEs to describe, model and assess scientific inquiry and problem solving. We identify and analyse 70 conference proceedings and journal papers published between 2012 and 2021. Our results reveal large variations in OELE and task characteristics, approaches used to extract features from log data and interpretation models used to link features to target constructs. While the educational data mining and learning analytics communities have made progress in leveraging log data to model inquiry and problem solving, multiple barriers still exist to hamper the production of representative, reproducible and generalizable results. Based on the trends identified, we lay out a set of recommendations pertaining to key aspects of the workflow that we believe will help the field develop more systematic approaches to designing and using OELEs for studying how students engage in inquiry and problem-solving practices.

Practitioner notes

What is already known about this topic

• Research has shown that technology-based, open-ended learning environments (OELEs) that collect users' interaction data are potentially useful tools for engaging students in practice-based STEM learning.
• More work is needed to identify generalizable principles of how to design OELE tasks to support student learning and how to analyse the log data to assess student performance.

What this paper adds

• We identified multiple barriers to the production of sufficiently generalizable and robust results to inform practice, with respect to: (1) the design characteristics of the OELE-based tasks, (2) the target competencies measured, (3) the approaches and techniques used to extract features from log files and (4) the models used to link features to the competencies.
• Based on this analysis, we can provide a series of specific recommendations to inform future research and facilitate the generalizability and interpretability of results:
  • Making the data available in open-access repositories, similar to the PISA tasks, for easy access and sharing.
  • Defining target practices more precisely to better align task design with target practices and to facilitate between-study comparisons.
  • More systematic evaluation of OELE and task designs to improve the psychometric properties of OELE-based measurement tasks and analysis processes.
  • Focusing more on internal and external validation of both feature generation processes and statistical models, for example with data from different samples or by systematically varying the analysis methods.

Implications for practice and/or policy

• Using the framework of evidence-centered assessment design, we have identified relevant criteria for organizing and evaluating the diverse body of empirical studies on the topic and that policy makers and practitioners can use for their own further examinations.
• This paper identifies promising research and development areas on the measurement and assessment of higher-order constructs with process data from OELE-based tasks that government agencies and foundations can support.
• Researchers, technologists and assessment designers might find useful the insights and recommendations for how OELEs can enhance science assessment through thoughtful integration of learning theories, task design and data mining techniques.

     

Deepening Students' Scientific Inquiry Skills During a Science Museum Field Trip

Field trips to science museums can provide students with educational experiences, particularly when museum programs emphasize scientific inquiry skill building over content knowledge acquisition. We describe the creation and study of 2 programs designed to significantly enhance students' inquiry skills at any interactive science museum exhibit without the need for advanced preparation by teachers or chaperones. The programs, called Inquiry Games, utilized educational principles from the learning sciences and from visitor studies of museum field trips. A randomized experimental design compared 2 versions of the games to 2 control conditions. Results indicate that the groups that learned the Inquiry Games significantly outperformed the control groups in the duration and quality of several inquiry skills when using a novel exhibit, with effect sizes ranging from 0.3σ to 0.8σ. The highest gains came from an Inquiry Game that was structured and collaborative rather than spontaneous and individualized. Students and chaperones in all conditions reported enjoying the experience. These results mirror those found in a previous study in which family groups learned the Inquiry Games.     

Using text mining to uncover students' technology‐related problems in live video streaming

Because of their capacity to sift through large amounts of data, text mining and data mining are enabling higher education institutions to reveal valuable patterns in students' learning behaviours without having to resort to traditional survey methods. In an effort to uncover live video streaming (LVS) students' technology related‐problems and to improve their learning experience, we applied text mining to data culled from LVS interactions. Our findings revealed low LVS student participation, which triggered us to initiate several actions to promote more active student participation. Our findings support previous studies regarding the effectiveness of data mining in transforming raw educational data into knowledge and decision‐making tools.     

A framework for scaffolding students' assessment of the credibility of evidence

Assessing the credibility of evidence in complex, socio‐scientific problems is of paramount importance. However, there is little discussion in the science education literature on this topic and on how students can be supported in developing such skills. In this article, we describe an instructional design framework, which we call the Credibility Assessment Framework, to scaffold high school students' collaborative construction of evidence‐based decisions and their assessment of the credibility of evidence. The framework was employed for the design of a web‐based reflective inquiry environment on a socio‐scientific issue, and was enacted with 11th grade students. The article describes the components of the Credibility Assessment Framework and provides the details and results of an empirical study illustrating this framework in practice. The results are presented in the form of a case study of how 11th grade students investigated and evaluated scientific data relating to the cultivation of genetically modified plants. Multiple kinds of data were collected, including pre‐ and post‐tests of students' conceptual understanding and their skills in assessing the credibility of evidence, and videotapes of students' collaborative inquiry sessions. The analysis of the pre‐ and post‐tests on students' conceptual understanding of Biotechnology and their skills in assessing the credibility of evidence revealed statistically significant learning gains. Students' work in task‐related artifacts and the analysis of two groups' videotaped discussions showed that students became sensitive to credibility criteria, questioned the sources of data and correctly identified sources of low, moderate, and high credibility. Implications for designers and educators regarding the application of this framework are discussed. © 2011 Wiley Periodicals, Inc. J Res Sci Teach 48: 711–744, 2011     

Testing one premise of scientific inquiry in science classrooms: Examining students' scientific explanations and student learning

In this study, we analyzed the quality of students' written scientific explanations found in notebooks and explored the link between the quality of the explanations and students' learning. We propose an approach to systematically analyzing and scoring the quality of students' explanations based on three components: claim, evidence to support it, and a reasoning that justifies the link between the claim and the evidence. We collected students' science notebooks from eight science inquiry‐based middle‐school classrooms in five states. All classrooms implemented the same scientific‐inquiry based curriculum. The study focuses on one of the implemented investigations and the students' explanations that resulted from it. Nine students' notebooks were selected within each classroom. Therefore, a total of 72 students' notebooks were analyzed and scored using the proposed approach. Quality of students' explanations was linked with students' performance in different types of assessments administered as the end‐of‐unit test: multiple‐choice test, predict‐observe‐explain, performance assessment, and a short open‐ended question. Results indicated that: (a) Students' written explanations can be reliably scored with the proposed approach. (b) Constructing explanations were not widely implemented in the classrooms studied despite its significance in the context of inquiry‐based science instruction. (c) Overall, a low percentage of students (18%) provided explanations with the three expected components. The majority of the sample (40%) provided only claims without any supporting data or reasoning. And (d) the magnitude of the correlations between students' quality of explanations and their performance, were all positive but varied in magnitude according to the type of assessment. We concluded that engaging students in the construction of high quality explanations may be related to higher levels of student performance. The opportunities to construct explanations in science‐inquiry based classrooms, however, seem to be limited. © 2010 Wiley Periodicals, Inc. J Res Sci Teach 47: 583–608, 2010     

Reflections on and implications of the Programme for International Student Assessment 2015 (PISA 2015) performance of students in Taiwan: The role of epistemic beliefs about science in scientific literacy

The 2015 Programme for International Student Assessment (PISA) has drawn a substantial amount of attention from science educators and educational policymakers because it marked the first time that PISA assessed students' ability to evaluate and design scientific inquiry using computer-based simulations. We undertook a secondary analysis of the PISA 2015 Taiwan dataset of 7,973 students from 214 schools to identify critical issues of student learning and potentially reshape our educational system and policies. Thus, this study sought to identify potential latent clusters of students' scientific literacy performance according to a set of focus variables selected from the PISA student questionnaires. In addition, significant determinants of students' scientific literacy and resiliency were analyzed. Cluster analysis results demonstrated the presence of four clusters of high, medium, low, and inferior scientific literacy/epistemology/affective dispositions. Specifically, students in cluster 1 compared with other clusters showed that the higher the scientific literacy scores are, the more positive epistemic beliefs about science, achievement motivation, enjoyment of science, interests in broad science, science self-efficacy, information and communications technology (ICT) interest, ICT autonomy, more learning time, more teacher supports and teacher-directed instructions are. Regression results indicated that the most robust predictor of students' scientific literacy performance is epistemic beliefs about science, followed by learning time, interest in broad science topics, achievement motivation, inquiry-based science teaching and learning practice, and science self-efficacy. Decision tree model results showed that the descending order of the variables in terms of their importance in differentiating students as high- versus low-performing were epistemic beliefs about science, learning time, self-efficacy, interest in broad science, and scientific inquiry, respectively. A similar decision tree model to determine students as resilient versus non-resilient also was found. Various interpretations of these results are discussed, as are their implications for science education research, science teaching, and science education policy.     

Inquiry Learning in the Singaporean Context: Factors affecting student interest in school science

Recent research reveals that students' interest in school science begins to decline at an early age. As this lack of interest could result in fewer individuals qualified for scientific careers and a population unprepared to engage with scientific societal issues, it is imperative to investigate ways in which interest in school science can be increased. Studies have suggested that inquiry learning is one way to increase interest in science. Inquiry learning forms the core of the primary syllabus in Singapore; as such, we examine how inquiry practices may shape students' perceptions of science and school science. This study investigates how classroom inquiry activities relate to students' interest in school science. Data were collected from 425 grade 4 students who responded to a questionnaire and 27 students who participated in follow-up focus group interviews conducted in 14 classrooms in Singapore. Results indicate that students have a high interest in science class. Additionally, self-efficacy and leisure-time science activities, but not gender, were significantly associated with an increased interest in school science. Interestingly, while hands-on activities are viewed as fun and interesting, connecting learning to real-life and discussing ideas with their peers had a greater relation to student interest in school science. These findings suggest that inquiry learning can increase Singaporean students' interest in school science; however, simply engaging students in hands-on activities is insufficient. Instead, student interest may be increased by ensuring that classroom activities emphasize the everyday applications of science and allow for peer discussion.     

Analyzing Learning About Conservation of Matter in Students While Adapting to the Needs of a School

We probed the impact of two teaching strategies, guided inquiry and argumentation, on students' conceptual understanding of the conservation of matter. Conservation of matter is a central concept in middle school science curriculum and a prerequisite upon which rests more complex constructs in chemistry. The results indicate that guided inquiry was particularly effective in improving students' conceptual understanding, as evidenced by pre/posttest results and by a skill analysis of in-depth interviews of student dyads. We also discuss how the challenges inherent to educational contexts can undermine the quality and limit the impact of empirical research carried out in many schools. We suggest how these challenges could be met in the emerging infrastructures for change called the Research Schools Network.     

Teachers' Spatial Anxiety Relates to 1st‐ and 2nd‐Graders' Spatial Learning

Teachers' anxiety about an academic domain, such as math, can impact students' learning in that domain. We asked whether this relation held in the domain of spatial skill, given the importance of spatial skill for success in math and science and its malleability at a young age. We measured 1st‐ and 2nd‐grade teachers' spatial anxiety (N = 19) and students' spatial skill (N = 132). Teachers' spatial anxiety significantly predicted students' end‐of‐year spatial skill, even after accounting for students' beginning‐of‐year spatial skill, phonological working memory, grade level, and teachers' math anxiety. Since spatial skill is not a stand‐alone part of the curriculum like math or reading, teachers with high levels of spatial anxiety may simply avoid incorporating spatial activities in the classroom. Results suggest that addressing teachers' spatial anxieties may improve spatial learning in early elementary school.     

Assessing students’ ability in performing scientific inquiry: instruments for measuring science skills in primary education

Background With the increased attention on the implementation of inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has thus far been concerned with the limitations and advantages of different test formats to assess students’ science skills.

Purpose This study explores the construction of different instruments for measuring science skills by categorizing items systematically on three subskill levels (science-specific, thinking, metacognition) as well as on different steps of the empirical cycle.

Sample The study included 128 fifth and sixth grade students from seven primary schools in the Netherlands.

Design and method Seven measures were used: a paper-and-pencil test (PPT), three performance assessments, two metacognitive self-report tests, and a test used as an indication of general cognitive ability.

Results Reliabilities of all tests indicate sufficient internal consistency. Positive correlations between the PPT and the three performance assessments show that the different tests measure a common core of similar skills thus providing evidence for convergent validity. Results also show that students’ ability to perform scientific inquiry is significantly related to general cognitive ability. No relationship was found between the measure of general metacognitive ability and either the PPT or the three performance assessments. By contrast, the metacognitive self-report test constructed to obtain information about the application of metacognitive abilities in performing scientific inquiry, shows significant – although small – correlations with two of the performance assessments. Further explorations reveal sufficient scale reliabilities on subskill and step level.

Conclusions The present study shows that science skills can be measured reliably by categorizing items on subskill and step level. Additional diagnostic information can be obtained by examining mean scores on both subskill and step level. Such measures are not only suitable for assessing students’ mastery of science skills but can also provide teachers with diagnostic information to adapt their instructions and foster the learning process of their students.     

The Parallels Between Philosophical Inquiry and Scientific Inquiry: Implications for science education

The ‘community of inquiry’ as formulated by C. S. Peirce is grounded in the notion of communities of discipline‐based inquiry engaged in the construction of knowledge. The phrase ‘transforming the classroom into a community of inquiry’ is commonly understood as a pedagogical activity with a philosophical focus to guide classroom discussion. But it has a broader application. Integral to the method of the community of inquiry is the ability of the classroom teacher to actively engage in the theories and practices of discipline‐based communities of inquiry so as to become informed by the norms of the disciplines, not only to aspire to competence within the disciplines, but also to develop habits of self‐correction for reconstructing those same norms when faced with novel problems and solutions, including those in the classroom. This has implications for science education and the role of educational philosophy in developing students' ability to think scientifically. But it also has broader implications for thinking critically within all key learning areas. Here we concentrate on science education. We present the parallels between philosophical inquiry and scientific inquiry that need to be realised to promote and engage with scientific inquiry in the classroom. We also discuss the conflicts between philosophical inquiry and the way inquiry science in the classroom is portrayed in the education literature. Based on philosophical and historical perceptions of science as inquiry, a practical approach to implementation of scientific inquiry in the science classroom is presented.     

Reading and writing to learn science: Achieving scientific literacy

A key step in helping students to achieve scientific literacy is to ensure that each school's curriculum supports students' efforts to learn science meaningfully. Educational researchers play a vital role in this step by providing teachers, teacher educators, administrators, and policy makers with information about the creation of a curriculum that supports scientific literacy. In a scientific literacy curriculum, reading and writing can serve as dynamic vehicles for learning science meaningfully. The task of educational researchers is to show how reading and writing can be used most effectively to support science learning. Much of what is done now in schools is based on teacher intuition—good intuition—but intuition nonetheless. What is needed is school-based research to validate and build upon these intuitions. This article is intended to stimulate research on reading and writing to learn science.     

Identification,Interpretation—Evaluation,Response: An alternative framework for analyzing teacher discourse in science

Although research has come to recognize the importance of studying classroom-based student–teacher discourse in science, the emphasis remains largely on teachers' abilities to ask questions and provide students with feedback, or on students' abilities to ask questions or engage in argumentative discourse. Consequently, little research has focused on the discourse elements relating to teacher–student discourse interactions. In this article, we argue for a shift of research attention toward describing what the teacher is responding to (Identification of student inquiry), the process of deciding how to respond (Interpretation—Evaluation of student inquiry), and how the teacher is responding (Response to student inquiry). We propose a new methodological approach for studying teacher discourse, which involves a framework we developed while analyzing 1,385 minutes of fifth grade, whole-class science conversations covering a 2-year period and facilitated by an experienced science teacher. Then, as a case in point, we applied our framework to the teacher discourse data of the study, aiming to show that the framework can be a useful tool for examining how a teacher supports students' inquiry.     

Analytics-supported reflective assessment for 6th graders' knowledge building and data science practices: An exploratory study

Preparing data-literate citizens and supporting future generations to effectively work with data is challenging. Engaging students in Knowledge Building (KB) may be a promising way to respond to this challenge because it requires students to reflect on and direct their inquiry with the support of data. Informed by previous studies, this research explored how an analytics-supported reflective assessment (AsRA)-enhanced KB design influenced 6th graders' KB and data science practices in a science education setting. One intact class with 56 students participated in this study. The analysis of students' Knowledge Forum discourse showed the positive influences of the AsRA-enhanced KB design on students' development of KB and data science practices. Further analysis of different-performing groups revealed that the AsRA-enhanced KB design was accessible to all performing groups. These findings have important implications for teachers and researchers who aim to develop students' KB and data science practices, and general high-level collaborative inquiry skills.

Practitioner notes

What is already known about this topic

• Data use becomes increasingly important in the K-12 educational context.
• Little is known about how to scaffold students to develop data science practices.
• Knowledge Building (KB) and learning analytics-supported reflective assessment (AsRA) show premises in developing these practices.

What this paper adds

• AsRA-enhanced KB can help students improve KB and data science practices over time.
• AsRA-enhanced KB design benefits students of different-performing groups.
• AsRA-enhanced KB is accessible to elementary school students in science education.

Implications for practice and/or policy

• Developing a collaborative and reflective culture helps students engage in collaborative inquiry.
• Pedagogical approaches and analytic tools can be developed to support students' data-driven decision-making in inquiry learning.

     

Knowing When You've Brought Them in: Scientific Genre Knowledge and Communities of Practice

Increasingly, researchers in the learning sciences are appealing to notions of community to shape the design of learning technologies and curricular innovations. Many of these designs, including those in the area of project-based science, show strong promise; but, it is a challenging matter to understand the influences of these innovations in a detailed enough fashion to refine them over time. This work demands sensitive, theoretically grounded ways to assess the depth to which particular facets of innovations help enculturate students into communities of discourse and practice. Taking genre theory and the sociology of science as points of departure, I demonstrate a unique approach to the problems of developing and assessing students' understanding of persuasive practices in the scientific community. The research I discuss revolves around students' use of a professional scientific genre of scientific writing, the Research Article or Introduction, Methods, Results, Discission (IMRD) report (Swales, 1990), as they compose reports about their own original research. Using data from an innovative project-based high school science class, I demonstrate how genre use provides a window on the effectiveness of a learning environment in helping use discipline-specific tools of persuasion. In the classroom studied here, students developed e-mail mentoring relationships with volunteer scientists across the United States and Canada. Working in partnership with the teacher, these "telementors" served not only as inquiry guides for students, but also as a critical audience that helped shape the arguments they made about their research. Detailed analysis of the final reports produced by teams of students in the class revealed a significant relation between their fulfillment of the customary persuasive functions of a scientific research article and sustained correspondence with their telementors. A significant relation was also observed between sustained dialogue with telementors and careful hedging of knowledge claims. I situate these findings within a body of theory that suggests the value of telementoring relationships consists not only the ongoing advice and guidance they furnish, but in the ways that a professional audience shapes students' ideas about the sorts of arguments that are called for in science class. Because the analysis of genre use is a relatively noninvasive way to examine students' understandings of scientific persuasion (as compared with survey instruments or pull-out interviews), this method can serve as a useful tool for reformers wishing to compare the outcomes from iterations or conditions of design experiments that aim to develop students' understanding of persuasive practices in the scientific community. It may also make a useful transfer measure for a wide range of classroom innovations that aim to cultivate scientific reasoning and persuasion, such as science-oriented tools for computer-supported collaborative learning.     

The Nature of Scientific Explanation: Examining the perceptions of the nature,quality, and “goodness” of explanation among college students,science teachers,and scientists

Issues regarding scientific explanation have been of interest to philosophers from Pre-Socratic times. The notion of scientific explanation is of interest not only to philosophers, but also to science educators as is clearly evident in the emphasis given to K-12 students' construction of explanations in current national science education reform efforts. Nonetheless, there is a dearth of research on conceptualizing explanation in science education. Using a philosophically guided framework—the Nature of Scientific Explanation (NOSE) framework—the study aims to elucidate and compare college freshmen science students', secondary science teachers', and practicing scientists' scientific explanations and their views of scientific explanations. In particular, this study aims to: (1) analyze students', teachers', and scientists' scientific explanations; (2) explore the nuances about how freshman students, science teachers, and practicing scientists construct explanations; and (3) elucidate the criteria that participants use in analyzing scientific explanations. In two separate interviews, participants first constructed explanations of everyday scientific phenomena and then provided feedback on the explanations constructed by other participants. Major findings showed that, when analyzed using NOSE framework, participant scientists did significantly “better” than teachers and students. Our analysis revealed that scientists, teachers, and students share a lot of similarities in how they construct their explanations in science. However, they differ in some key dimensions. The present study highlighted the need articulated by many researchers in science education to understand additional aspects specific to scientific explanation. The present findings provide an initial analytical framework for examining students' and science teachers' scientific explanations.