An assessment of the validity and discrimination of the intensive time-series design by monitoring learning differences between students with different cognitive tendencies

Intensive time-series designs for classroom investigations have been under development since 1975. Studies have been conducted to determine their feasibility (Mayer & Lewis, 1979), their potential for monitoring knowledge acquisition (Mayer & Kozlow, 1980), and the potential threat to validity of the frequency of testing inherent in the design (Mayer & Rojas, 1982). This study, an extension of those previous studies, is an attempt to determine the degree of discrimination the design allows in collecting data on achievement. It also serves as a replication of the Mayer and Kozlow study, an attempt to determine design validity for collecting achievement data. The investigator used her eighth-grade earth science students, from a suburban Columbus (Ohio) junior high school. A multiple-group single intervention time-series design (Glass, Willson, & Gottman, 1975) was adapted to the collection of daily data on achievement in the topic of the intervention, a unit on plate tectonics. Single multiple-choice items were randomly assigned to each of three groups of students, identified on the basis of their ranking on a written test of cognitive level (Lawson, 1978). The top third, or those with formal cognitive tendencies, were compared on the basis of knowledge achievement and understanding achievement with the lowest third of the students, or those with concrete cognitive tendencies, to determine if the data collected in the design would discriminate between the two groups. Several studies (Goodstein & Howe, 1978; Lawson & Renner, 1975) indicated that students with formal cognitive tendencies should learn a formal concept such as plate tectonics with greater understanding than should students with concrete cognitive tendencies. Analyses used were a comparison of regression lines in each of the three study stages: baseline, intervention, and follow-up; t-tests of means of days summed across each stage; and a time-series analysis program. Statistically significant differences were found between the two groups both in slopes of regression lines (0.0001) and in t-tests (0.0005) on both knowledge and understanding levels of learning. These differences confirm the discrimination of the intensive time-series design in showing that it can distinguish differences in learning between students with formal cognitive tendencies and those with concrete cognitive tendencies. The time-series analysis model with a trend in the intervention was better than a model with no trend for both groups of students, in that it accounted for a greater amount of variance in the data from both knowledge and understanding levels of learning. This finding adds additional confidence in the validity of the design for obtaining achievement data. When the analysis model with trend was used on data from the group with formal cognitive tendencies, it accounted for a greater degree of variance than the same model applied to the data from the group with concrete cognitive tendencies. This more conservative analysis, therefor, gave results consistent with those from the more usual linear regression techniques and t-tests, further adding to the confidence in the discrimination of the design.     

Project-based geometry learning: Knowledge and attitude of field-dependent/independent cognitive style students

The authors in a convergent parallel mixed method design aimed to investigate whether and how the geometry knowledge and attitude toward geometry of students with field-dependent/independent cognitive style improve differentially within a project-based learning environment. Quantitative data were collected from 97 seventh-grade students before and after the treatment. Repeated measures multivariate analysis of covariance results, controlling for gender and prior mathematics achievement, revealed a statistically significant main effect of time but not cognitive style. Follow-up repeated measures analysis of covariance by controlling the experiment-wise alpha level indicated that field-dependent, field-mixed, and field-independent students achieved a statistically significant mean increase for all measures. The qualitative (classroom observations and interviews with some students) data provided evidence that contextualizing, visualizing, and collaborating opportunities in the project-based learning environment made contributions for mean increase.     

Mathematics achievement and mathematics learning strategies: Cognitive competencies and construct differentiation

Responding to a survey requires cognitive abilities similar to those for any other linguistic task. We argue that, when faced with a cognitively challenging task, individuals respond by simplifying the task, declining it, or performing it poorly. Using the 2003 Program for International Student Assessment (PISA 2003) data sets, we document that the extent of construct differentiation in students’ mathematics learning strategies is strongly associated with their level of mathematics achievement. Likewise, the higher the level of mathematics achievement, the lower is the probability of a non-response to the mathematics learning strategy questions. Finally, the higher the students’ level of mathematics achievement, the more varied were their responses to the learning strategies items. These associations were examined across 40 participating countries.     

Aptitude treatment effects of laboratory grouping method for students of differing reasoning ability

This study examines aptitude treatment effects in an inquiry/learning cycle based physical science class for elementary education majors. The aptitude was formal reasoning ability and the students were arranged into three groups: high, middle, and low ability reasoners. The treatment was method of forming groups to work in the laboratory. Students in each of three classes were grouped according to reasoning ability. In one class the laboratory groups were homogeneous, i.e., students of similar reasoning ability were grouped together. In the second class the students were grouped heterogeneously, i.e., students of different reasoning ability were grouped together. In the third class, the student choice pattern, the students chose their own partners. The findings were that there were no aptitude treatment interaction for achievement or for gain in formal reasoning ability, that grouping students of similar cognitive ability together for laboratory work in the class was more effective in terms of science achievement than grouping students of differing cognitive ability together or than allowing students to choose their own partners, and that students at different levels of reasoning ability experienced differential gains in that ability over the semester.     

Effects of cognitive learning strategies for Korean learners: A meta-analysis

The purpose of this study was to synthesize the cognitive learning strategy intervention studies conducted in Korea between 1990 and 2006, using meta-analysis. By means of pre-established systematic criteria, 50 articles were selected and 97 effect sizes were calculated. Effect size was calculated using ‘the Cohen’s d’ (Cooper &; Hedges, 1994). The research questions of the present study were as follows: (a) Are cognitive learning strategies generally effective? (b) What type of cognitive learning strategy is most effective? (c) Are effect sizes of different types of cognitive learning strategies different according to the applied domains, grade levels, and achievement levels? The results of the study indicate that, first of all, the overall cognitive learning strategies (97 ESs) yielded a large effect size (ESsm=.96), which was not homogenous (Q=55.19,p <.05). Thus, in each subcategory of learners’ characteristics and applied domains, we calculated effect sizes and conducted the test of homogeneity separately. Except for grade level, the effect sizes were generally homogenous in each subcategory. The findings revealed that cognitive strategies had large effect sizes (.82–1.69). For average achieving students as well as underachieving students (Learning Disabilities), cognitive learning strategies were very effective (.82–1.42). The effect of cognitive learning strategies was very large in terms of students in all grades (1.02–1.34), except for middle school students (.70). Lastly, the implications for the application of different cognitive learning strategies were discussed.     

A nationwide epidemiologic modeling study of LD: risk, protection, and unintended impact

Through multiple logistic regression modeling, this article explores the relative importance of risk and protective factors associated with learning disabilities (LD). A representative national sample of 6- to 17-year-old students (N = 1,268) was drawn by random stratification and classified by the presence versus absence of LD in reading, spelling, and mathematics according to ability-achievement discrepancies or low achievement levels. The dichotomous classifications were regressed on sets of explanatory variables indicating potential biological, social-environmental, and cognitive factors, problem behavior, and classroom learning behavior. Modeling revealed patterns of high risk for male students and students evincing verbal and nonverbal ability problems and processing speed problems. It was shown that, absent controls for cognitive abilities (such as provided by the ability-achievement discrepancy definition), definitions keyed to low achievement will substantially overidentify ethnic minority and disadvantaged students and will be confounded by significantly higher proportions of students who display oppositional and aggressive behavior problems. Alternatively, good learning behaviors uniformly provide substantial reduction in the risk for LD.     

Learner presence,perception, and learning achievements in augmented–reality–mediated learning environments

Although research has indicated that augmented reality (AR)–facilitated instruction improves learning performance, further investigation of the usefulness of AR from a psychological perspective has been recommended. Researchers consider presence a major psychological effect when users are immersed in virtual reality environments. However, most research on learner presence has focused on measuring it rather than the factors influencing it. This study explored the relationship between learner perception and presence in an AR-facilitated learning environment. A game-type AR learning process was developed and an experiment was implemented employing a one-group pretest–posttest method. Three sets of research instruments were developed, comprising a learning achievement test, a learner's presence inventory, and a questionnaire on learners’ perception of the AR-mediated environment. A total of 60 validated data samples were collected and statistically analysed. The researchers determined that learner presence closely relates to learning achievement and AR learning perception. These results indicate that a more satisfactory AR perception leads to a higher level of learner presence in the AR environment, thereby resulting in more beneficial learning outcomes.     

Mathematics before formal schooling

This article is concerned with the learning of mathematics before the commencement of formal schooling. The experiences of two students are described. Four main sets of data were gathered: formal and informal measures of mathematics achievement, the learning environment in the home, and observations during teacher-led sessions concerned with mathematical concepts delivered as part of the regular pre-school program. Particular attention was focused on the nature and quality of the students' interactions with their teacher during these sessions.     

A report of cognitive, academic, and linguistic profiles for college students with and without learning disabilities

A comparison of cognitive, academic, and linguistic profiles for 74 college students with learning disabilities and 37 college students without learning disabilities resulted in significant differences in achievement for reading, writing, listening, and speaking. No significant differences were found for gender or the presence of a Verbal-Performance split in cognitive ability. Instruments for measuring academic and linguistic skills were similar in their ability to classify students with and without learning disabilities. These findings support the importance of using measures of multidimensional attributes, including language, for making decisions concerning the criteria for learning disabilities.     

Relationships between motivational strategies and cognitive learning in distance education courses

This study examines the relationships between students’ academic levels, the use of motivational regulation strategies, and cognitive learning strategies. A total of 141 undergraduate and graduate students enrolled in online distance courses participated in the study. The findings show that students use different motivational regulation strategies and cognitive learning strategies depending on their academic levels. Additionally, hierarchical regression analyses using two dependent variables (i.e., surface level learning strategy and deep processing level learning strategy) indicate that a surface level learning strategy (i.e., rehearsal) and deep processing level strategies (i.e., elaboration, organization, and critical thinking) are predicted by different sets of motivational regulation strategies after controlling for academic level and age. The results provide distance educators and instructional designers with practical suggestions on how to support undergraduate and graduate students’ motivational needs and further promote their use of cognitive learning strategies in online distance education programs in higher education.     

Particulate pollution and learning

Exposure to PM2.5 pollution is detrimental to health and cognitive function, and at early ages, inhibits learning. Using standardized achievement data at the school-district-grade level for 3rd- through 8th-grade students for the entire United States from 2009–2016, we show that variation in ambient PM2.5 concentrations and particularly polluted days reduce student learning. For a school district at the 90th percentile of PM2.5 concentrations we find an approximate 7.5% of a standard deviation reduction in achievement due to pollution. We further find that cumulative and year-round exposure matters in determining the full effect of PM2.5 on student learning, and that younger students in particular are harmed. Our results provide external validity to the received literature that has been limited in its geographic scope.     

Accelerating the development of formal thinking in middle and high school students II: Postproject effects on science achievement

A one-year lag was found between the effect of an intervention intended to promote formal operational thinking in students initially 11 or 12 years of age and the appearance of substantial science achievement in the experimental groups. A one-year lag was also reported on cognitive development: Whereas at the end of the two-year intervention the experimental groups were up to 0.9σ ahead of the control groups, one year later the differential on Piagetian measures had disappeared, but the experimentals now showed better science achievement of even greater magnitude. Although the control groups showed normal distribution both on science achievement and cognitive development, the experimental groups showed bi- or trimodal distribution. Between one-half and one-quarter of the students involved in the experiment in different groups showed effects of the order of 2σ both on cognitive development and science achievement; some students appeared unaffected (compared with the controls), and others demonstrated modest effects on science achievement. An age/gender interaction is reported: the most substantial effects were found in boys initially aged 12+ and girls initially 11+. The only group to show no effects was boys initially aged 11+. It is suggested that the intervention methods may have favored the abstract analytical learning style as described by Cohen 1986.     

Formal reasoning performance of higher secondary school students: Theoretical and educational implications

The study investigated the structure and development of formal thought among tenth-, eleventh-, and twelfth-grade students. The subjects of the study were the total numbers of students attending the science, the economic, and the other sections of two higher secondary schools. Students' performance on a standardized Test of Logical Thinking (TOLT) was used as a measure of their cognitive abilities related to control of variables, proportional, probabilistic, correlational, and combinatorial reasoning. Students attending the different sections of study had significantly different TOLT performance, older students exhibited significantly better TOLT performance than younger ones, and boys performed significantly better on TOLT than girls did. The “rate” of development was, however, different for different reasoning modes and differences in school achievement between boys and girls did not tap differences in TOLT performance. Regression analysis showed that section of study, gender, grade level, and measures of school achievement contributed significantly to the prediction of TOLT performance. Factor analysis of performance on the ten TOLT items (two items from each reasoning mode) produced a two- and three-factor solution for the sample of boys and the sample of girls, respectively. The results indicate that different theoretical perspectives should be considered when evaluating cognitive development and that learning environments conducive to cognitive growth need to be designed and implemented.     

A meta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings?

One of the major conclusive results of the research on learning in formal learning settings of the past decades is that cooperative learning has shown to evoke clear positive effects on different variables. Therefore this meta-analysis has two principal aims. First, it tries to replicate, based on recent studies, the research about the main effects of cooperative learning on three categories of outcomes: achievement, attitudes and perceptions. The second aim is to address potential moderators of the effect of cooperative learning. In total, 65 articles met the criteria for inclusion: studies from 1995 onwards on cooperative learning in primary, secondary or tertiary education conducted in real-life classrooms. This meta-analysis reveals a positive effect of cooperative learning on achievement and attitudes. In the second part of the analysis, the method of cooperative learning, study domain, age level and culture were investigated as possible moderators for achievement. Results show that the study domain, the age level of the students and the culture in which the study took place are associated with variations in effect size.     

一带一路背景下南亚东南亚来华留学生学习动机对学业成绩的影响研究

对留学生的个人特征、学习动机与学业成绩进行比较分析,学习动机主要从学习成就、职业价值、社会取向成就、技能成就四方面进行调查研究。采用随机抽样的方法选取100名学生,利用SPSS 19.0对样本数据进行分析,结果表明:年级、年龄及性别对留学生的学习动机水平和学业成绩均无显著性影响;不同学科对学生学业成绩有一定影响;学业成绩与学习动机呈显著正相关,与职业价值动机相关程度最高;社会取向动机对学习动机水平相关程度最高;学习动机水平与学业成绩呈极显著正相关关系。同时,针对留学生的学习动机与学业成绩现状,提出针对性的建议。     

A comparison of concrete and formal science instruction upon science achievement and reasoning ability of sixth grade students

Several recent studies suggest concrete learners make greater gains in student achievement and in cognitive development when receiving concrete instruction than when receiving formal instruction. This study examined the effect of concrete and formal instruction upon reasoning and science achievement of sixth grade students. Four intact classes of sixth grade students were randomly selected into two treatment groups; concrete and formal. The treatments were patterned after the operational definitions published by Schneider and Renner (1980). Pretest and posttest measures were taken on the two dependent variables; reasoning, measured with Lawson's Classroom Test of Formal Reasoning, and science achievement, measured with seven teacher made tests covering the following units in a sixth grade general science curriculum: Chemistry, Physics, Earth Science, Cells, Plants, Animals, and Ecology. Analysis of covariance indicated significantly higher levels (better than 0.05 and in some cases 0.01) of performance in science achievement and cognitive development favoring the concrete instruction group and a significant gender effect favoring males.     

Does the design of learning outcomes matter from students’ perspective?

Learning outcomes have gained more attention in the development of higher education course unit programmes. This study sought to understand how the design of learning outcomes relates to students’ perceptions of their motivation, satisfaction, engagement and achievement of the learning outcomes. The learning outcomes from 78 course units were coded to reflect the level of cognitive demand according to Bloom’s Taxonomy and the attended students (n = 1329) were surveyed regarding their perceptions of their achievement of the learning outcomes. The results indicated that the lowest four levels of Bloom’s Taxonomy were most commonly used in the design of learning outcomes, the highest level was not used at all. The levels of learning outcomes related to students’ perceptions of their achievement of learning outcomes, motivation, satisfaction and engagement. The results demonstrated that students were more likely motivated, satisfied, engaged to achieving learning outcomes, which were designed at higher levels of cognitive demand.     

Scaffolding peer-assessment skills: Risk of interference with learning domain-specific skills?

Giving students complex learning tasks combined with peer-assessment tasks can impose a high cognitive load. Scaffolding has proven to reduce cognitive load during learning and improve accuracy on domain-specific tasks. This study investigated whether scaffolding has a similar, positive effect on the learning of peer-assessment tasks. We hypothesised that: (1) domain-specific scaffolding improves domain-specific accuracy and reduces time on task and perceived mental effort, and (2) peer-assessment scaffolding improves peer-assessment accuracy and reduces time on task and perceived mental effort. Additionally, we explored whether there was an interaction between domain-specific and peer-assessment scaffolding. In a 2x2 experiment with the factors domain-specific scaffolding (present, absent) and peer-assessment scaffolding (present, absent), 236 secondary school students assessed the performance of fictitious peers in an electronic learning environment. We found that domain-specific accuracy indeed improved with domain-specific scaffolding, confirming our first hypothesis. Our tests of the second hypothesis, however, revealed surprising results: peer-assessment scaffolding significantly increased accuracy and mental effort during learning, it had no effect on peer-assessment accuracy at the test and led to reduced domain-specific accuracy, even when combined with domain-specific scaffolding. These results suggest that scaffolding students' peer assessment before they have mastered the task at hand can have disturbing effects on students’ ability to learn from the task.     

认知诊断技术在学科学业评价中的应用——以初中一年级“有理数及其运算”为例

当前,中小学学业评价中以考试总分为结果报告的主要方式,这虽然可以判断学生在特定团体中所处的位置以及学生总体上的学习情况,但是却不能明确地指出学生的认知优势或劣势,不能有效地提供“学生掌握了或未掌握什么知识、技能”等信息,也不能有效地让教师因材施教、实现针对性教学。基于这一情况,本研究将教育测量中的前沿技术——认知诊断应用于学业成就评价,以初中一年级数学“有理数及其运算”为例,介绍了认知诊断技术在数学学业评价中的应用过程,为教师改进教学、促进学生发展提供有效支持。     

Using Formal Embedded Formative Assessments Aligned with a Short-Term Learning Progression to Promote Conceptual Change and Achievement in Science

This study examined the effect of learning progression-aligned formal embedded formative assessment on conceptual change and achievement in middle-school science. Fifty-two sixth graders were randomly assigned to either an experimental group or a control group. Both groups were taught about sinking and floating by the same teacher with identical curriculum materials and activities. The experimental group received, in addition, three sets of formal embedded formative assessments with qualitative feedback as to how to improve their understandings aligned with an expected learning progression during instruction. The control group spent the corresponding time between new curriculum activities conducting curriculum-specific extension activities. Overall, the experimental group experienced on average greater conceptual change than the control group. The experimental group also scored higher on average than the control group on general achievement tests, especially the performance assessment. This study supported the contention, then, that embedding formal formative assessments within a curricular sequence built around an expected learning progression is a useful way to promote conceptual change along that learning progression in science classrooms.