The Impact of Vertical Scaling Decisions on Growth Interpretations

Most growth models implicitly assume that test scores have been vertically scaled. What may not be widely appreciated are the different choices that must be made when creating a vertical score scale. In this paper empirical patterns of growth in student achievement are compared as a function of different approaches to creating a vertical scale. Longitudinal item‐level data from a standardized reading test are analyzed for two cohorts of students between Grades 3 and 6 and Grades 4 and 7 for the entire state of Colorado from 2003 to 2006. Eight different vertical scales were established on the basis of choices made for three key variables: Item Response Theory modeling approach, linking approach, and ability estimation approach. It is shown that interpretations of empirical growth patterns appear to depend upon the extent to which a vertical scale has been effectively “stretched” or “compressed” by the psychometric decisions made to establish it. While all of the vertical scales considered show patterns of decelerating growth across grade levels, there is little evidence of scale shrinkage.     

Career decision-making difficulties of Turkish adolescents

The purposes of this study are (1) to adapt the Career Decision-Making Difficulties Questionnaire (CDDQ) to Turkish high school students and (2) to examine gender differences, grade differences, and differences between “decided” and “undecided” students. The sample consisted of 2509 adolescent students. The results showed that the structure of the Turkish version of the CDDQ was similar to the structure of the original CDDQ. The adolescent girls reported greater difficulties general indecisiveness, and dysfunctional belief difficulties than adolescent boys. Adolescent boys reported greater motivation difficulties than adolescent girls. Undecided students reported having more difficulties than decided students.     

A typology of undergraduate students' conceptions of size and scale: Identifying and characterizing conceptual variation

The importance of “size and scale” in nanoscience and engineering has been recognized by both scientists and science educators. A solid understanding of this concept is key to the learning of nanoscience. Students, however, have been reported to have considerable difficulty grasping this concept; yet little is known regarding their state of understanding. To address this knowledge gap, we conducted a series of studies that were aimed at exploring the different ways students conceive of “size and scale” in the context of undergraduate nanoscience and engineering courses. Informed by Variation Theory of Learning (Marton and Booth, 1997), we identified four major categories (with two sub‐categories within each) of student conception—fragmented, linear, proportional, and logarithmic. These conception categories, together with the aspects of variation that characterize and distinguish them, are summarized in a typology. In addition to serving as a diagnostic tool to describe students' understanding, this typology can also be used to guide the development of instructional interventions that facilitate students to move toward a more sophisticated understanding of “size and scale.” © 2011 Wiley Periodicals, Inc., Inc. J Res Sci Teach 48: 512–533, 2011     

Elementary school students’ strategic learning: does task-type matter?

This study investigated what types of learning patterns and strategies elementary school students use to carry out ill- and- well-structured tasks. Specifically, it was investigated which and when learning patterns actually emerge with respect to students’ task solutions. The present study uses computer log file traces to investigate how conditions of task types that might affect strategic learning. Elementary school students (N = 12) participated in two science study lessons. During these lessons the students were asked to solve well- and ill-structured tasks. For both of these tasks, the students used the gStudy learning environment designed to support strategic learning. In addition, gStudy records traces of each student’s strategic actions as they proceed with tasks. First, the students’ task solutions was rated according to three categories, namely “on track”, “off track” and “partial solution”. Second, learning patterns in terms of learning strategies that emerged throughout these tasks were investigated. Third, detailed cross case analysis was used to explore in depth how and when these learning patterns were used with respect to the students’ task solutions. The results show that young students’ can provide in-depth task solutions, but also adapt to the task complexity. However, despite the task types being different, the students had same types of learning patterns. The detailed cross-case comparison of the students’ task solutions with respect to learning patterns indicates that there are intra individual differences concerning how students allocate their learning strategy use. Especially if the task is ill-structured, it can also mislead the students to focus on irrelevant aspects and hinder strategic learning.     

Validation of Cognitive Sensitivity for Item Response Curves

This study sought a scientific way to examine whether item response curves are influenced systematically by the cognitive processes underlying solution of the items in a procedural domain (addition of fractions). Starting from an expert teacher's logical task analysis and prediction of various erroneous rules and sources of misconceptions, an error diagnostic program was developed. This program was used to carry out an error analysis of test performance by three samples of students. After the cognitive structure of the subtasks was validated by a majority of the students, the items were characterized by their underlying subtask patterns. It was found that item response curves for items in the same categories were significantly more homogeneous than those in different categories. In other words, underlying cognitive subtasks appeared to systematically influence the slopes and difficulties of item response curves.     

Impact of Personality on Academic Performance of MBA Students: Qualitative Versus Quantitative Courses*

The traditional core Masters in Business Administration (MBA) curriculum consists of a broad range of courses that can be considered as a whole, or divided into qualitative and quantitative courses. Regression models were developed with “QualGPA” and “QuantGPA” as response variables, and gender, pre‐MBA academic indicators, and personality factors (measured by the RightPath6^® profile) as the explanatory variables. Results may provide pedagogical insight for faculty teaching increasingly diverse MBA classes. Additionally, there are recruitment implications for those hiring MBA graduates, as well as implications for MBA students in decisions regarding MBA concentrations and subsequent career choices. While gender alone was not a significant variable in any model, gender–personality interactions were significant. Across both course categories, performance tended to be higher for students who were more “Detached” than “Compassionate,” with the exception of females in quantitative courses. Additionally, “Extraversion” and “Reactiveness” significantly enhanced performance among males in qualitative courses, and “Conscientiousness” had a strong positive performance effect among females in quantitative courses.     

Identifying patterns in students’ scientific argumentation: content analysis through text mining using Latent Dirichlet Allocation

Constructing scientific arguments is an important practice for students because it helps them to make sense of data using scientific knowledge and within the conceptual and experimental boundaries of an investigation. In this study, we used a text mining method called Latent Dirichlet Allocation (LDA) to identify underlying patterns in students written scientific arguments about a complex scientific phenomenon called Albedo Effect. We further examined how identified patterns compare to existing frameworks related to explaining evidence to support claims and attributing sources of uncertainty. LDA was applied to electronically stored arguments written by 2472 students and concerning how decreases in sea ice affect global temperatures. The results indicated that each content topic identified in the explanations by the LDA— “data only,” “reasoning only,” “data and reasoning combined,” “wrong reasoning types,” and “restatement of the claim”—could be interpreted using the claim–evidence–reasoning framework. Similarly, each topic identified in the students’ uncertainty attributions— “self-evaluations,” “personal sources related to knowledge and experience,” and “scientific sources related to reasoning and data”—could be interpreted using the taxonomy of uncertainty attribution. These results indicate that LDA can serve as a tool for content analysis that can discover semantic patterns in students’ scientific argumentation in particular science domains and facilitate teachers’ providing help to students.

     

An Appraisal of the Watson-Glaser Critical Thinking Appraisal

Abstract

Successful prediction of achievement involves, as a minimum, selecting significant variables, measuring them accurately, and finding a way of combining them to account for maximum achievement variance. Extending earlier work, this report is of two studies-one on developing a refined combination of predictors including ability, “likability,” and “motivation”; and the other aimed at validating this multiple regression equation against actual school achievement, Prediction is in terms of whether students would fall in “good” or “poor” categories determined by dichotomizing the rank-ordered list of actual achievement at a grade point average of 3.33. The biserial r between the dichotomized variable of actual achievement and predicted achievement scores is .882, which is highly significant. The importance and shortcomings of the method are discussed.     

„Bildungsräume“ und „Bildungslandschaften“ ‒ Raumbezogene Forschungskategorien aus Sicht der Bildungsgeschichte Konzeptionelle und methodische Perspektiven

Research in educational history has opened itself up increasingly in the past years to questions related to “space” The focus of this essay is on the current research category “educational space” and the related concept of “educational landscapes”. Both concepts are presented, beginning with a comparison of similarities and differences from an early modern historical perspective and ending with an analysis of different epochs. The study also expands upon influences of the concept of cultural transfer on the concepts of “educational space” and “educational landscape” and presents a current research project on early modern educational history using both categories.     

Helping Hong Kong business students to appreciate how they learn

Hong Kong students enrolling in the tertiary sector exhibit tendencies to passivity and non-participation. There is also some evidence that, in common with other countries, the tertiary educational environment in Hong Kong may encourage the adoption of inappropriate approaches to learning. A programme was developed within the first year of a business studies degree with the purpose of enhancing students’ approach to learning. This was attempted by making them aware of different approaches, giving them the analytical tools to examine their own conceptions of and approaches to learning and by involving them in different forms of learning experience. Most students conceived ofieaming as a quantitative increase in knowledge. They exhibited similar patterns in respect of SPQ scores to other Hong Kong students, scoring slightly higher than their Australian peers with respect to “deep” and “achieving” approaches and slightly lower on the “surface” approach. Evaluation of the programme was based on a range of sources including unprompted views using the “slip” technique, course evaluation questionnaires and a second administration of the SPQ at the beginning of the students’ second year. The evaluation shows that student reaction to the programme was mixed, though with an overall balance in favour. The SPQ results showed.that although the mean scores for the “surface” approach rose and those for the “deep” and the “achieving” approach fell, they did so to a much lesser extent than on similar programmes.     

The science support scale: Its appropriateness with high school students

Implementing the idea that more emphasis should be placed on student achievement in the affective domain is contingent upon the concurrent development of suitable instruments for the assessment of prescribed criteria. One such instrument, the Schwirian Science Support Scale (Tri-S scale), was reported in a recent NSTA publication as a promising tool for measuring student science support. Recent research using the Tri-S scale with high school pupils showed that scores on this instrument did not increase after the students had taken a tenth grade introductory course in biology. Further analysis indicated students of teachers scoring “high” in science support did not produce higher scores on the Tri-S scale than students studying biology from teachers “low” in science support. Reliability estimates using high school student scores were well below previous estimates using scores from college undergraduates. Factor analysis of inter-item correlations indicated that student interpretation of item meaning did not correspond to the five subtest structure of the Tri-S scale. Findings from this study demonstrate that the Tri-S scale is not an appropriate instrument for measuring attitudinal changes of tenth grade high school students. This study is suggestive of the fact that went and future instruments that purport to measure achievement in noncognitive areas should be carefully analyzed before they are recommended for use with specific populations.     

Professional storytelling in clinical dental anatomy teaching

The aim of the present work was to see if storytelling in a clinical dental anatomy course would increase student satisfaction. We enhanced teaching by spontaneous storytelling in problem‐based learning, in half of the third‐year dentistry class. At the end of the course, we administered an anonymous questionnaire to the students in the class, consisting of 12 questions that students had to answer on a Likert scale of 1–5. An overall satisfaction score was obtained and we used a linear mixed model to compare differences in satisfaction between the two groups, with “group” as the fixed effect. We also conducted an exploratory factor analysis of the responses to investigate whether there were distinct constructs within the data. Overall satisfaction is high, with students “with stories” having higher satisfaction than those “without stories.” The former group consistently gives higher satisfaction scores, regardless of which question is being asked. Factor analysis provides evidence that storytelling nurtures reflective learning, while students work on their clinical anatomy problems. Anat Sci Ed 1:84–89, 2008. © 2008 American Association of Anatomists.     

Exploring presence in online learning through three forms of computer-mediated discourse analysis

This case study examined patterns in online communication using computer-mediated discourse analysis to better understand how teaching presence, social presence, and cognitive presence are manifested in an online learning environment. The findings indicate that study participants actively participated in the discussion. The instructor and facilitators displayed high teaching presence through posting encouraging social words and maintaining a positive emotional tone, which created an open communication environment for student discussion. To promote students’ cognitive development, the acts that their words described included to “inform” and “elaborate” to help students construct knowledge by providing factual information and extending or embellishing upon points made. Students displayed social presence by using more social and positive emotion words, and tone, which signaled that they were satisfied with the discussion. Students’ cognitive presence was manifested through making claims, providing information and elaboration on posted comments.     

“Because a robot's brain hasn't got a brain,it just controls itself” — Children's attributions of brain related behaviour to intelligent artefacts

Educational settings have seen an increased presence of intelligent artefacts. Objects such as computers and robots take up new positions along the animate-inanimate continuum due to their substantive “cognitive” and “sensori-motor” repertoires including for example an ability to engage with a diversity of problem-solving tasks and having a memory. In the present study we report children's understanding of a variety of stimulus objects with different anthropomorphic features, including a person, robot, computer and doll. Attributional judgements were elicited from 60 children aged 5–11 and a comparison group of adults. Children were asked for judgements (and justifications) whether the above objects were capable of realising a large number of items drawn from 6 major behavioural categories (e.g., involuntary activity). The data, show that the different objects did not generally elicit substantially different justification patterns. The exception to this is a clear developmental pattern in terms of an increased understanding of the nature of clever artefacts. Results are discussed in terms of different forms of causal reasoning and the specific nature of the act of programming in terms of a growing understanding of the behaviour of intelligent artefacts.     

The effect of students’ subject discipline on their m-learning application preferences

The effect of students’ subject discipline on their preferences toward m-learning applications was investigated by using a mixed-method research design. A questionnaire on students’ preferences of m-learning application features was used to collect data from 181 undergraduate students. One-way analysis of variance found a significant difference among perceptions of students from different subject disciplines related to the “collaboration” and “learning” features. Follow-up interviews were carried out to further investigate students’ perceptions. Content analysis revealed that “availability” and “ease of use” were the most preferred features, and “collaboration” and “entertaining” were the least preferred ones. Interview results related to universities’ readiness for m-learning were categorized into (i) universities’ infrastructures, (ii) instructors’ skills and (iii) students’ skills for m-learning. Students indicated their universities’ infrastructures as “moderately ready” for m-learning. They ranked their instructors’ skills as “low”. However, students assessed their own skills as “moderate” for utilizing m-learning in their respective universities.     

NEGRO TEACHERS IN NEW YORK CITY

This article addresses the question of what is entailed in enhancing teacher quality and student achievement through university-school partnership. It compares two different secondary schools working in partnership with Clark University in Worcester, Massachusetts. University Park Campus School (UPCS) is a small, neighborhood-based school that spans grades 7–12 and serves 215 students. South High School is a large comprehensive high school, with grades 9–12, and 1500 students. UPCS has attained an exceptional level of effectiveness, as reflected in student achievement; all students have passed the statewide test on their first try, with most scoring in the top two performance categories (“proficient” and “advanced”), and qualified for postsecondary education. In contrast, South High, committed to a major restructuring initiative, marks improvement more slowly and incrementally. While scale looms large as a factor in explaining the effectiveness of each school (an instrumental factor), the story of the differences between the two schools is more complex. The comparison focuses on the most salient dimensions in an effort to understand critical cultural dimensions of effectiveness.     

The effect of authentic m-learning activities on student engagement and motivation

Authentic collaborative m-learning activities were designed, developed and implemented for a computer networking course. The effect of the activities on student engagement and motivation were analyzed using a mixed method research design. Moreover, the effect of the iterative design of the content and instructional process of authentic m-learning activities on students' engagement and motivation were analyzed in the study. The activities were implemented for two consecutive semesters and were modified based on the findings from the first semester. Student engagement survey and motivation questionnaire were used to collect quantitative data, student interview protocol was used to collect qualitative data for further investigation. The findings from the first semester indicated that the engagement categories “personal development” and “satisfaction from the course” had the highest mean scores. In the second semester, the highest mean score belonged to the “personal development” category, followed by “collaborative learning.” Comparison of the results from two semesters revealed that the improvements in the content of the activities and instructional process increased the “collaboration” among students as well as their “interaction with instructor.” Paired sample t-tests revealed a difference in indicators of student motivation within groups in both semesters. Analysis of the interview data showed that students perceived the authentic activities as an appropriate tool for enhancement in “communication” and “collaboration” opportunities.