Prompting undergraduate students’ metacognition of learning: implementing ‘meta-learning’ assessment tasks in the biomedical sciences

To succeed at post-secondary education, it’s essential that students develop an understanding of their own knowledge and learning processes. This metacognition of learning, or ‘meta-learning’, helps students to become more effective learners, as they become more aware of their self-regulatory processes and recognise the effectiveness of their study strategies. To increase biomedical science students’ self-awareness, we have designed and implemented meta-learning assessment tasks across our biomedical science courses. Most students reported that meta-learning tasks had a positive impact on their learning, as they prompted self-regulatory processes of forethought and self-reflection. We found that students were equally likely to change or not change their study strategies across subsequent semesters. Those students that did not change were generally high achievers, believing their study approaches were most effective, but their performance did not improve across semesters. In contrast, students who adapted, mostly by modifying how they appraised and rearranged records or improved planning and time management, performed less well overall but significantly improved their performance across semesters. Meta-learning tasks may prompt students to become more self-reflective and independent learners by affecting their approach to learning, enabling them to reflect on their study strategies, adapt and improve performance, and may enable the development of lifelong learning skills.     

Alignment and Implications for Test Takers

The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).     

Identification and Evaluation of Local Item Dependencies in the Medical College Admissions Test

Measurement specialists routinely assume examinee responses to test items are independent of one another. However, previous research has shown that many contemporary tests contain item dependencies and not accounting for these dependencies leads to misleading estimates of item, test, and ability parameters. The goals of the study were (a) to review methods for detecting local item dependence (LID), (b) to discuss the use of testlets to account for LID in context-dependent item sets, (c) to apply LID detection methods and testlet-based item calibrations to data from a large-scale, high-stakes admissions test, and (d) to evaluate the results with respect to test score reliability and examinee proficiency estimation. Item dependencies were found in the test and these were due to test speededness or context dependence (related to passage structure). Also, the results highlight that steps taken to correct for the presence of LID and obtain less biased reliability estimates may impact on the estimation of examinee proficiency. The practical effects of the presence of LID on passage-based tests are discussed, as are issues regarding how to calibrate context-dependent item sets using item response theory.     

Can virtual environments enhance the learning of historical chronology?

Historical time and chronological sequence are usually conveyed to pupils via the presentation of semantic information on printed worksheets, events being rote-memorised according to date. We explored the use of virtual environments in which successive historical events were depicted as “places” in time–space, encountered sequentially in a fly-through. Testing was via “Which came first, X or Y?” questions and picture-ordering. University undergraduates experiencing the history of an imaginary planet performed better after a VE than after viewing a “washing line” of sequential images, or captions alone, especially for items in intermediate list positions. However, secondary children 11–14 years remembered no more about successive events in feudal England when they were presented virtually compared with either paper picture or 2-D computer graphic conditions. Primary children 7–9 years learned more about historical sequence after studying a series of paper images, compared with either VE or computer graphic conditions, remembering more in early/intermediate list positions. Reasons for the discrepant results are discussed and future possible uses of VEs in the teaching of chronology assessed.     

Whatever happened to STS? Pre-service physics teachers and the history of quantum mechanics

If issues in the history and philosophy of science and those related to science, technology and society are generally accepted in policy, how ought these be handled in practice? Mandate in policy does not guarantee implementation in practice. Indeed, HPS and STS have for decades been marginalized in the curriculum. Subject areas designated to teach components of HPS and STS, such as design and technology, social studies and science, seem preoccupied with other aspects of the curriculum and rarely get around to HPS and STS. This study aimed at eliciting pre-service physics teachers’ perspectives on using HPS to address quantum mechanics and scientific literacy. Through questionnaires, observation of and participation in a physics methods class, 16 pre-service teachers were asked to identify topics they considered problematic to teach or learn. They were challenged to identify those topics that could effectively be taught or learned from HPS. The pre-service teachers agreed that HPS and STS were more appealing for teaching some topics, such as quantum mechanics, which is the focus of this article. This intervention in physics teacher education demonstrates the importance of using specific methods in physics instruction to demonstrate the value of HPS in scientific literacy.     

Using the Millon College Counseling Inventory to Assess Student Mental Health Needs

Students visiting college counseling centers experience a broad range of complex and sometimes severe concerns that are often not adequately addressed by existing clinical measures. In response, the Millon College Counseling Inventory (MCCI; T. Millon, S. N. Strack, C. Millon, & S. Grossman, 2006) was specifically designed for use with contemporary college populations. The authors introduce the MCCI, briefly explain its development, discuss its utility for everyday use in counseling centers, and offer a fictional case illustration.     

Demographics and professional practices of school psychologists: A comparison of NASP members and non–NASP school psychologists by telephone survey

A national telephone survey was conducted to examine potential differences between National Association of School Psychologists (NASP) members and non–NASP member school psychologists. Identified schools were contacted by telephone and the researchers asked to speak with the school psychologist. A sample of 124 practicing school psychologists was obtained. Overall, 57.3% (n = 71) of respondents were NASP members, and 42.7% (n = 53) were not. In most respects, current results were similar to NASP‐member‐only surveys. Current results suggest that previous studies overestimated the proportion of NASP members among school psychologists and may have underestimated the total number of school‐based practitioners. Significant differences between NASP members and nonmembers were found in ethnicity, national certification, professional organization membership, and use of Curriculum Based Measurement. Results are discussed in the context of previous national surveys. © 2008 Wiley Periodicals, Inc.     

Influence Tactics in the Classroom and Their Relationship to Student Satisfaction*

We argue that an instructor's use of influence tactics can be classified as soft, rational, and strong in nature and that the use of these tactics will have a differential impact on student satisfaction. We find support for the existence of the three categories of influence. We find that student satisfaction is positively influenced by the use of soft and rational tactics, but is uninfluenced by the use of strong tactics.