Measuring deep, reflective comprehension and learning strategies: challenges and successes

There is a heightened understanding that metacognition and strategy use are crucial to deep, long-lasting comprehension and learning, but their assessment is challenging. First, students’ judgments of what their abilities and habits and measurements of their performance often do not match. Second, students tend to learn and comprehend differently depending on the subject matter, contexts, goals, and tasks. As a consequence, a student may appear to use deep, reflective strategies in one situation, and fail to do so in other circumstances. Third, it is generally assumed that strategy use (metacognition, metacomprehension) are separable constructs from the underlying skills germane to the target task. The studies described in this issue draw attention to the potential challenges to developing a pure (separable) measure of strategy use that is also reliable, valid, and contextualized.     

The effect of metacomprehension judgment task on comprehension monitoring and metacognitive accuracy

The authors investigated differences in the processes underlying two types of metacomprehension judgments: judgments of difficulty and predictions of performance (JOD vs. POP). An experiment was conducted to assess whether these two types of judgments aligned with different types of processing cues, and whether their accuracy correlated with different factors such as sensitivity to processing ease and reading ability. Participants (n?=?72) read an extended text about brain structure and after each sentence made either a JOD or POP. Results suggested that JODs and POPs were made based on different sets of cues because different factors correlated with the accuracy of metacomprehension judgments. JOD accuracy correlated with sensitivity to processing ease and POP accuracy most strongly correlated with reading ability. Engaging in different metacomprehension judgments during reading may alter the information sources to which a reader attends and which factors influence metacognitive accuracy.     

Enhancing academic engagement: Providing opportunities for responding and influencing students to choose to respond

Although educators often provide opportunities for students to engage in active academic responding, in many situations, students either cannot or will not respond. In the current article, we analyze the reasons students fail to respond. Practical procedures educators can use to prevent can't do problems are provided. Won't do problems are conceptualized as choice behaviors. Both applied and theoretical research on choice behavior provides the basis for recommendations designed to enhance the probability of students choosing to engage in active accurate academic (AAA) responding. Such procedures can increase skill development and achievement while decreasing inappropriate behaviors that are incompatible with AAA responding. School psychologists may utilize this information during the initial stages of collaborative problem solving (e.g., consultation) to help conceptualize problems. This conceptualization may then guide the assessment and intervention processes. © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 389–403, 2005.     

Teacher assessment literacy: a review of international standards and measures

Assessment literacy is a core professional requirement across educational systems. Hence, measuring and supporting teachers’ assessment literacy have been a primary focus over the past two decades. At present, there are a multitude of assessment standards across the world and numerous assessment literacy measures that represent different conceptions of assessment literacy. The purpose of this research is to (a) analyze assessment literacy standards from five English-speaking countries (i.e., Australia, Canada, New Zealand, UK, and USA) plus mainland Europe to understand shifts in the assessment landscape over time and across regions and (b) analyze prominent assessment literacy measures developed after 1990. Through a thematic analysis of 15 assessment standards and an examination of eight assessment literacy measures, results indicate noticeable shifts in standards over time yet the majority of measures continue to be based on early conceptions of assessment literacy. Results also serve to define the multiple dimensions of assessment literacy and yield important recommendations for measuring teacher assessment literacy.     

Integrating Scaffolding Strategies Into Technology-Enhanced Assessments of English Learners: Task Types and Measurement Models

This article investigates ways to improve the assessment of English learner students' English language proficiency given the current movement of creating next-generation English language proficiency assessments in the Common Core era. In particular, this article discusses the integration of scaffolding strategies, which are prevalently utilized as an instructional strategy for English learner students, into the design of technology-enhanced assessment tasks. The article includes sample tasks and student responses to illustrate the design of scaffolding assessment tasks and their potential to increase the accuracy of measuring students' English language proficiency. We also explore possible scoring and psychometric models for the scaffolding tasks in large-scale standardized assessments.     

White Paper: A Multidimensional Understanding of Effective University and College Counseling Center Organizational Structures

Established in 1950, the Association for University and College Counseling Center Directors (AUCCCD) is an international organization comprising universities and colleges (https://www.aucccd.org). AUCCCD members are the higher education leaders for student mental health. Our members represent a wide range of professional disciplines, public and private institutions, and a range of institutional student enrollment sizes. This white paper: (a) provides a historical background on counseling and mental health services on college campuses; (b) argues that, based on current research, there is no single organizational structure that is optimal; (c) makes recommendations about factors to consider when making decisions about the counseling center that are based on specific campus needs and resources rather than a preferred organizational structure; and (d) advocates for a collaborative care model regardless of organizational structure.     

Quantifying stroke coordination during the breathing action in front-crawl swimming using an instantaneous net drag force profile

Abstract

This study used both an instantaneous net drag force profile and a symmetry timing to evaluate the effect of the breathing action on stroke coordination. Twenty elite swimmers completed a total of six randomised front-crawl towing trials: (i) three breathing trials and (ii) three non-breathing trials. The net drag force was measured using an assisted towing device mounted upon a Kistler force platform, and this equipment towed the swimmer at a constant speed. The net drag force profile was used to create a stroke symmetry index for each swimming trial. Analysis using the symmetry indices identified that the majority of participants demonstrated an asymmetrical instantaneous net drag force stroke profile in both the breathing and non-breathing conditions, despite no significant differences in the time from finger-tip entry to finger-tip exit. Within the breathing condition, the faster swimmers compared to the slower swimmers demonstrated a lesser percentage of overlap between stroke phases on their breathing stroke side. During the non-breathing condition, the faster participants compared to the slower swimmers recorded a reduction in the percentage of overlap between stroke phases and less duration in the underwater stroke on their breathing stroke side. This study identified that the majority of participants demonstrated an asymmetrical net drag force profile within both conditions; however, asymmetry was less prevalent when examining with only the timing symmetry index.     

Metalinguistic contributions to reading and spelling in second and third grade students

Minimal research has been conducted on the simultaneous influence of multiple metalinguistic, linguistic, and processing skills that may impact literacy development in children who are in the process of learning to read and write. In this study, we assessed the phonemic awareness, morphological awareness, orthographic awareness, receptive vocabulary, and rapid naming abilities of second and third grade students (N?=?56) and determined how these abilities predicted the children??s reading and spelling skills. Regression analyses revealed that morphological awareness was the sole unique contributor to spelling and, together with orthographic awareness, uniquely contributed to word recognition. Morphological awareness also was significantly related to reading comprehension. The results add to a growing literature base providing evidence that early literacy development is influenced by morphological awareness, an ability that has received considerably less educational attention. Additionally, the findings point to the importance of tapping into multiple sources of metalinguistic knowledge when providing instruction in reading and spelling.     

Determining the informational,navigational, and transactional intent of Web queries

In this paper, we define and present a comprehensive classification of user intent for Web searching. The classification consists of three hierarchical levels of informational, navigational, and transactional intent. After deriving attributes of each, we then developed a software application that automatically classified queries using a Web search engine log of over a million and a half queries submitted by several hundred thousand users. Our findings show that more than 80% of Web queries are informational in nature, with about 10% each being navigational and transactional. In order to validate the accuracy of our algorithm, we manually coded 400 queries and compared the results from this manual classification to the results determined by the automated method. This comparison showed that the automatic classification has an accuracy of 74%. Of the remaining 25% of the queries, the user intent is vague or multi-faceted, pointing to the need for probabilistic classification. We discuss how search engines can use knowledge of user intent to provide more targeted and relevant results in Web searching.