When Should I Use a Measure to Support Instructional Improvement at Scale? The Importance of Considering Both Intended and Actual Use in Validity Arguments

Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument has historically focused on the intended interpretation and use. There has been a press to consider both the intended and actual interpretations and how users make sense of the data when constructing validity arguments, but the practice is not widespread. This paper contributes to existing research on validity by highlighting the value of attending to the actual interpretation and use of a measure aimed at supporting instructional improvement in mathematics. We describe the use of the same measure across two contexts to highlight the importance of attending to characteristics of both users and the contexts in which the measures are used when assessing the validity of inferences for the purpose of instructional improvement efforts.     

Using Blogs to Identify Misconceptions in a Large Undergraduate Nutrition Course

We describe two iterations of the design, development, implementation and evaluation of small online activity and reflection blogging groups into a large undergraduate lecture course in nutrition. Our goal was to promote student learning and conceptual change through reflection and interaction in blog conversations. We found the blog conversations to be highly useful to the instructors as a source of data on student understandings and misconceptions of course topics. These misconceptions could then be addressed with further instruction. We found that, even with initial training, graduate teaching assistants needed significant guidance in facilitation strategies and that finding the ideal balance between structure and autonomy is a design challenge.     

Sector differences in the role of institutional research in informing decision making and governance in higher education

The intent of the authors in preparing this paper is to compare and contrast the roles of Institutional Research in informing decision making and governance in higher education. Using a case study format the authors will provide an example of a research project conducted within each of the following sectors of United States higher education system: private 4-year not for profit, public major research institutions/private specialized institutions, and a pubic state university system. The first case study from the private sector will feature a mixed methodology study that used data from the National Survey of Student Engagement (NSSE) and student focus groups to explore student engagement at this institution and inform faculty development. The second case study will compare the use of data for decision making from the standpoint of large public research institutions and private specialized institutions. The third case study from a state university system focuses on recent initiatives in the public sector to inform the public, the institutions, the State, and the federal government using data from institutional research offices, student engagement surveys, and student learning assessments shared through consortia and national associations. These examples will be discussed within the structure of decision making and governance in higher education.     

Cultivating Connectivity: Folklife and Inclusive Excellence in Museums

Today there is a growing global awareness of the need to address issues related to the safeguarding and use of both tangible and intangible heritage. By engaging with communities in the documentation of local cultures—especially their folklife, or in other words, their traditional intangible cultural heritage—museums can create collections that will serve as foundations for museum research, exhibitions, and programs that have more resonance with and relevance for those communities. Interactions of these kinds—in particular those of the Smithsonian's Center for Folklife and Cultural Heritage and the Michigan State University Museum, home of the Michigan Traditional Arts Program, as well as collaborations between the Smithsonian Folklife Festival and the Great Lakes Folk Festival, and other programs around the world—have served as important platforms for public discourse about a variety of issues and have produced programs and exhibitions both at home and around the world.     

Curriculum analysis and education for sustainable development in Iceland

The article explores how the Icelandic public school curriculum for early childhood, compulsory and upper secondary school deals with education for sustainable development. As the curriculum does not often mention the term sustainability, a key with which to investigate signs of education for sustainable development in the three curricula was created. The key encourages a holistic view of sustainable development, where economic, environmental and social factors are not treated as separate entities. It was designed to reflect the goals of the United Nations Decade of Education for Sustainable Development (2005–2014) with research on environmental education and education for sustainable development in mind. The key has seven characteristics: values, opinions and emotions about nature and environment; knowledge contributing to a sensible use of nature; welfare and public health; democracy, participation, and action competence; equality and multicultural issues; global awareness; and finally, economic development and future prospects. Using the key, a variety of signs and indicators that provide a space for teachers and schools to deal with issues of sustainable development were identified.     

Linking early science and mathematics attitudes to long-term science,technology, engineering,and mathematics career attainment: latent class analysis with proximal and distal outcomes

There is a need to identify students' early attitudes toward mathematics and science to better support their long-term persistence in science, technology, engineering, and mathematics (STEM) careers. Seventh graders from a nationally representative sample (N = 2,861) were classified based on their responses to questions about their attitudes toward mathematics and science using latent class analysis. Four distinct groups of students that differed in terms of their attitudes were identified. There were relationships between attitudinal group membership, demographic characteristics, mathematics and science achievement, and STEM career attainment. Females and underrepresented minorities were more likely to be in the positive attitude group. However, despite these early positive attitudes, females and underrepresented minorities were less likely to be employed in a STEM career some 20 years later. Information about student interests organized in this manner can be used to better target specific interventions to support and encourage persistence in STEM careers.     

A Field-Based Testing Protocol for Assessing Gross Motor Skills in Preschool Children: The Children's Activity and Movement in Preschool Study Motor Skills Protocol

The purpose of this study was to develop a valid and reliable tool for use in assessing motor skills in preschool children in field-based settings. The development of the Children's Activity and Movement in Preschool Study Motor Skills Protocol included evidence of its reliability and validity for use in field-based environments as part of large epidemiological studies. Following pilot work, 297 children (3–5 years old) from 22 preschools were tested using the final version of the Children's Activity and Movement in Preschool Study Motor Skills Protocol and the Test of Gross Motor Development (2nd Edition). Reliability of the Children's Activity and Movement in Preschool Study Motor Skills Protocol and interobserver reliability were determined using intraclass correlation procedures (intraclass correlation coefficients; ANOVA). Concurrent validity was assessed using Pearson correlation coefficients to compare the Children's Activity and Movement in Preschool Study Motor Skills Protocol to the original Test of Gross Motor Development (2nd Edition). Results indicated that test reliability, interobserver reliability, and validity coefficients were all high, generally above R/r = .90. Significant age differences were found. Outcomes indicate that the Children's Activity and Movement in Preschool Study Motor Skills Protocol is an appropriate tool for assessing motor development of 3-, 4-, and 5-year-old children in field-based settings that are consistent with large-scale trials.     

Leading campus OER initiatives through library–faculty collaboration

With the rising costs of tuition and textbooks, Open Educational Resources (OERs) are becoming increasingly important. The university library, in collaboration with faculty, is a natural leader of OER initiatives at institutions of higher education. Cleveland State University's Michael Schwartz Library embraced this leadership role by assisting a faculty member with developing an OER, which involved balancing the workload between librarians and the faculty member, determining successful modes of communication, taking advantage of graphic design skills, and more. The success of this initial collaboration has led the Library to expand its support of OER initiatives on campus.