A Critical Discussion of Deep and Surface Processing: What It Means, How It Is Measured, the Role of Context, and Model Specification

The prevailing assumption by some that deep processing promotes stronger learning outcomes while surface processing promotes weaker learning outcomes has been called into question by the inconsistency and ambiguity of results in investigations of the relation between levels of processing and performance. The purpose of this literature review is to examine four areas that may be contributing to the inconsistency and ambiguity of these research results: conceptualization, operationalization, situational factors, and model specification of deep and surface processing. A PsycINFO database search was conducted, and 221 studies were identified for a comprehensive data table. Analysis of these data revealed trends that suggested conceptualization and operationalization of deep and surface processing differed depending on the theoretical frame utilized in each study. Additionally, the choice of theoretical frame also seemed to impact what situational factors may or may not have been present as well as how the model of levels of processing and performance was specified. Results from studies that met certain criteria demonstrated that levels of processing and performance are related, and further, these relations may be moderated by other factors. Implications for future research are discussed that focus on these four areas.     

Conceptualization and Operationalization of Executive Function

Executive function is comprised of different behavioral and cognitive elements and is considered to play a significant role in learning and academic achievement. Educational researchers frequently study the construct. However, because of its complexity functionally, the research on executive function can at times be both confusing and contradictory. To attempt to bring some clarity to the construct, a systematic review of contemporary empirical studies was conducted. A PsycInfo database search was conducted and 106 empirical studies were selected for review. The analyses explored specific aspects of these studies such as how executive function is defined and measured, and in what domains and population groups is it studied. The resulting analyses identified both points of convergence and divergence, as well as issues with both the conceptualization and operationalization of executive function.     

A systematic review of item response theory in language assessment: Implications for the dimensionality of language ability

The present study conducted a systematic review of the item response theory (IRT) literature in language assessment to investigate the conceptualization and operationalization of the dimensionality of language ability. Sixty-two IRT-based studies published between 1985 and 2020 in language assessment and educational measurement journals were first classified into two categories based on a unidimensional and multidimensional research framework, and then reviewed to examine language dimensionality from technical and substantive perspectives. It was found that 12 quantitative techniques were adopted to assess language dimensionality. Exploratory factor analysis was the primary method of dimensionality analysis in papers that had applied unidimensional IRT models, whereas the comparison modeling approach was dominant in the multidimensional framework. In addition, there was converging evidence within the two streams of research supporting the role of a number of factors such as testlets, language skills, subskills, and linguistic elements as sources of multidimensionality, while mixed findings were reported for the role of item formats across research streams. The assessment of reading, listening, speaking, and writing skills was grounded within both unidimensional and multidimensional framework. By contrast, vocabulary and grammar knowledge was mainly conceptualized as unidimensional. Directions for continued inquiry and application of IRT in language assessment are provided.     

The Use of Mobile Learning in Science: A Systematic Review

The use of mobile learning in education is growing at an exponential rate. To best understand how mobile learning is being used, it is crucial to gain a collective understanding of the research that has taken place. This systematic review reveals the trends in mobile learning in science with a comprehensive analysis and synthesis of studies from the year 2000 onward. Major findings include that most of the studies focused on designing systems for mobile learning, followed by a combination of evaluating the effects of mobile learning and investigating the affective domain during mobile learning. The majority of the studies were conducted in the area of life sciences in informal, elementary (5–11 years) settings. Mobile devices were used in this strand of science easily within informal environments with real-world connections. A variety of research methods were employed, providing a rich research perspective. As the use of mobile learning continues to grow, further research regarding the use of mobile technologies in all areas and levels of science learning will help science educators to expand their ability to embrace these technologies.     

Examining research into the use of data walls for teaching and learning: How are they being implemented within data use cycles?

Data walls, used to display student data within schools, are a growing phenomenon internationally. Drawing on a conceptual model of data use, this systematic review examined 32 empirical sources from compulsory education settings to evaluate claims about the impact of data walls on teaching and learning. The review found details regarding goals for data walls and the displayed information, but there was limited evidence of how data analysis was used to guide improvement action and evaluation of impact. The review concluded that there is currently insufficient empirical research evidence to substantiate or refute claims about their educational effects.     

The contribution of TIMSS to the link between school and classroom factors and student achievement

Worldwide, the interest of policy-makers in participating in studies from the International Association for the Evaluation of Educational Achievement (IEA), such as Trends in International Mathematics and Science Study (TIMSS) has been growing rapidly over the past two decades. These studies offer the opportunity to relate the teaching and learning context to student achievement. This article presents the results of a systematic review of the research literature on TIMSS. Its main purpose is to find out to what extent TIMSS has contributed to insights into ‘what works in education and what does not’, particularly with regard to school and classroom factors. The review was guided by a generic framework developed within the tradition of educational effectiveness research. The review showed that: (a) since 2000, the number of publications which use TIMSS data for secondary analyses aimed at explaining differences in student achievement has increased strongly; (b) a number of studies, especially older ones, did not take account of the specific sample and test design of TIMSS; and (c) there are large differences between countries in school and classroom factors associated with student achievement. In the light of these results, we discuss the benefits and limitations of country and system comparisons.     

A systematic literature review of the use of Semantic Web technologies in formal education

This paper presents a systematic literature review of research focused on use of Semantic Web technologies in formal educational contexts. Through systematic search, the review has identified 199 research articles, which are examined with the intention of identifying prevalent themes within the body of research within the field of formal educational use of Semantic Web technologies. The themes identified by the review are: (1) Semantic Web ontologies; (2) Efficient distribution, accessibility, retrieval, reuse and combination of educational resources; (3) Linked Data; (4) Semantic Web enhanced virtual learning environments and personalization of learning environments; (5) Semantic Web learning objects; (6) Evaluation, feedback and assessment; (7) Semantic Web services; (8) Pedagogical tools for teachers and students. Furthermore, this review seeks to examine how these themes and the use of Semantic Web technologies in formal education reflects on the ongoing discussion of how pedagogy and technology should interact. The outset of this discussion is a previous study by Dirckinck-Holmfeld, which establishes that there is a tendency to emphasize technology over pedagogy in educational design and development.     

Transfer of Training: An Updated Review and Analysis

This study updates the Baldwin and Ford (1988) review of the empirical articles published on training transfer. The updated review and analysis revolves around the four key limitations noted in the original review: (1) the criterion problem of how and when to measure training transfer, (2) the generalizability of results from training design studies, (3) the choice of which trainee characteristics to examine for their impact on transfer, and (4) the conceptualization and operationalization of work environment factors that can impact transfer. Twenty studies were found in the literature since the 1988 review on training transfer. An analysis of these studies found that progress has been made in addressing many of the limitations noted by Baldwin and Ford. This paper concludes with a discussion of future research directions for training transfer research relevant to each of the four areas of criterion measurement, training design, trainee characteristics, and work environment.     

Assessing self-regulated learning in higher education: a systematic literature review of self-report instruments

The growing interest in the field of learning strategies has led to an increasing number of studies and, with that, the development of numerous instruments to measure the use of self-regulated learning (SRL) strategies. Due to the complexity of this research field, the types of assessment methods are diverse. For this reason, we conducted a systematic review of self-report instruments that measure SRL in higher education and highlight their main characteristics. In doing so, we applied the general principles of systematic reviewing—we conducted a systematic search of established psychological and educational databases with previously defined inclusion criteria and applied a multistage filtering process. In an additional step, we examined a subsample of nine established instruments in terms of their implementation characteristics, psychometric properties, and additional characteristics. The results illustrate the distribution of self-report instruments used in higher education and point to a growing use of course- or domain-specific questionnaires over the past decades as well as a lack of emotional and motivational regulation scales.     

An examination of the evidence-based literacy research in deaf education

The ability to read and write for a variety of purposes is essential to success in school and in contemporary society. The purpose of this investigation was to conduct an exhaustive review of the literature and a meta-analysis of literacy research in the field of deaf education. Computer and manual searches of 40 years of peer-reviewed journal articles were conducted. A total of 964 articles related to literacy and deafness were identified and examined; 22 articles met the criteria for inclusion in the review. Results indicate that (a) no two studies examined the same dimension of literacy; (b) there was a paucity of well-designed group studies; (c) there were no systematic replication of studies; (d) there is limited data to establish evidenced-based practices. Consequently, increasing the quantity and improving the quality of research in the field is recommended.     

句法加工的fMRI研究

句法加工是语言理解中的重要环节,句法加工的脑机制问题是心理语言学和认知神经科学的重要研究内容。功能性磁共振成像（functional magnetic resonance imaging,简称fMRI）的出现为研究语言加工提供了一种新的信息资源,它能对句子中不同位置发生的大量语义分析操作进行检测,为研究语言的脑机制提供证据。详细阐述了如何运用fMRI来研究各种句法加工,并对当前的句法加工研究及fMRI技术进行了评价。     

Mobile learning and student cognition: A systematic review of PK-12 research using Bloom’s Taxonomy

The rise of mobile learning in schools during the past decade has led to promises about the power of mobile learning to extend and enhance student cognitive engagement. The purpose of this study was to examine trends to determine the cognitive level students are involved in within mobile learning activities. This systematic review involved an aggregated and configurative synthesis of PK-12 mobile learning studies from 2010 to 16 and used Bloom’s Taxonomy as a theoretical framework for categorizing the cognitive level of student activities. Major new findings include that students are involved in activities at all six levels of Bloom’s Taxonomy. This study shows that over 60% of researchers are developing activities that require high levels of cognitive processing, a large increase from past studies. Nonetheless, 40% are integrating mobile devices in ways that keep students working with minimal cognitive processing. In both elementary and secondary studies, there was a 40/60% split in the use of lower versus high level thinking opportunities. New findings show that mobile devices were integrated into science, mathematics, social studies, literacy, art and special education. Studies in science settings were the majority of the studies (40%), followed by literacy (24%).     

When are powerful learning environments effective? The role of learner activities and of students’ conceptions of educational technology

The goal of this chapter is to outline a theoretical and empirical perspective on how learners’ conceptions of educational technology might influence their learning activities and thereby determine the power of computer-based learning environments. Starting with an introduction to the concept of powerful learning environments we outline how recent developments in information and communication technologies might be used to implement these environments technologically. In the next step we refer to several exemplary empirical studies to argue that the power of computer-based learning environments will largely depend on very detailed aspects of the learning activities within these environments. In order to design these environments so that they elicit effective learning activities, it is necessary to analyze the factors that determine learners’ goals and their choices of processing strategies. The focus of this paper is on one of these factors, namely on learners’ instructional conceptions with regard to educational technology and its use in instruction. Up to now, there has been nearly no research conducted within the educational community addressing the issue of how this particular type of instructional conceptions determine learning activities. Therefore, we review several relevant findings from neighboring fields like epistemological beliefs, attitude research, human computer interaction, or cognitive modeling. We use this review to demonstrate that there are numerous findings outside the educational technology community that deserve much more resonance in this community than they currently receive.     

Interest, motivation and learning: An educational-psychological perspective

Within the last few years, researchers have shown a renewed interest in “interest”. Especially in the field of educational psychology many studies have been conducted to analyze how learning and achievement are influenced by motivational and cognitive factors, which are connected with individual and/or situational interests. In this paper, results from empirical research will be presented besides theoretical considerations concerning the interest-construct. Interest has typically been studied as an independent variable. Dependent variables have been either some aspects of learning outcome (knowledge structure, academic achievement) or hypothetical mediators, which probably can be used to explain the interest effects (e.g., learning strategies, attention, emotional experiences). There is also a growing number of studies which try to explore the conditions of interest development within educational settings. Future lines of research will be discussed in light of the demands of educational theory and practice.     

Perspectives on Age and Continuing Professional Development for Nurses: A Literature Review

The need for nurses to participate in continuing professional development (CPD) is growing to keep abreast of rapid changes in nursing care. Concurrently, the nursing workforce is growing older. Ageing leads to changes in biological, psychological, and social functioning. Little is known about the effects of age-related changes on nurses’ CPD. A literature review was conducted to examine whether and how CPD differs across age groups. A framework with five perspectives on age was used in an attempt to distinguish factors contributing to these age differences. Given the limited research on this topic with respect to nurses, we also included studies of workers in general. The literature search revealed 27 relevant studies. In general, older workers appeared less likely to participate in CPD, when considering formal learning activities and late-career workers (older than 50/55 years). We found no clear age patterns for motivation to participate in CPD, for learning outcomes, and for participation in informal and non-formal learning activities. The study showed that more nuanced results are found when studies distinguish at least three age groups. By using different perspectives of age, a comprehensive overview of age-related factors in CPD was generated and gaps in current research were identified. Recommendations for further research are discussed, such as the need for research on whether the types of learning activities that nurses undertake change with ageing.     

A reasonably large review of operationalization in child maltreatment research: Assessment approaches and sources of information in youth samples

Child maltreatment research varies considerably in how maltreatment is measured. Although researchers have advocated for improvements in maltreatment assessment, a first step is a clear understanding of the status on how the field operationalizes maltreatment. The current paper sought to achieve this goal through reviewing research on child maltreatment over a recent 10-year span to identify trends in maltreatment assessment and operationalization. Information on maltreatment measurement was extracted from 338 articles across three major journals devoted to publishing research on child maltreatment. Among the various definitional dimensions of maltreatment, type was the most common way maltreatment was operationalized, followed by severity, frequency, and chronicity, a stable trend across the 10-year span of review. The results indicated that the majority of studies measured maltreatment as consisting of multiple types, although some studies focused on one type of maltreatment as the indicator of child maltreatment. Further, the most common assessment method was the administration of a questionnaire or the combination of two questionnaires with the second most common being summaries from case file review. Recommendations for future research are discussed.     

The power of open: benefits,barriers, and strategies for integration of open educational resources

ABSTRACT

Open Educational Resources (OER) are becoming a significant, mission-driven trend within educational literature. To help address rising costs, instructors and designers are looking to OER to effectively replace traditional instructional content, which requires more than just identify and replace. Drawing from 51 OER studies conducted in countries across the five continents, this systematic literature review explored the empirical themes evident in the current research on a global scale. This review found (1) discoverability, sustainability, and remixing are significant barriers that stand in the way of OER disrupting traditional textbook models; (2) there is no significant difference in learning outcomes when instructors incorporate OER; and (3) implementation of OER as instructional strategies is challenging but can be effective in supporting positive learning outcomes when properly designed. The paper concludes with a discussion of gaps in the literature, considerations for implementation and further directions for future research.     

Interventions in education to prevent STEM pipeline leakage

The so-called leaking STEM pipeline (dropout in STEM education) has been the subject of many studies. The large interest of scholars in plausible causes of this leakage has resulted in a number of meta-reviews describing factors at system, school and student level related to interest and persistence in STEM education. The STEM pipeline discussion has also resulted in a large number of programmes aimed at enhancing STEM interest and persistence in STEM education. Although these programmes have been widely evaluated, there seems to be no consensus about which interventions are successful in raising interest in STEM or persistence in STEM education. This study reports the results of a systematic review of empirical studies in which the effectiveness of STEM-related interventions are assessed. Initially, 538 studies were found. The quality analyses showed that only a few of these evaluation studies are designed in such a way that it is likely that the found effects are caused by the intervention. Although some potentially effective interventions were found, this review shows that there is still a need for research into the effectiveness of those programmes, especially with regard to programmes preventing talented and initially motivated STEM students to drop out of STEM education.     

Empirical Research on Performance Improvement

Renewed interest in research on performance improvement provides an ideal opportunity to examine how much empirical work is actually published and to identify the focus of research in the field. This paper describes a study conducted to examine the empirical research on performance improvement. The study involved a content analysis of articles published in PIQ from 1997 through 2000. Results indicated that empirical research accounted for about one‐third of all articles published in PIQ. A detailed analysis of the empirical research studies published in the journal is provided.     

Video production in content-area pedagogy: a scoping study of the research literature

Video production offers a way for students to learn content-area knowledge while simultaneously developing technology skills deemed important in contemporary society. Yet, the research has not been examined in a systematic way to reveal how these types of projects are oriented to align to instructional goals or how learning is investigated when they are implemented as part of content-area pedagogy. A scoping study was conducted to review the research literature on implementation of student video production in content-area classrooms. A total of 61 studies published from 2006 through 2017 were selected and analyzed through a systematic process. Findings suggest that video production projects were conducted to meet information, performance, composition, literacy, or creativity learning goals in content-area classrooms. Strategies used to investigate student learning included evaluation of learner perceptions, analysis of the process of creating video, assessment of the final video project, or a combination of these approaches.