Effect sizes as result interpretation aids in single‐subject experimental research: description and application of four nonoverlap methods

Single‐subject experimental research (SSER), one of the most commonly used research methods in special education and applied behaviour analysis, is a scientific, rigorous and valid method to evaluate the effectiveness of behavioural, educational and psychological treatments. However, studies using single‐subject experimental research designs are often excluded from meta‐analyses of evidence‐based practices due to the lack of methodological consensus on the type of effect size indices to be used to determine treatment effect. To promote the use of effect size indices as an adjunct to visual analysis, this article describes four nonoverlap methods (PND, IRD, PEM‐T and Tau‐U) and demonstrates their application to data obtained from studies employing different SSER designs. Advantages and disadvantages of each method are highlighted and considerations for selecting the most appropriate method are provided for researchers and practitioners.     

Effects of single‐case reading interventions for students with and at‐risk of emotional and behavioral disorders in grades K–12: A quantitative synthesis

This study examined the effects of reading interventions from single‐case design studies for students with and at‐risk of emotional and behavioral disorders in grades K–12 using a quantitative synthesis. Seventeen studies met the selection criteria of having one more dependent variables meeting what works clearinghouse (WWC) design standards with or without reservations. Although students’ reading performance significantly improved from baseline to intervention phases (p < 0.001), the overall weighted average effect size was weak (Tau‐U = 0.58, 95% confidence interval = [0.54, 0.63]; d = 0.29); smaller effects were found on reading comprehension. Interventions were less effective for students in secondary grades, students with a comorbid disability, and students in substantially separate settings. While no studies meeting the selection criteria were conducted in inclusive settings, the teacher provided interventions were more effective than those provided by researchers suggesting the importance of the student–teacher relationship for reading instruction. Study limitations, areas for future research, and implications for school practices are discussed.     

Single‐subject designs in special education: advantages and limitations

Single‐subject designs provide the special education field with an alternative to group designs. The purpose of this paper is to introduce the topic of single‐subject designs by providing an overview of the relevant literature and a discussion of the major issues and applications of these designs in the field of special education. This paper is divided into four main sections: (1) characteristics of single‐subject designs; (2) types of single‐subject designs; (3) advantages of single‐subject designs; and (4) issues and concerns regarding single‐subject designs. It was concluded that a minimum of three measurements in each phase is typically required until there is a clear pattern. Flexibility and cost‐effectiveness are among the main advantages of these designs. External validity and generalisability are the main concerns. However, meta‐analytic studies can enhance the generalisability of single‐subject designs findings within similar context. Conclusions and recommendations to improve these designs are discussed.     

基于CiteSpace的国内外泛在学习研究演变可视化分析

本文使用CiteSpace 5.6.R2,对国内外核心期刊中的泛在学习研究论文进行可视化分析｡ 研究发现国内外关于泛在学习研究呈现多领域､多视角､平稳发展的特点;研究热点主要聚焦于泛在学习环境和网络资源,国内研究更注重学习资源的分析,国外研究更注重学习模型的建构和实践｡在研究趋势方面,国内外均经历了理论建构和模型设计的阶段,逐步向实证研究转变,但国内实证研究并不突出且缺乏传承性,有待国内研究者进一步补充｡     

案例教学法在VB程序设计教学中的实践与探究

将案例教学法应用在VB程序设计的教学过程中,从而提高学生分析和解决问题的能力．通过展示案例教学的思路和特点,解析VB程序设计进行案例教学的可行性并借助具体的教学案例展示了案例教学在VB教学中的应用．     

The propagation of errors in experimental data analysis: a comparison of pre- and post-test designs

Experimental designs involving the randomization of cases to treatment and control groups are powerful and under-used in many areas of social science and social policy. This paper reminds readers of the pre- and post-test, and the post-test only, designs, before explaining briefly how measurement errors propagate according to error theory. The substance of the paper involves a series of comparisons using the same measurements, all assumed to have a small initial error, and seeing what would happen to that error in the two different experimental designs. The findings from these calculations and simulations are that although post-test only and pre- and post-test designs yield different ‘manifest’ results with the same data, the substantive conclusions drawn would be similar in most real-life situations. However, if these manifest results are assumed to be in error, stemming from small initial errors in the measurements at pre- and post-test, then these substantive conclusions could be completely wrong. In one example, the pre- and post-test designs propagate an initial maximum measurement error of 10% to an error of over 60,000% in the answer. In general, and perhaps counter-intuitively, the post-test only results are less misleading. The paper ends by summarizing the lessons drawn. The key message is that all other things being equal, the post-test only design is to be preferred. We may also need to use bigger samples, and more strictly accurate measures, capable of objective calibration focus on seeking larger effect sizes.     

Understanding OECD representations of teachers and teaching: a visual discourse analysis of covers in OECD documents

OECD dominance in the international educational policy discourse in the developed regions of the world, particularly in promoting teaching policy, has been long acknowledged. While many works have explored the organisation’s verbal discourse, no study has considered exploring its visual discourse. To close that gap, we employed a visual discourse analysis on the covers of OECD documents pertaining to teachers and teaching (i.e., TALIS and ISTP). The analysis found that OECD’s covers drew on two discourses, a conservative discourse and a liberal diversity discourse. However, the latter was entangled with constructions which serve to maintain a conservative order.     

Lessons for co-innovation in agricultural innovation systems: a multiple case study analysis and a conceptual model

Purpose: This paper highlights important lessons for co-innovation drawn from three ex-post case study innovation projects implemented within three sub-sectors of the primary industry sector in New Zealand.

Design/methodology/approach: The characteristics that fostered co-innovation in each innovation project case study were identified from semi-structured interviews conducted with key stakeholders in each project, iterative discussions to confirm the findings and secondary document analysis. Common themes from the three cases are examined in relation to innovation system structure and function analysis and agricultural innovation system (AIS) literature. This study builds on the literature attempting to overcome methodological challenges in the applied AIS research space.

Findings: The findings have implications for co-innovation in practice; that there needs to be network-level capability and legitimacy, an understanding of priorities between actors, and adequate resources, to ensure proposed outcomes are likely to be attained.

Practical implications: Practically, project leaders need to ensure they embed an appropriate mix of actors in the research program and they also need to create and encourage room for open and honest dialogue between these actors to develop a shared vision of the future.

Theoretical implications: A conceptual model is developed to highlight and simplify lessons that can inform future projects involving co-innovation approaches to create value in the primary industries and AIS more generally. This model is unique to the applied AIS research space and provides new insights on enhancing the potential value of a co-innovation approach.

Originality/value: The paper adds to current scholarly debates and provides insight to key actions stakeholders need to take to foster co-innovation processes for successful outcomes in extension.     

Multidisciplinary graduate training in social research methodology and computer-assisted qualitative data analysis: a hands-on/hands-off course design

Drawing on the experience of training graduate students and researchers in qualitative and mixed-methods analysis since the mid-1990s, the authors reflect on the evolution of a multidisciplinary graduate course developed in a Canadian university since 2007. The hands-on/hands-off course design based on the use of NVivo was developed in parallel with a conceptual and reflexive position on methodology and multidisciplinarity in the context of an action research supported by their institution. This article exposes the four basic components of the course and the constructivist assessment model based on a term-long team analysis of original data created specifically for this purpose. The balance between collective and individual work, in-class and online exchanges, hands-on experience with the software and hands-off reflection is described and compared to recent pedagogical literature on the subject. The interest of this blended approach in fostering the development of the methodological expertise expected from researchers and graduate students, as well as the main issues and challenges facing this type of training in a research environment characterised by new approaches and tools, are discussed.     

Arts‐Based Educational Research: The Challenges of Social Media and Video‐Based Research Methods in Communication Design Education

This article discusses the practical and ethical challenges and benefits of using social media and video‐based research methods – also known as Photovoice – to investigate contemporary Communication Design education. The two visual research methods discussed include the social media mobile application Snapchat^® and participant‐generated GoPro^® video filming. The investigation focused on understanding students’ on‐the‐ground, lived experiences of studio learning within two distinctive higher education case study settings in the United Kingdom and Australia. This study employed Participatory Action Research (PAR) as an inquiry process and incorporated a methodological framework involving a combination of narrative inquiry, visual Participatory Design (PD) and visual ethnography. The findings of this study revealed the impact of specialised studio and classroom‐based Technology Enhanced Learning (TEL) on student learning and engagement as the participants expressed differing responses to their own learning and community of practice at each site. The choice of arts‐based educational research methods used for this study allowed the relationships between place, lived experience, and community to be explored. Students, in effect, became investigators of their own practice through engagement in a rigorous set of visual methods, which placed the tools directly into their hands.     

Defining and seeking to identify critical Internet literacy: a discourse analysis of fifth‐graders' Internet search and evaluation activity

Pedagogic focus is shifting increasingly from teaching students to search the Internet efficiently to encouraging critical Internet literacy, but this paper argues that these more complex and subtle skills are both challenging to teach and difficult to identify. The paper presents an analysis of the discourse of triads of fifth graders undertaking an Internet search task that emphasised decisions relating to the trustworthiness and relevance of websites. The analysis uses two lenses – the Vygotskian concept of obuchenie and Mercer's notion of ‘inter‐thinking’ – to help identify discourse markers that could support teachers in identifying and teaching critical Internet literacy. More work is needed, but it is argued that if our goal is to develop critical Internet literacy, the concept of obuchenie helps us to understand the socio‐cognitive prerequisites of group learning in Internet searching tasks, while the concept of ‘interthinking’ offers us a distribution mechanism that can be applied in helping students acquire the skills of independent and critical analysis as they carry out those tasks.     

Cultivating minority scientists: Undergraduate research increases self‐efficacy and career ambitions for underrepresented students in STEM

In this study, Social Cognitive Career Theory (SCCT) is used to explore changes in the career intentions of students in an undergraduate research experience (URE) program at a large public minority‐serving college. Our URE model addresses the challenges of establishing an undergraduate research program within an urban, commuter, underfunded, Minority‐Serving Institution (MSI). However, our model reaches beyond a focus on retention and remediation toward scholarly contributions and shifted career aspirations. From a student's first days at the College to beyond their graduation, we have encouraged them to explore their own potential as scientists in a coordinated, sequential, and self‐reflective process. As a result, while the program's graduates have traditionally pursued entry‐level STEM jobs, graduates participating in mentored research are increasingly focused on professional and academic STEM career tracks involving post‐graduate study. In addition to providing an increasingly expected experience and building students’ skills, participation in undergraduate research is seen to have a transformative effect on career ambitions for many students at MSIs. While undergraduate research is often thought of in context of majority‐serving institutions, we propose that it serves as a powerful equalizer at MSIs. Building on the institutional characteristics that drive diversity, our students produce scholarly work and pursue graduate degrees, in order to address the long‐standing under‐representation of minorities in the sciences. © 2016 Wiley Periodicals, Inc. J Res Sci Teach 54: 169–194, 2017     

Learning anatomy through Thiel‐ vs. formalin‐embalmed cadavers: Student perceptions of embalming methods and effect on functional anatomy knowledge

Thiel‐embalmed cadavers, which have been adopted for use in anatomy teaching in relatively few universities, show greater flexibility and color retention compared to formalin‐embalmed cadavers, properties which might be considered advantageous for anatomy teaching. This study aimed to investigate student attitudes toward the dissection experience with Thiel‐ compared to formalin/ethanol‐embalmed cadavers. It also aimed to determine if one embalming method is more advantageous in terms of learning functional anatomy through the comparison of student anterior forearm functional anatomy knowledge. Student opinions and functional anatomy knowledge were obtained through use of a questionnaire from students at two medical schools, one using Thiel‐, and one using more traditional formalin/ethanol‐embalmed cadavers. Both the Thiel group and the formalin group of students were surveyed shortly after completing an anterior forearm dissection session. Significant differences (P‐values <0.01) in some attitudes were found toward the dissection experience between cohorts using Thiel‐ vs. formalin‐embalmed cadavers. The Thiel group of students felt more confident about recognizing anatomy in the living individual, found it easier to identify and dissect anatomical structures, and indicated more active exploration of functional anatomy due to the retained flexibility of the cadaver. However, on testing, no significant difference in functional anatomy knowledge was found between the two cohorts. Overall, although Thiel embalming may provide an advantageous learning experience in some investigated areas, more research needs to be carried out, especially to establish whether student perception is based on reality, at least in terms of structure identification. Anat Sci Educ 11: 166–174. © 2017 American Association of Anatomists.     

Arts‐based responses to teaching poetry: a literature review of dance and visual arts in poetry education

This study investigates the use of dance and visual arts in poetry education by systematically reviewing peer‐reviewed articles published on the topic from 2000 to 2019. The review focuses on empirical results in studies concerned with using dance and visual arts in poetry education and implications for poetry pedagogy in research and practice. The review encompasses 21 articles that were analysed thematically. The thematic analysis yielded seven themes: expand and deepen understandings of poetry; break curricular boundaries; interaction and collaboration; personal knowledge, reflection and experience; increase interest, motivation and confidence; challenges, limitations and constraints; and disciplinary knowledge. With research on this topic having increased in the 2010s, the findings show the potentials and challenges of using dance and visual arts in different ways in poetry education. Still, the research field is understudied, and many questions remain unanswered. Consequently, this study concludes with suggestions for future research on arts‐based responses in poetry education. The study adds to the dialogue on poetry education and contributes to raising awareness of the possibilities and challenges of using dance and visual arts in the poetry classroom.     

The effect of face‐to‐face teaching on student knowledge and satisfaction in an undergraduate neuroanatomy course

The total number of anatomy teaching hours has declined in medical courses worldwide. Conversely, face‐to‐face teaching in undergraduate neuroanatomy at Macquarie University increased by 50% in 2011. Our aim was to investigate whether this influenced student performance and overall satisfaction with the course. One hundred eighty‐one students consented to participate in this study. A questionnaire was administered to rate the course, and final grades from the old and new unit cohorts were compared. The old and new unit cohorts did not differ in their final grades (P = 0.249). However, the new unit cohort rated their knowledge of the material higher compared to the old unit cohort (P = 0.013), and reported higher levels of satisfaction with the course (P < 0.001). In an era in which teaching time for anatomy has been reduced at tertiary institutions, and there is much lamenting of the effect this will have, there is a paucity of literature on whether the decrease really influences neuroanatomical knowledge. This is the first study, to the best of our knowledge, to show that an increase in total face‐to‐face teaching hours does not improve student grades, but does increase student satisfaction with the course. Anat Sci Educ 6: 239–245. © 2012 American Association of Anatomists.     

The use of visual schedules and work systems to increase the on‐task behaviour of students on the autism spectrum in mainstream classrooms

Apparent differences in executive function can lead to challenges for students on the autism spectrum in mainstream settings. Difficulties with staying on‐task and transitioning between tasks and task elements can interfere with students’ participation in educational activities and lead to stress and anxiety. While the use of visual supports, such as visual schedules and work systems, has been shown to be effective in supporting students to stay on‐task in special education and autism‐specific settings, there is little research to support the use of these strategies by teachers in mainstream classrooms. This study evaluated the use of visual schedules and work systems in supporting four students on the autism spectrum to stay on‐task and work independently in a mainstream setting. These strategies were implemented by teachers as inclusive practices, and evaluated using observations within the natural classroom environment to examine their feasibility in mainstream settings. All participants demonstrated improvements in on‐task behaviours. Results for other, secondary, dependent variables were mixed, with some students showing reduced off‐task behaviours and increased productivity. The implications for clinical practice and future research directions are discussed.     

Levelling the reading gap: a socio‐spatial study of school libraries and reading in Singapore

This article takes a comparative socio‐spatial approach at the intersection of social class and reading politics to provide a fresh way of examining school reading policies and practices, unearthing previously hidden spaces of inequity for reading intervention. The juxtaposition of two nested case studies in Singapore, one of an elite all‐boys' school and another of a co‐educational government school with students in different academic tracks, revealed inequitable practices, specifically in the designs and uses of school library spaces between schools serving different social classes. The study argues that attempts to design reading interventions should move away from the view of student‐as‐problem to structure‐as‐problem in order to discover new perspectives for reading intervention. Additionally, this study demonstrates how foregrounding social class in educational research is necessary for effective design of educational strategies that aim to transform education and society by narrowing the gap between students from different social classes.     

Understanding neurophobia: Reasons behind impaired understanding and learning of neuroanatomy in cross‐disciplinary healthcare students

Recent studies have highlighted a fear or difficulty with the study and understanding of neuroanatomy among medical and healthcare students. This has been linked with a diminished confidence of clinical practitioners and students to manage patients with neurological conditions. The underlying reasons for this difficulty have been queried among a broad cohort of medical, dental, occupational therapy, and speech and language sciences students. Direct evidence of the students’ perception regarding specific difficulties associated with learning neuroanatomy has been provided and some of the measures required to address these issues have been identified. Neuroanatomy is perceived as a more difficult subject compared to other anatomy topics (e.g., reproductive/pelvic anatomy) and not all components of the neuroanatomy curriculum are viewed as equally challenging. The difficulty in understanding neuroanatomical concepts is linked to intrinsic factors such as the inherent complex nature of the topic rather than outside influences (e.g., lecture duration). Participants reporting high levels of interest in the subject reported higher levels of knowledge, suggesting that teaching tools aimed at increasing interest, such as case‐based scenarios, could facilitate acquisition of knowledge. Newer pedagogies, including web‐resources and computer assisted learning (CAL) are considered important tools to improve neuroanatomy learning, whereas traditional tools such as lecture slides and notes were considered less important. In conclusion, it is suggested that understanding of neuroanatomy could be enhanced and neurophobia be decreased by purposefully designed CAL resources. This data could help curricular designers to refocus attention and guide educators to develop improved neuroanatomy web‐resources in future. Anat Sci Educ 11: 81–93. © 2017 American Association of Anatomists.     

Engineering education research in European Journal of Engineering Education and Journal of Engineering Education: citation and reference discipline analysis

The authors, citations and content of European Journal of Engineering Education (EJEE) and Journal of Engineering Education (JEE) in 1973 (JEE, 1975 EJEE), 1983, 1993, 2003, and available 2013 issues were analysed. Both journals transitioned from house organs to become engineering education research (EER) journals, although JEE transitioned first. In this process the number of citations rose, particularly of education and psychology sources; the percentage of research articles increased markedly as did the number of reference disciplines. The number of papers per issue, the number of single author papers, and the citations of science and engineering sources decreased. EJEE has a very broad geographic spread of authors while JEE authors are mainly US based. A ‘silo’ mentality where general engineering education researchers do not communicate with EER researchers in different engineering disciplines is evident. There is some danger that EER may develop into a silo that does not communicate with technically oriented engineering professors.     

提升新建本科院校工程教育研究水平的实证研究——基于福建工程学院2005-2014年研究文献的可视化分析

利用CiteSpace软件,通过定量分析CNKI平台上收录的文献,首次对福建工程学院教师发表的工程教育期刊研究论文进行计量学研究和可视化分析,以此了解学校教师对工程教育研究领域的关注度及研究的发展轨迹,指出存在的问题及与国际工程教育研究关注热点的差距,并就提高学校教育研究水平提出建议。