Learning Environments: The Case for Evidence-Based Practice and Issue-Driven Research

In his thought-provoking review of current trends in educational research, Winn offers advice to practitioners and to researchers concerning the role of computer-based simulations in education (Winn, W. (2000). Educ. Psychol. Rev. 14, 331–351). In this critique, I offer two proposals for consideration by those who wish to make practical recommendations about learning environments: (1) Recommendations for practice should be based on specifically relevant evidence. (2) The available methods for collecting evidence should not exclude controlled experiments; instead, researchers should be free to choose among experimental or observational methods, use quantitative or qualitative measures, focus on artificial or naturalistic settings, and invent new techniques as needed. In short, I join the call for evidence-based practice and issue-driven research.     

Significance,Effect Sizes,Stepwise Methods,and Other Issues: Strong Arguments Move the Field

The author asserts that editors should publicly declare their expectations and expose the rationales for editorial policies to public scrutiny. He argues that editorial policies ought to require effect size reporting, as those at 17 journals now do. He also argues (a) that score reliabilities should be reported; (b) that stepwise methods should not be used; (c) that structure coefficients should be interpreted; and (d) that if used wisely, confidence intervals differ from hypothesis tests in important ways. The use of noncentral t and F distributions to create confidence intervals about effect sizes also is appealing.     

Risking the future: Democratic participation in technological innovation

Drawing on the voices of students, parents and teachers from a secondary school located in a regional area of Australia in a township characterised by its high welfare dependency and Indigenous population, this article explores the tensions between how marginalised students see themselves and how they are seen by their peers, teachers and fellow community members, with reference to Bourdieu's concept of habitus. The article moves towards a theorisation of a reproductive habitus (those who recognise the constraint of social conditions and conditionings and tend to read the future that fits them) and a transformative habitus (those who recognise the capacity for improvisation and tend to generate opportunities for action in the social field). While some teachers appear to be attempting a transformation of students, the article concludes that instead, teachers should value and give voice to who students are, as they identify themselves. They should be more concerned to transform schooling; to provide educational opportunities that transform the life experiences of and open up opportunities for all young people, especially those disadvantaged by poverty and marginalised by difference.     

Informing in the Information Age: How to Communicate Measurement Concepts to Education Policy Makers

Current educational policies rely on educational assessments. However, the technical aspects of assessments are often unknown to policy makers, which is dangerous because sound assessment policy requires knowledge of the strengths and limitations of educational tests. In this article, we discuss the importance of informing policy makers of important psychometric issues that should be considered whenever tests are proposed for specific purposes. We discuss the types of information that are important to communicate to policy makers, how to best convey this information in a manner in which it can be understood, and how to be seen as a valuable source of information to education policy makers. We end with some specific steps organizations such as NCME can take to inform policy makers and advocate for valid educational assessment policies.     

Twenty-Year Evolution of Discourse System of China’s Educational Economics

Although the discourse system of China’s educational economics has a short history of only 20 years, it has gained an important position in the discourse system of pedagogy. This system consists of rich discourse branches including the relations between education and economy, educational investment and educational finance, educational cost and educational benefit, changes and innovation in education system and utilization and efficiency of educational resources. All the above discourse branches show various characteristics in different stages. From their development and changes, the following features of discourse system of educational economics can be drawn: the specialty of discourse, the trend of time of discourse themes, the positivism of discourse expressions and the applicability of discourse nature and contention of Chinese perspectives. To further improve the quality of the discourse system, the emphasis of educational economic studies should be laid upon the improvement of research attitude, theoretical basis, content and methodology. Translated from Educational Research, 2004:12     

教育学中国化百年反思

Pedagogy was initially imported into China, known as “a discipline imported from abroad”. The introduction of Pedagogy and its Sinicization almost went hand in hand. The Sinicization has gone through six stages, which showed that more attention should be paid to Chinese educational reality, scientific research methods and the relationship between academic research and ideology. What is more, original research should be advocated and the relationship between national cultural and educational heritage and foreign educational theory should also be handled well. Translated from Gaodeng Jiaoyu Yanjiu 高等教育研究 (Journal of Higher Education), 2006, (6): 86–92     

A Self-Regulated Learning Approach to Teaching Educational Psychology

In this paper, we describe an undergraduate educational psychology course that utilizes self-regulated learning as the organizing principle. The course aims to facilitate students' development in self-regulated learning and to promote students' understanding of how to embed instruction for self-regulated learning strategies into classroom teaching. In the first section of the paper, we develop the rationale for this position and identify underlying assumptions we believe should guide the development and implementation of such a program. In the second section of the paper, we demonstrate how we have incorporated these assumptions in a basic educational psychology course.     

Dewey and Possibility: Challenging Neoliberalism in Education

In recent decades, critiques of neoliberalism have been widespread within the scholarly literature on education. Despite the lack of a clear definition of what neoliberalism in education is and entails, researchers from different fields and perspectives have widely criticized the neoliberal educational mindset for its narrowness, lack of democratic engagement, and objectification of educational practices. In this essay, through an analysis of a particular aspect of Dewey's oeuvre — namely, Dewey's commitment to the “unattained” and “wonderful possibilities” of experience and education — I argue that educational neoliberalism should be refuted above all on the basis of its lack of intelligence and professional weakness. With regard to this, I contend that educational neoliberalism, despite its relative sophistication, is but another form authoritarian teaching. Dewey, in contrast, challenged the view of education as a means for achieving predetermined goals, and instead conceived of education as an end in itself, something imbued with the unpredictable space of pure possibility.     

Educational Assessment Knowledge and Skills for Teachers

The 1990 Standards for Teacher Competence in Educational Assessment of Students ( AFT, NCME, & NEA, 1990 ) made a documentable contribution to the field. However, the Standards have become a bit dated, most notably in two ways: (1) the Standards do not consider current conceptions of formative assessment knowledge and skills, and (2) the Standards do not consider teacher knowledge and skills required to successfully work in the current accountability and “standards‐based reform” context. This article briefly reviews the 1990 Standards and their influence, describes some other lists of assessment knowledge and skills that might be considered in updating them, and then proposes educational assessment knowledge and skills for teachers that reflect current teacher assessment needs. This set of competencies should help focus the work of teachers, teacher supervisors, professional developers, teacher educators, and others responsible for teachers’ assessment knowledge and skills.     

Singapore’s educational policy through the prism of student voice: recasting students as co-agents of educational change and ‘disrupting’ the status quo?

This paper examines the implementation of Singapore’s landmark policy, ‘Thinking Schools, learning Nation’ (TSLN), in developing ‘thinking students’ through the prism of student voice. In the context of twenty-first century education and the growing importance of student voice in education, this paper argues that the time might be right to ‘disrupt’ Singapore’s education status quo and incorporate meaningful student voice in education policies. Instead of perceiving students as mere subjects of educational policy enactment, and seeing policy as something that is done to them, it should be reconceptualised as something which is done with them; importantly, students should be recast as key co-agents of educational change, consistent with TSLN’s reconceptualization of learners as ‘thinking students’. Basing its arguments on findings from a qualitative case study of students’ perceptions and schooling experiences of critical thinking in TSLN, this paper considers the case for the inclusion of significant student voice in Singapore’s educational policy reforms. It fills gaps in research on student voices in Singapore’s educational reforms and TSLN’s research from students’ perspective. The paper suggests that the inclusion of student voice in educational reform might be the next landmark step in ‘disrupting’ its educational landscape after the ‘big bang’ of TSLN.     

Statistical Significance and Effect Size in Education Research: Two Sides of a Coin

Abstract

In education research, statistical significance and effect size are 2 sides of 1 coin; they complement each other but they do not substitute for each other. Good research practice requires that, to make sound research decisions, both sides should be considered. In a simulation study, the sampling variability of 2 popular effect-size measures (d and R ²) was examined. The variability showed that what is statistically significant may not be practically meaningful, and what appears to be practically meaningful could have been the result of sampling error, thus not trustworthy. Some practical guidelines are suggested for combining the 2 sources of information in research practice.     

Educational trust: relational and structural perspectives on young people on the margins of the education system

Background: Across Europe and the Nordic countries, it is widely agreed that the high proportion of 15–30-year olds not in employment, education or training is a challenge, which needs to be tackled by focusing on education. The political and institutional focus is on individual training readiness, individual qualification processes, individual building of confidence in oneself and so forth, culminating in an overall individual perspective.

Purpose: The study argues for a shift in focus away from an individual perspective on young people on the margins of education and towards a relational perspective that takes the social environment and the education system into account.

Sample: Respondents were 20 young people aged 17–24 who were participating in a specific project in a provincial town in Denmark, the aim of which was to encourage the youths to re-enter education.

Design and methods: Qualitative data were collected through: (1) 40 semi-structured qualitative interviews with 11 young people on the margins of the education system, and (2) observations of 11 respondents’ participation in educational activity. The analysis was based on relational and social constructionist theories.

Findings: The analysis of data from this small-scale study provides evidence to suggest that a shift in the current focus on the individual young person on the margins of education is needed. The concept of ‘educational trust’ is introduced as a supplement to the individual concept of self-confidence in order to capture the socially constructed aspects of the young adult’s participation in education.

Conclusions: We identify three overall components of educational trust: (1) social security and recognition, (2) flexibility in structures and (3) progression in skills. The concept of educational trust, it is suggested, creates a shift in focus from the individual young person to the role and function of the education system in aiming to reach the target of more young people completing education.     

An investigation into the effects of LMS on headteachers’ use of time

Background: HIV/AIDS poses a major threat to development and poverty alleviation, particularly in Sub-Saharan Africa. Education has been declared an effective preventative approach and the single most powerful weapon against HIV transmission. However, there is a paucity of research on the type of education required, the appropriate teaching/learning methods, and generally how such education influences change of attitudes and behaviour on the part of the students.

Purpose: In the context of Swaziland, a country with the highest HIV prevalence rate at 42.6%, this study explores how students at the University of Swaziland perceive an HIV/AIDS course. The students' comments cover the course content, the teaching/learning methods used in the course, the regulations governing the course, and the impact of the course.

Sample and design: A sample of 15 students was randomly selected from all the year 1 Faculty of Agriculture students to form focus group 1. Another sample of 15 was randomly selected from year 3 students who were enrolled on a new programme to form focus group 2. Of the 15 invited students in each focus group, 11 (seven males and four females) attended the focus group 1 meeting, and 12 (eight females and four males) attended the focus group two meeting. A pilot-tested and pre-prepared interview schedule was used during the focus group interviews to collect information on the students' perceptions. This data was analysed using themes.

Results: The findings reveal that the perceptions of the two groups were very similar. The students identified some topics that they felt were treated in great depth, and other topics, particularly dealing with traditional healers, that they felt should be added to the course content. They further criticised the excessive use of the lecture method in teaching the course and recommended that more visual materials, presentations by HIV-positive people and workers, as well as site visits to relevant places should be encouraged to make the course more interesting and give it greater educational value. Overall, the students felt that the course had been effective in changing their attitudes and behaviour. The students cited numerous benefits that they had derived from this course and recommended that it should be offered to all first-year students at the university.

Conclusions and recommendations: This small scale study suggests that providing HIV/AIDS education is an important intervention in changing the attitudes and behaviour of university students and in combating the spread of HIV. It further stresses the importance of engaging all the relevant stakeholders, particularly the students, in working out the content of such a course.     

Educational Psychology: What Do We Teach, What Should We Teach?

Teacher education students sometimes question the value of educational psychology courses even though educational psychology textbooks are primarily concerned with understanding and improving classroom teaching and learning. A survey of current educational psychology textbooks and instructors reveals that (a) most texts cover a wide variety of topics, (b) instructors rate most of these topics as important, (c) there are large variations in depth of coverage among texts, and (d) all texts contain numerous classroom applications. The questionable reputation of the educational psychology course may stem from its broad coverage. A dozen or more topics in one semester may decrease the probability that most students will achieve a solid grasp of any one topic, leaving students uncertain about the course's meaning and applicability. A proposed solution is to offer the introductory course as a two-semester sequence, with the second course offered as an elective.     

Interpretive validity theory: mapping a methodology for validating educational assessments

Background:?Validity theory has evolved significantly over the past 30 years in response to the increased use of assessments across scientific, social and educational settings. The overarching trajectory of this evolution reflects a shift from a purely quantitative, positivistic approach to a conception of validity reliant on the interpretation of multiple evidence sources integrated into validity arguments. Moreover, within contemporary validity, interpretation has been emphasised as a central process; however, despite this emphasis, there have been few explicit articulations of specific interpretive methodologies applicable to the practice of validation.

Purpose:?To link contemporary theoretical foundations in validity to practical methods and structures to help guide the collection and analysis of interpretive validity evidence. By building upon existing validity theory, this paper aims to provide greater clarity on the practice of validation and contribute toward the larger developing framework for the validation of educational assessments.

Source of evidence:?An interdisciplinary, integrative review of over 60 research articles and sources related to the theory and practice of educational validation and interpretive inquiry approaches. Sources include literature from the fields of educational assessment and more broadly social scientific research.

Main argument:?As assessments in education increasingly aim to measure complex constructs that are value-laden and socially dependant, validity theory must keep pace and evolve in ways that address the inherent complexities associated with contemporary educational assessment. Through this paper, I assert that a greater understanding of interpretive methodologies represents one of the most promising areas for development of validation theory and practice. Specifically, I argue that dialectic, hermeneutic and transgressive forms of inquiry can be integrated within current argument-based structures for the collection, analysis and representation of validity evidence in several useful ways.

Conclusions:?Interpretive inquiry processes, namely dialectic, hermeneutic and transgressive forms of interpretation, serve to expand validation practice to include diverse evidences for the generation of multiple-perspective validity arguments. The paper concludes with specific implications for future research and practice within the field of interpretive validity theory.     

Teaching-learning methods and their effect on professional development and the development of graduates’ competencies / Métodos de enseñanza-aprendizaje y su efecto en el desarrollo profesional y competencial de los egresados

This article analyses the effect of the teaching-learning methods used in Spanish universities on three measures of educational output: average mark, graduates’ assessment of their professional performance in different dimensions, and their assessment of the acquisition of professional competencies and skills. Multi-level models were used in which graduates (first level) are grouped by field of study (second level). The Class attendance and Written work methods have the most influence on the average mark but influence the graduates’ working future the least, as measured with assessments of professional aspects or competencies. In contrast, Problem-based learning, In-company internships and Practical and methodological knowledge are the methods that bear the most influence on the graduates’ professional careers and their development of specific professional competencies.     

Introducing Secondary Education Students to Algorithms and Programming

In Greece, the development of the teaching of Information Technology (IT) in schools has been greatly influenced by the rapid development of technology, making IT literacy a priority for all individuals. Consequently, the teaching of algorithms and programming, with the ulterior motive of teaching modeling as well as problem solving, has been greatly limited in Secondary Education. However, we strongly believe that algorithms and programming constitute an important intellectual tool and should be included in basic education. In any case, both the research literature findings, as well as, our own experience confirm the fact that novice programmers come up against many mental obstacles in their attempts to understand the functioning of programs or the construction of algorithms. In order to deal with these difficulties and successfully teach the elementary concepts of algorithms and programming, we have developed didactic scenarios, which are based on specially designed educational software. In conjunction with this, we are attempting to develop a program for the systematic training of those students who will become IT teachers in Secondary or Primary Education. The most significant findings of our research are summarized as follows: (a) The development of educational software and its experimental use in the teaching process allow us to formulate several general rules related to the specific didactic characteristics, which these environments should include. (b) Educational software is effective only when it is incorporated within the framework of the didactic scenarios that the teacher organizes and which are supported by the software. (c) Teachers do not spontaneously use educational software in the context of this rationale. Therefore, specific training is required so that they adopt and use such software in didactic scenarios.     

Learning statistics with interactive pictures using R Shiny: Generally preferred,but not generally advantageous

Constructing interactive web apps has become more accessible for instructors, for example, by using the R package Shiny. Here we explored learners' preferences and the efficiency of interactive simulations versus static pictures in acquiring statistics knowledge of Cohen's d and standard normal distribution. Results revealed that students' spontaneous interaction with pictures was infrequent (pilot study, N = 26). While prompts (Exp. 1, N = 152) effectively ensured the manipulation of simulations, student exposure to interactive simulations led to longer learning times though similar test performance compared with student exposure to static pictures. Multiple interactive representations led to lower test performance than single interactive and static representations (Exp. 2, N = 117). Though no advantage was gained regarding learning outcomes, participants preferred the interactive variant (Exp. 3, N = 119). Taken together, this study demonstrates that the superiority of interactive pictures cannot be assumed to hold in general. Further work should evaluate how mental model construction can be effectively scaffolded by interactive simulations.     

Are Educational Psychology Courses Educationally and Psychologically Sound? What Textbooks and Teachers Say

Educational psychology courses should be the best taught courses on college campuses given that its instructors and textbook authors are resident experts in learning and teaching. More specifically, we contend that educational psychology courses should adhere to six principles. Educational psychology courses should: (a) be driven by teaching models, (b) integrate theory and practice, (c) provide opportunities to practice teaching skills, (d) present an integrated model for instructional planning, (e) prepare teachers to teach learning strategies, and (f) help students learn. We surveyed practicing teachers and analyzed current educational psychology texts and found that these principles are not upheld. We report on the principles, our findings, and how an educational psychology course that upholds these principles might be developed.     

Guidelines for Interpreting and Reporting Subscores

Recent research has proposed a criterion to evaluate the reportability of subscores. This criterion is a value‐added ratio (VAR), where values greater than 1 suggest that the true subscore is better approximated by the observed subscore than by the total score. This research extends the existing literature by quantifying statistical significance and effect size for using VAR to provide practical guidelines for subscore interpretation and reporting. Findings indicate that subscores with VAR ≥ 1.1 are a minimum requirement for a meaningful contribution to a user's score interpretation; subscores with .9 < VAR < 1.1 are redundant with the total score and subscores with VAR ≤ .9 would be misleading to report. Additionally, we discuss what to do when subscores do not add value, yet must be reported, as well as when VAR ≥ 1.1 may be undesirable.