Integrating design science research and design based research frameworks for developing education support systems

Education and Information Technologies - This paper proposes an integrated research framework that takes advantage of the similarities of design science research (DSR) and Design-based research...     

A time sequence-oriented concept map approach to developing educational computer games for history courses

Concept maps have been recognized as an effective tool for students to organize their knowledge; however, in history courses, it is important for students to learn and organize historical events according to the time of their occurrence. Therefore, in this study, a time sequence-oriented concept map approach is proposed for developing a game-based environment to facilitate students' learning of historical events and their organization during the gaming process. With this approach, students can easily learn the precedence relationships among the historical events that occurred in different time periods with the time sequence-oriented concept map. To evaluate the effectiveness of the proposed approach, a historical role-playing game has been developed for an elementary school history course to examine the students' performance in terms of learning motivation, self-efficacy and learning achievements. A subject unit, the “Siege of Fort Zeelandia by Zheng Cheng-Gong,” was chosen as the history topic. The results show that the proposed approach can significantly enhance the students' learning achievement, but did not affect their learning motivation or self-efficacy for the history course. As a consequence, it is concluded that students can benefit from concept maps in terms of enhancing their learning achievement, but they do not necessarily enjoy using concept maps in game-based learning activities.     

Development of a competency model and tailored assessment method for high school science teachers utilizing a flipped learning approach

Many professional development programs aim to improve student outcomes by enhancing teacher competencies. Effective evaluation of these programs requires a clear delineation of the competencies to be gained. A competency model was developed to evaluate the impact of a teacher professional program that aimed to improve teachers’ ability to effectively implement technologically engaged modules in a flipped classroom setting. Competencies were identified via participatory evaluation techniques and assessments were aligned to the competencies. The competency of teachers in the knowledge, skills, and abilities needed for creation and delivery of effective flipped lessons can be tracked using a radar graph to guide tailored professional development.

     

A model for using a concept inventory as a tool for students' assessment and faculty professional development

This essay describes how the use of a concept inventory has enhanced professional development and curriculum reform efforts of a faculty teaching community. The Host Pathogen Interactions (HPI) teaching team is composed of research and teaching faculty with expertise in HPI who share the goal of improving the learning experience of students in nine linked undergraduate microbiology courses. To support evidence-based curriculum reform, we administered our HPI Concept Inventory as a pre- and postsurvey to approximately 400 students each year since 2006. The resulting data include student scores as well as their open-ended explanations for distractor choices. The data have enabled us to address curriculum reform goals of 1) reconciling student learning with our expectations, 2) correlating student learning with background variables, 3) understanding student learning across institutions, 4) measuring the effect of teaching techniques on student learning, and 5) demonstrating how our courses collectively form a learning progression. The analysis of the concept inventory data has anchored and deepened the team's discussions of student learning. Reading and discussing students' responses revealed the gap between our understanding and the students' understanding. We provide evidence to support the concept inventory as a tool for assessing student understanding of HPI concepts and faculty development.     

A deterministic approach to research in instructional science 1

A deterministic alternative to probabalistic theory and research is proposed and justified on both rational and empirical grounds. Direct tests of deterministic behavior theories are demanding but they are not only possible but are shown to be quite feasible. The main requisite is that of realizing suitable idealized test conditions. Some deterministic theories have been tested under idealized behavior conditions with a level of empirical support which goes far beyond what is normally found in behavioral research. Moreover, deterministic support in the laboratory is shown to necessarily imply probabalistic applicability in the real world—without field testing.     

A semi-custom design methodology for design performance optimization

We present a semi-custom design methodology based on transistor tuning to optimize the design performance Compared with other transistor tuning approaches, our tuning process takes the cross-talk effect into account and prominently reduces the complexity for circuit simulation and analysis by decomposing the circuit network utilizing graph theory. Furthermore, the incremental placement and routing for the corresponding transistor tuning in conventional approaches is not required in our methodology, which might induce timing graph variation and additional iterations for design convergence. This methodology combines the flexible automated circuit tuning and physical design tools to provide more opportunities for design optimization throughout the design cycle.     

A concept map approach to developing collaborative Mindtools for context‐aware ubiquitous learning

Recent advances in mobile and wireless communication technologies have enabled various new learning approaches which situate students in environments that combine real‐world and digital‐world learning resources; moreover, students are allowed to share knowledge or experiences with others during the learning process. Although such an approach seems to be promising and innovative, researchers have indicated several problems when applying it to practical applications, in particular, the lack of proper strategies or tools to assist the students to learn collaboratively in such a learning scenario with abundant content. Students might feel interested when using the mobile devices to learn; however, without proper assistance or guidance, their learning achievements are usually disappointing. To cope with this problem, this study proposes a concept map‐oriented Mindtool for collaborative ubiquitous learning. Experimental results from a natural science course in an elementary school show that this approach not only enhances learning motivation but also improves the learning achievements of the students.     

Researching assessment as social practice: Implications for research methodology

Recent educational journals on both sides of the Atlantic have seen a resurgence of debate about the nature of educational research. As a contribution to these debates, this paper draws on theoretical and methodological ‘thinking tools’ of French sociologist Pierre Bourdieu. Specifically, the paper explores what Jenkins [Jenkins, R. (2002). Pierre Bourdieu. London: Routledge and Falmer] refers to as Bourdieu's “reflexive epistemological pluralism” and its implications for research into higher education, with a particular focus on assessment as social practice. This particular theoretical and methodological understanding is used to critically reflect on a study conducted in 2005 on the impact of a policy on anonymous examination marking which was implemented at the University of Cape Town in 2004. The study collected both quantitative data of student examination performance pre- and post-policy implementation, as well as interviews with course conveners. The paper argues that when viewed interdependently the data offers insight into some of the “principles of vision and division” [Bourdieu, P. (1996). The state nobility: Elite schools in the field of power. Cambridge: Polity Press] at work in assessors’ judgment-making process. The assessors’ deliberations expose ideological tensions between the dual challenges of equity and excellence in the context of a historically white liberal university under transformation.     

Concept maps as assessment in science inquiry learning - a report of methodology

Increasing availability of technologies, such as CD ROMs and the World Wide Web, in schools means that more teachers will have the potential to implement student-centred, inquiry-based approaches to learning. Assessing what each student knows in a broad subject area, such as science, is difficult. Assessing students' understanding in circumstances where each student may pursue different topics of study, where there is no way to predict in advance what those topics of study will be and where the possible topics of study include natural phenomena which are only beginning to be studied by professional scientists, is even more difficult. The authors recently faced such a challenge. To meet the challenge, the authors chose to assess student learning using an open-ended concept map activity combined with a rubric which extracts quantitative information about the quality of understanding from each map. This article describes the method the authors developed, including tests of reliability and validity.     

Lecturers’ views of assessment design,marking and feedback in higher education: a case for professionalisation?

Abstract

Research on professional assessment practice in higher education does not always take account of lecturers’ perceptions and experiences, or their disciplinary context. This questionnaire study was designed to explore lecturers’ views about three inter-related elements of professional assessment practice: assessment design, marking and feedback. It consisted of two questionnaires: the Assessment Design Inventory (ADI), previously published, and the Assessment, Marking and Feedback Inventory (AMFI) which was newly developed for this study. The two main purposes of the research were to: i) establish the validity of these two questionnaires as research tools, ii) explore the existence of professional practice in assessment and analyse any perceived hindrances as well as possible effects of participants’ subject discipline. 356 lecturers from two UK universities, with a range of teaching experience and representing soft and hard disciplines, took part. Results indicated that the ADI and the AMFI were robust instruments. Findings showed evidence of assessment professionalism, but also some areas where it was lacking, together with a perceived need for formal training. Participants recognised that there were certain hindrances in putting their pedagogical beliefs into practice. The implications of this study are discussed in terms of advancing the sector’s understanding of assessment professionalism.     

A research methodology for studying how people think

Although science education intends to help students learn to think, research in this area does not usually use psychological research on how people think. The purpose of this article is to describe one type of research, commonly called information-processing psychology. Its goal is understanding how people think while doing complex tasks. It uses detailed data, usually from individual subjects, and develops precise yet powerful models of human performance, often by using a computer. After describing information-processing research, we illustrate it with two studies. The first shows how computer models are used to explain thinking. A computer program models the knowledge needed to understand and use a physics textbook. The second study shows how information-processing approaches can be used systematically but more simply. This study clarifies why students find it so difficult to master the “factor-label” method for converting chemical units. The article concludes with a discussion of guidelines and suggestions for using information-processing ideas.     

Knowledge engineering: An alternative approach to curriculum design for science education at a distance

Most of the curriculum design models within the technical-scientific approach utilise the rational and sequential process of designing and inter-relating the various elements of the design process. While this procedure may be efficient and adequate for conventional education in which the designers are professional science educators, there is doubt if it satisfies the particular needs of distance education. The experience accumulated through a multi-disciplinary team approach to distance learning courseware development for higher education at the University of Southern Queensland Distance Education Centre motivated this study which primarily focused on a search for an alternative approach to curriculum development with a more satisfactory functional value. Using selected units in Engineering as a focus, an experiment was designed in which a variant of the classical Wheeler model was used. This paper reports the results of this experiment. The implications for contemporary curriculum development initiatives in science especially within distance education settings are pointed out. Specializations: science education, learning strategies, curriculum development, instructional design, research and development in distance education. Specializations: Cognitive Science, curriculum development, instructional design, expert systems, research and development in distance education. Specializations: science education, learning strategies, curriculum development, instructional design, research and development in distance education.     

A participatory action research approach to developing youth-friendly strategies for the prevention of teenage pregnancy

Teenage pregnancy among school-going youth is a concern worldwide, but in socially–economically challenged environments it is a result of, and contributory factor to, a complex web of social injustice. In South Africa, most of the school-based prevention interventions to date have been adult-designed and imparted, with the voice of the target audience – the youth – being ignored. The purpose of this participatory action research study was to involve school-going youth in the research and development of prevention interventions, tailored to meet their perceived needs. This article focuses on the first cycle where 24 high school participants interrogated their own and their peers’ narratives about teenage pregnancy so as to determine a way forward. Findings indicate that, although the youth perceive parenthood while they are still studying to have a negative impact on their future life goals, the prevention messages mediated by educators and other adults do not take into consideration the needs and lifestyle of teenagers within their specific social context. The implications of the three themes which emerged from the thematic analysis of the interviews, open-ended questionnaires and visual data are discussed to provide guidelines for the design of more youth-friendly prevention education to inform the next cycle of the research. Since teenage pregnancy is a global problem, the findings of this study have international relevance.     

A methodological approach to developing an assessment procedure for testing the neurobehavioral maturity of preterm infants

Using data from 179 preterm infants, a neurobehavioral maturity assessment was developed by using a process in which clusters characterized by conceptual coherence and face validity were systematically subjected to statistical analyses designed to test whether they also had high test-retest reliability, statistical cohesion, and developmental validity. The psychometric soundness of the test items was made a precondition for their inclusion into the assessment procedure. Also tested were cluster redundancy, as well as the impact of gestational and conceptional age, and of postbirth influences on the functions tested. 8 dimensions of neurobehavioral functioning were found to be stable with a test-retest reliability of at least .6 or higher on 2 consecutive days, nonredundant and developmentally valid. They were: Active Tone/Motor Vigor, Alertness and Orientation, Excitation Proneness, Inhibition Proneness, Scarf Sign, Popliteal Angle, Maturity of Vestibular Response, and Vigor of Crying.