Peer assessment in a project-based engineering course: comparing between on-campus and online learning environments

As the number of participants in online distance learning courses increases, peer assessment is becoming a popular strategy for evaluating open assignments and for breaking the social isolation surrounding distance education. Yet, the quality and characteristics of peer assessment in massive online courses has received little attention. Hence, this study was set to examine peer feedback quality and grading accuracy in a project-based course. The study applied a sequential exploratory mixed methods design. It included 339 participants who studied the same engineering course, but in three different modes: on-campus (n = 77), small private online course (n = 110), and massive open online course (MOOC) (n = 152). Content analysis of feedback comments identified four categories: reinforcement, statement, verification and elaboration, arranged in an ascending scale of cognitive ability. The findings indicated that the MOOC participants provided more feedback comments and volunteered to assess more projects than their counterparts did. However, the on-campus students provided higher quality feedback and their peer grading was better correlated with the grades assigned by the teaching assistants.     

Differentiating work for statistics modules in sports degrees

The aims of the study were to use differentiated online learning material for use with a Level 1 statistics module for undergraduate sport students and examine relationships between student performance on differentiated tests and module performance. We developed the differentiated material by writing easy and hard multiple choice tests, with the harder tests having a shorter completion time and more choices. Each multiple choice test related to information available online and immediate feedback was provided on completion of the test. Results indicated that 85% of students accessed the module online, with 26% accessing difficult tests and 22% accessing easy tests. Correlation results indicated that module performance was significantly related to performance on the easy test (r = 0.27, P<0.01) and also on the harder test (r = 0.26, P<0.01). Findings suggest that lecturers should encourage students to engage with interactive material and that future research should explore methods to enhance students' independent learning skills.     

Differentiations in motivation and need satisfaction based on course modality: a self-determination theory perspective

Online education has grown exponentially over the past two decades, in large part due to its promise of flexibility and connectivity for students. However, this approach to pedagogy has remained relatively unexamined in regard to issues of motivation and intellectual thriving. Using self-determination theory as a foundation, we assessed the degree to which course modality (namely online vs. face-to-face) led to psychological need satisfaction and quality motivation. Our survey of 240 (n = 240) college students confirmed previous research in which higher quality motivation predicted the satisfaction of autonomy, competence and relatedness, which in turn predicted course and instructor approval. However, in a series of matched-pairs t-tests, students reported lower levels of quality motivation, autonomy support, competence and relatedness in online courses than they did for face-to-face courses.     

Student attitudes that predict participation in peer assessment

Peer assessment has been widely applied to actively engage students in learning to write. However, sometimes students resist peer assessment. This study explores reviewers’ attitudes and other underlying factors that influence students’ participation in online peer assessment. Participants were 234 Chinese undergraduates from two different academic backgrounds: engineering majors (n = 168) and English majors (n = 66). Gender, academic background and prior experience with peer assessment were all related to participation levels. Moreover, factor analyses revealed three attitudinal factors: (1) positive attitude (a general endorsement of the benefits of peer assessment), (2) interpersonal negative (concerns about the negative effects on interpersonal relationships), and (3) procedural negative (doubts about the procedural rationality of peer assessment). Among the attitudinal factors, procedural negative was negatively associated with participation, as expected. Interestingly, interpersonal negative was associated with greater participation, and positive attitude was associated with lower participation, in part because students worked hard on each review rather than doing many reviews superficially. Implications for instruction are discussed.     

Conversations about sexuality on a public university campus: perspectives from campus ministry students and leaders

Little is known about university campus religious organisations’ influence on students’ sexuality-related attitudes and behaviours. This study sought to better understand sexuality-related communication within the context of campus ministries by exploring students’ and campus ministry leaders’ conversational experiences at a public university in the south-east USA. Data sources included an online survey of undergraduates participating in student religious organisations (n = 57), focus groups with campus ministry students (n = 36), and individual interviews with campus ministry leaders (n = 19). Findings indicated student satisfaction with the focus and frequency of conversations about romantic relationships and sexual health within the context of campus ministries. However, both campus ministry students and leaders indicated discomfort in discussions of sexuality. Leaders acknowledged their need for better strategies to engage students; students focused on how to integrate religious messages about sexuality with messages from other sources. These findings suggest campus ministry leaders may benefit from focused training and support to communicate more effectively with college students about sexuality.     

How MOOC instructors view the pedagogy and purposes of massive open online courses

Massive open online courses (MOOCs) have proliferated in recent years despite disagreement about the role of MOOCs in higher education and whether student outcomes are satisfactory. Taking a mixed-methods approach, the current study surveys professors who have taught MOOCs (n = 162) in order to better understand how MOOCs are perceived by instructors. Professors’ backgrounds and beliefs about the role of MOOCs in higher education and their perceptions of the experiences of students are discussed. In addition, professors’ satisfaction in teaching MOOCs is reported. The study finds that most MOOC professors are experienced faculty members with relatively little prior experience teaching online, and that they are divided about the purpose of MOOCs in the institutional landscape of higher education.     

The Influence of Motivational Regulation Strategies on Online Students’ Behavioral,Emotional, and Cognitive Engagement

Providing effective motivational support is a critical determinant of a successful online distance learning experience for students in higher education. In this study, we examined how students’ academic level and use of 8 motivational regulation strategies influence 3 types of student engagement: behavioral engagement, emotional engagement, and cognitive engagement. A total of 95 undergraduate and graduate students enrolled in online courses in 4-year universities in the United States participated in this study. A series of hierarchical regression analyses of undergraduate and graduate online students (N = 95) showed that behavioral engagement, emotional engagement, and cognitive engagement are predicted by different motivational regulation strategies after controlling for the academic level. Additionally, students’ academic level was found to be a predictor of cognitive engagement but not a predictor of behavioral engagement or emotional engagement. The results suggest that online course instructors, tutors, and designers should provide students with differentiated motivational scaffolding based on their motivational profile in order to promote different aspects of learning engagement.     

No longer exempt from good practice: using exemplars to close the feedback gap for exams

In this paper, we discuss the anomaly between the increasing interest in feedback in current education research, the continued role of time-limited, unseen examinations as a form of assessment and the dearth of literature on feedback related to such exams. We argue that while exams have long been regarded as different from other forms of assessment, it is not justifiable to exempt them from the good practice that can, and does, inform these other types of assessment. We suggest a solution to providing timely, effective feedback for end of course examinations is to move the feedback emphasis to ‘feedforward’ by implementing exemplars (examples of real students’ work, generally of different qualities). This study adopts a mixed-methods approach to investigate whether there was a relationship between student use of exemplars before the exam and the final exam grade achieved (n?=?520), and to explore students’ and lecturers’ perspectives about the effectiveness of and engagement with exemplars. Quantitative findings suggested that those students who accessed exemplars did score better in their exams than those that did not. Qualitative data revealed that exemplars were received positively by students and lecturers, and we use this to provide practical suggestions on exemplar good practice.     

When academics integrate research skill development in the curriculum

This study considered outcomes when 27 academics explicitly developed and assessed student research skills in 28 regular (non-research methods) semester-length courses. These courses ranged from small (n?=?17) to medium-large (n = 222) and included those from first year to masters in business, engineering, health science, humanities and science, across five universities in three Australian cities. The two-year study used three data sets to determine the outcomes of development and assessment initiatives: student pre- (n?=?779) and post-questionnaires (n?=?601), interviews with students (n?=?46) one year after completing a course that developed research skills and interviews with academics (n?=?17) involved in developing and assessing student research skills. These multiple sources provided evidence that students developed a variety of discipline-specific research skills and that these skills were useful for subsequent studies and especially for employment. Academics indicated that the process of making explicit the development of student research skills led to enhancement of their teaching, helping the academics to clarify major course purposes as well as enabling them to provide more substantial feedback to students than in the past. Academics also indicated that this teaching process changed their understanding of disciplinary research and, for some, even suggested new directions in their research.     

Timed Online Tests: Do Students Perform Better With More Time?

This article focuses on timed tests and specifically on whether increased time enhances test performance. Three courses during the Winter 2015 term (quizzes n = 573) and three courses over the Spring 2015 term (quizzes n = 600) comprised this sample. Students were given the same tests, but the experimental group (Spring 2015) was given 50% more time than the control group. The results indicate that more time on tests did not enhance student performance in terms of higher scores.

Much attention has been given to student assessment of learning in the online classroom. One such method of measurement is online tests, quizzes, and exams. The focus of this research is to determine whether test scores would improve if students were allowed more time on tests.     

Are they using my feedback? The extent of students’ feedback use has a large impact on subsequent academic performance

Feedback is known to have a large influence on student learning gains, and the emergence of online tools has greatly enhanced the opportunity for delivering timely, expressive, digital feedback and for investigating its learning impacts. However, to date there have been no large quantitative investigations of the feedback provided by large teams of markers, feedback use by large cohorts of students, nor its impact on students’ academic performance across successive assessment tasks. We have developed an innovative online system to collect large-scale data on digital feedback provision and use. Our markers (n = 38) used both audio and typed feedback modalities extensively, providing 388 ± 4 and 1126 ± 37 words per report for first- and second-year students, respectively. Furthermore, 92% of first year and 85% of second-year students accessed their feedback, with 58% accessing their feedback for over an hour. Lastly, the amount of time students spent interacting with feedback is significantly related to the rate of improvement in subsequent assessment tasks. This study challenges assertions that many students do not collect, or use, their feedback. More importantly, we offer novel insights into the relationships between feedback provision, feedback use and successful academic outcomes.     

Students’ participation in peer-to-peer communication supported by social media

Social media (SM) support new approaches to learning that rely on voluntary, peer-to-peer communication using devices and software provided and managed by students rather than on institutional course management systems. We present one case of such an approach with first-year university students (n = 86) in Thailand using SM for asking and answering questions between peers in a face-to-face computer-programming course. Encouraging students to ask questions about course content can result in improved performance. In general, understanding how students participate and what drives them to participate can provide insights into how universities and instructors can be socially ready. Students used SM during 10 weeks of an 18-week course. Each of four sections selected one form of SM as follows: Facebook [n = 33], Instagram [n = 21], Twitter [n = 21], and Line [n = 11]. The mixed-methods case study involved quantitative measures of how students participated and quantitative and qualitative measures of students’ perceptions of what drives or discourages their participation. Results revealed patterns in participation as follows: participation and motivation; passive and active participation; participation and sample size; participation and type of SM and; participation and student demographics. Implications for practice relate to the value of instructors’ understanding of the social incentives for student participation such as social recognition, gratification of needs and convenience. Implications for research focus on the value of investigating new forms of participation available to read-only participants and ‘lurkers’ using features of SM such as ‘liking’ and sharing.     

Questionnaire on Perceived Competency-based Learning for primary school students (#ICOMpri1) / Cuestionario del Aprendizaje Percibido basado en Competencias para el Alumnado de Educación Primaria (#ICOMPri1)

The purpose of this study was to design and validate an assessment tool to find out how primary school students perceive their competency-based learning. By examining the content validity (n = 35 experts), comprehension (n = 173 students) and construct (n = 523 students) of the instrument, the results showed correct psychometric quality, internal consistency, reliability and adequacy of the structural model: χ²/df = 2.08, TLI = 0.88, CFI = 0.90, GFI = 0.90, RMSEA = 0.04, and SRMR = 0.04. The final version of the Questionnaire on Perceived Competency-based Learning of primary school students (#ICOMpri1) includes eight dimensions and 27 items. The results showed a high perceived competency-based learning of primary school students. This is therefore a valid and reliable instrument that provides a more subjective and real vision of primary students’ academic performance. Nevertheless, future studies should analyse the criterion-related validity by comparing perception results with those of international academic achievement.     

Responsibilities of Online Teachers and On-Site Facilitators in Online High School Courses

Local schools are increasingly providing their students who are enrolled in an online course with an on-site facilitator as a means for increasing online pass rates. However, few studies have examined how online teachers and on-site facilitators work in conjunction to support online students. Successful on-site facilitators (n = 12) and online teachers (n = 12) participated in two one-hour interviews. Analysis found that while both the teachers and the facilitators assumed extensive and complex roles, their responsibilities were overlapping but complementary. Although the facilitators were highly engaged in supporting students, online teachers found the quality of support provided by facilitators varied greatly across schools. Eleven of the facilitators required the majority of their students to attend a daily lab that allowed them more easily and effectively fulfill their responsibilities. Findings from this research also support the need to provide facilitators with professional development so that they can better assume their critical responsibilities.     

Learning with and from: positioning school students as advisors in pre-service teacher education

This article reports on an innovative pedagogical approach within the Learning Partnerships program in which school students help to ‘teach the teachers’ within pre-service teacher education. Classes of school students join with classes of pre-service teachers to provide input on how teachers can enhance school students’ engagement and wellbeing. The article draws on data collected from 125 students (aged 13–16) and 120 pre-service teachers in these workshops. Findings generated from a mixed methods study combining pre-workshop focus groups (n = Students: 38, Teachers: 33) and post-workshop focus groups (n = Students: 69, Teachers: 15) and post-workshop surveys (n = Students: 96; Teachers: 101) demonstrated that the workshops were mutually beneficial for both students and pre-service teachers. Participants found that workshopping together enhanced their belief in the possibility of positive student–teacher relationships. The pre-service teachers reported greater confidence in communicating with young people about the issues that affect student engagement and wellbeing. The school students reported that they were more willing to use teachers as a source of help. Implications include the need for increased attention to a ‘third space’ for learning in teacher development which provides opportunity for learning with and from young people about how to foster their engagement and wellbeing.     

Educators’ understanding of young children’s typical and problematic sexual behaviour and their training in this area

As part of a wider study, this paper reports on Australian educators’ understanding of children’s typical and problematic sexual behaviour and their source of training in this area. A sample of 107 educators from government, independent and Catholic primary schools, preschools and care organisations across Australia answered an online questionnaire regarding their understanding of and experiences with children’s problematic sexual behaviours and their management strategies. The majority of educators were able to identify children’s age-appropriate typical sexual behaviour and some elements of problematic sexual behaviour; however, individual knowledge was not extensive. Approximately 35% (n = 35) of educators said they had not been trained in identifying and responding to children’s problematic sexual behaviour. Of those who said they had received training, the majority (82%, n = 53) described having participated in a compulsory course on reporting suspected abuse to government (a mandated reporting course). Ninety per cent (n = 89) of educators reported that courses specific to children’s problematic sexual behaviours should be offered. This suggests that mandated reporting courses do not offer in-depth training specific to problematic sexual behaviour. Implications for professional development are discussed.     

Confidence and Expectations About Caring for Older People With Dementia: A Cross-Sectional Survey of Student Nurses

Older people who are living with dementia often need healthcare, including hospital admissions, due to additional health conditions. Caring for older people who are living with dementia is, therefore, a core nursing role. This study investigated student nurses’ expectations of, and confidence about, caring for older people with dementia and the effect of students’ age, precourse experience, and their academic year. The design was a cross-sectional survey using questionnaires to collect data. The participants (n = 328), based at one university in England, had all had at least one practice learning placement. Most student nurses (n = 202; 62%) had precourse contact with older people with dementia and had cared for them during the course (n = 291; 89%). The student's academic year significantly affected confidence about caring for older people with dementia (p = .006), but still only 52% (n = 26) of third-year students felt “generally confident.” Precourse contact with older people with dementia had a significant impact on expectations (p = .001) and confidence in caring for people with dementia (p = .002). Students who were >25 years were significantly more likely to have had precourse contact with older people with dementia (p = < .001). Nurse educators should ensure that students entering nurse education appreciate that caring for older people who are living with dementia will be a core part of their role. They must proactively prepare nursing students to care for people with dementia, recognizing that some students have no previous contact, which may affect their confidence and experiences.     

Honesty on student evaluations of teaching: effectiveness,purpose, and timing matter!

Student evaluations of teaching (SETs) are an important point of assessment for faculty in curriculum development, tenure and promotion decisions, and merit raises. Faculty members utilise SETs to gain feedback on their classes and, hopefully, improve them. The question of the validity of student responses on SETs is a continuing debate in higher education. The current study uses data from two universities (n = 596) to determine whether and under what conditions students are honest on in-class and online SETs, while also assessing their knowledge and attitudes about SETs. Findings reveal that, while students report a high level of honesty on SETs, they are more likely to be honest when they believe that evaluations effectively measure the quality of the course, the results improve teaching and benefit students rather than the administration, and when they are given at the end of the term. Honesty on evaluations is not associated with socio-demographic characteristics.     

The Role of Student Characteristics in Predicting Retention in Online Courses

Given the continued issue of student retention for online classes, past research has suggested several “retention strategies” focused on engaging students as a way to reduce their withdrawal rate from these classes. However, a recent study testing the effects of these strategies on retention in online undergraduate business courses (Leeds et al., Int J Manage Educ 7(1/2), 2013) did not show empirical support for the effectiveness of such strategies. Taking an alternative approach that focuses on individual characteristics of students, this study takes a broader view and examines previous research literature on traditional face-to-face classes to determine how individual characteristics of students may be associated with the likelihood of withdrawal from online classes. Using a sample of undergraduate students (n = 2,314) from a large state university, results from this study identified prior performance in college classes (cumulative GPA) and class standing (senior vs. non-senior) as significant student characteristics related to student retention in online classes for all students. Other factors significantly related to retention rates for students with certain characteristics or within certain majors include previous withdrawal from online courses, gender, and receipt of academic loans.