Applying the Own it,Learn it,Share it framework to the flexible Pink Time assignment to scaffold student autonomy online and in person

This response to Lee and Hannafin’s A design framework for enhancing engagement in student-centered learning: own it, learn it, and share it (OLSit) (Lee and Hannafin, Educational Technology Research and Development 64:707–734, 2016) discusses its helpful design guidelines from a practitioner’s perspective. OLSit provides a blueprint for chance-taking with student-centered learning. Here, I apply this blueprint to a flexible assignment colleagues and I designed to promote intrinsic motivation and engagement, called Pink Time (PT), which asks students to “skip class, do whatever you want, and grade yourself.” Together, OLSit and PT are well suited for this moment of disruption and pivot to remote learning. Students’ stereotypes about what is “valid” in the classroom may be important limitations. But iterative and effective communication can shape students’ perceptions and scaffold their efforts. In the future, scholars and practitioners should consider how grades undermine online SCL strategies like OLSit and PT.

     

Beyond the Rhetoric: A framework for evaluating improvements to the student experience

A framework is described to assist institutions in evaluating the extent to which activities described as “quality improvements” or “quality enhancements” are likely to directly improve the student experience. The framework classifies ways of improving the student experience into “coaching improvements”, “umpiring improvements”, and “facilities improvements”, while also considering the location of improvements along a “risk avoidance—quality assurance—quality enhancement” continuum. The utility of this framework is explored through case studies of sector‐wide initiatives in Scotland and Australia. If used to stimulate internal discussion, the framework can help institutions to better balance their efforts to improve the student experience.     

Student perceptions of predictability of examination requirements and relationship with outcomes in high-stakes tests in Ireland

Entirely predictable examinations are ones for which the questions are known in advance. Some assessments are designed this way, but in public examinations, predictability is subtler. Students familiarise themselves with the requirements broadly: likely topics that will come up, question formats and how to maximise their marks. If students can predict what they have to do, they can memorise performances, such as essays, and restrict their learning to fit only with examination requirements. The danger is that this focus could undermine curriculum aims. Further, examinations that are overly predictable might produce results that do not generalise to other performances or have predictive validity. This paper presents part of a broader project investigating whether the Higher Level Irish Leaving Certificate (LC) examinations were too predictable. Here, the development of a rating scale for students’ views of examination predictability is described. Data were collected from 1002 Irish LC students taking higher level examinations in biology (n?=?536), English (n?=?749) and geography (n?=?387). Students’ views on predictability of the examination could be grouped consistently across subject areas into three factors: valuable learning, predictability and narrowing of the curriculum. Belief that narrowing of the curriculum was a good examination preparation tactic had a negative relationship with examination scores and perceived learning value of examinations was positively associated with students’ scores in biology and English. These findings indicate that the scoring system rewards students who believe they must study the discipline broadly.     

Predicting item difficulty of science national curriculum tests: the case of key stage 2 assessments

Predicting item difficulty is highly important in education for both teachers and item writers. Despite identifying a large number of explanatory variables, predicting item difficulty remains a challenge in educational assessment with empirical attempts rarely exceeding 25% of variance explained.

This paper analyses 216 science items of key stage 2 tests which are national sampling assessments administered to 11 year olds in England. Potential predictors (topic, subtopic, concept, question type, nature of stimulus, depth of knowledge and linguistic variables) were considered in the analysis. Coding frameworks employed in similar studies were adapted and employed by two coders to independently rate items. Linguistic demands were gauged using a computational linguistic facility. The stepwise regression models predicted 23% of the variance with extended constructed questions and photos being the main predictors of item difficulty.

While a substantial part of unexplained variance could be attributed to the unpredictable interaction of variables, we argue that progress in this area requires improvement in the theories and the methods employed. Future research needs to be centred on improving coding frameworks as well as developing systematic training protocols for coders. These technical advances would pave the way to improved task design and reduced development costs of assessments.     

The undergraduate experience: Commonalities and differences among colleges

Item and scale responses of students in 42 colleges to the College Student Experiences Questionnaire were examined to determine the frequency with which students had engaged in a wide variety of college activities. Results suggested that students most commonly attended and carried out activities related to studying and classwork, but typically did not engage in a great many intellectual and extracurricular activities. Students in selective and general liberal arts colleges were more active and involved in their colleges' lives than students in doctoral universities or comprehensive colleges and universities. Community college students were just as active as other students in academic areas, but were far less involved in out-of-class activities.