Measuring ESL readers’ ability to apply reasoning in reading: a validity study of the TOEFL reading comprehension subtest

This paper reports the results of an attempt to measure English as a Second Language (ESL) students’ability to apply reasoning in reading. The elicitation instrument was an experimental test which was developed from a model of reading comprehension based upon cognitive activities which Piaget referred to as concrete operations. The experimental test delineated Piaget's concrete operations in prose text and set them against difficulty criteria. The experimental test which measured the ability to apply reasoning in reading and the Test of English as a Foreign Language (TOEFL) were administered to a pool of adult ESL subjects. The results indicated that the TOEFL reading comprehension subtest does not measure the ability to apply reasoning in reading; thus, its validity as a measure of reading is in doubt. Significant effects were also shown for the paragraph types and the item types in the experimental test. The items based on the classification paragraphs were significantly more difficult than the items based on the serial paragraphs. In like manner, the items based on the multiplication paragraphs were significantly more difficult than the items based on the addition paragraphs. And finally, the intension questions which concerned the properties of a class were significantly more difficult than the extension questions which dealt with the members of classes. The results of this study indicate a need for further, increased attention to the measurement of reading to solve problems in ESL reading assessment and to the effects of the different structural organizations of ideas (e.g., addition, classification, multiplication, and series) and the interrelations of ideas on the comprehension process. The motivation for this line of research derives from the pragmatic interest of those researchers concerned with the communicative aspects of a text and the manner in which authors organize their ideas. Current research is beginning to explain the complex interaction between text structure and the reader's processing of such structure which further explicates the comprehension process.     

Exploring perceived support of postgraduate medical science research students

There is still much to learn about the support required by postgraduate research students, across academic disciplines, to facilitate successful completion of a research degree. The primary aim of this study was to explore postgraduate medical science research students’ perceptions of academic and mentoring support at different stages during their degree programme. A second aim was to explore the feasibility and acceptability of peer mentoring as a strategy to enhance student support in this population. A mixed method study design was used. Students first completed an online questionnaire, which was then supplemented with focus group discussion to explore emergent findings in greater depth. The main results indicated that the nature and quality of academic supervision support have a significant influence on research student training and development. ‘Functional’ and ‘relationship development’ concepts of supervisory styles were highlighted as important aspects to perceived support in this research population. The main facilitators to enhance academic support were effective communication, project planning and timely feedback. There was a high degree of acceptability for a peer mentoring programme as a complementary approach to enhance student support. Peer mentoring psychosocial functions such as friendship, counselling and career guidance were considered potentially beneficial to enhancing student support. Students also discussed peer coaching as central to their learning and research skill development. This work is a useful starting point to explore perceptions of research student support in the target population. Further work is required to develop strategies to enhance student support in academic practice.     

Learning in and beyond school gardens with cyber-physical systems

This design-based research study considers the learner-generated design and refinement of a school garden. We report one enactment of the Connected Gardening project in order to illuminate and understand how a fourth-grade class organizes and refines its garden plot using observations of the physical environment and evaluations of data from a networked digital probe. By examining the ways individuals, materials, and activities influence, and are influenced by, one another, our qualitative analysis characterizes interplay among an ecosystem, a garden and graphical representations of environmental indicators in real time and over time. We consider the novel affordances of such a cyber-physical systems for supporting participatory culture within yet beyond school classrooms.     

Reading Words In and Out of Connected Text: The Impact of Context on Semantic and Orthographic Processing

The majority of naturalistic reading occurs within passages. Therefore, it is important to understand how reading in context affects the division of labor between semantic and orthographic processing. However, it is difficult to compare the cognitive processes elicited by reading in context and lists because of the perceptual differences that define them. In 2 experiments, undergraduate students read 72 different words divided across three conditions (context, semantic-list, and orthographic-list). Participants then completed a memory task that was used to estimate either the semantic processing (surprise recall; Experiment 1) or orthographic processing (word stem completion; Experiment 2) elicited during reading. In both experiments, memory performance for words read in context more closely resembled words read in the semantic-list condition and differed greatly from those read in the orthographic-list condition. We interpret these results as showing that contextual reading biases the division of labor toward semantic processing and away from orthographic processing.     

The Development of Intra-Departmental Stratification and Competition for Resources: A Case Study of a Non-Research Based Higher Education Institution

Fluctuations in the financial welfare of institutions of higher education have long been tied to our country’s economic well-being. For many institutions the most recent financial downturns have led to historic revenue and enrollment difficulties that have necessitated the use of cost containment strategies to conserve dwindling resources. Included in these tactics are resource allotment decisions that reflect administrative favor towards some academic departments, leading to the development of a prestige-based stratification system and competition driven funding. A case study of a non-research based institution is used to take a preliminary look at the impact of institutional resource conservation on intra-departmental competition for resources and disparate funding allocations across disciplines in this setting. Special attention is given to the trends in enrollment and the selection of particular academic majors that have occurred across time and in response to the institution’s continued fiscal difficulties.     

Examining the Impact of Interdisciplinary Programs on Student Learning

We investigated how learning outcomes of students majoring in interdisciplinary fields differ from those of students in discipline-based majors. We found that students in interdisciplinary majors report less change in Critical Thinking and Need For Cognition than their peers in disciplinary majors, but no difference in change in Positive Attitude Toward Literacy. Students’ gains in Critical Thinking and Need For Cognition do not vary by the characteristics of the interdisciplinary major, but some program characteristics influence modest changes in Positive Attitudes Toward Literacy. Future research should address selection effects, develop measures of interdisciplinary learning, and further explore curricular and instructional patterns in interdisciplinary programs.     

Effective compiler error message enhancement for novice programming students

Programming is an essential skill that many computing students are expected to master. However, programming can be difficult to learn. Successfully interpreting compiler error messages (CEMs) is crucial for correcting errors and progressing toward success in programming. Yet these messages are often difficult to understand and pose a barrier to progress for many novices, with struggling students often exhibiting high frequencies of errors, particularly repeated errors. This paper presents a control/intervention study on the effectiveness of enhancing Java CEMs. Results show that the intervention group experienced reductions in the number of overall errors, errors per student, and several repeated error metrics. These results are important as the effectiveness of CEM enhancement has been recently debated. Further, generalizing these results should be possible at least in part, as the control group is shown to be comparable to those in several studies using Java and other languages.