Measuring ESL readers’ ability to apply reasoning in reading: a validity study of the TOEFL reading comprehension subtest

This paper reports the results of an attempt to measure English as a Second Language (ESL) students’ability to apply reasoning in reading. The elicitation instrument was an experimental test which was developed from a model of reading comprehension based upon cognitive activities which Piaget referred to as concrete operations. The experimental test delineated Piaget's concrete operations in prose text and set them against difficulty criteria. The experimental test which measured the ability to apply reasoning in reading and the Test of English as a Foreign Language (TOEFL) were administered to a pool of adult ESL subjects. The results indicated that the TOEFL reading comprehension subtest does not measure the ability to apply reasoning in reading; thus, its validity as a measure of reading is in doubt. Significant effects were also shown for the paragraph types and the item types in the experimental test. The items based on the classification paragraphs were significantly more difficult than the items based on the serial paragraphs. In like manner, the items based on the multiplication paragraphs were significantly more difficult than the items based on the addition paragraphs. And finally, the intension questions which concerned the properties of a class were significantly more difficult than the extension questions which dealt with the members of classes. The results of this study indicate a need for further, increased attention to the measurement of reading to solve problems in ESL reading assessment and to the effects of the different structural organizations of ideas (e.g., addition, classification, multiplication, and series) and the interrelations of ideas on the comprehension process. The motivation for this line of research derives from the pragmatic interest of those researchers concerned with the communicative aspects of a text and the manner in which authors organize their ideas. Current research is beginning to explain the complex interaction between text structure and the reader's processing of such structure which further explicates the comprehension process.     

Bringing science into the classroom by basing craft on research

In response to Crockett's analysis of the relation of science and the instruction of students with learning disabilities, we discuss reasons why teaching in special education is infrequently affected by science and research, and we propose a model of naturalistic decision making and make recommendations for bridging the gap between research and practice based on that model. By building an extensive experiential base in using effective practices, we propose that teachers can become experts at the craft of applying research-based methods. Bringing science into the classroom by basing craft on research in this way represents one promising alternative for improving outcomes for students with and without learning disabilities.     

Adapting to Learner Attributes: experiments using an adaptive tutoring system

A composite learner model for adaptive tutoring systems has been developed, which combines a model of learner attributes with a simple overlay model of the learner's domain knowledge state. The model of learner characteristics enables several different forms of psychological and background data about the student to be taken into account, and provides a profile of the learner in terms of pedagogically useful attributes. An Adaptive Tutor Using Learner Attributes (ATULA) has been constructed, which uses the composite learner model. The system is able to select for the learner the optimal form of the learning material for the group of topics about to be presented. Experiments carried out with the adaptive tutoring system over 3 successive academic years with two disparate groups of students are described. User records collected during the experiments provide insight into the operation of the model, both at initialisation and during the student's interaction with the system. Previous users’ records also enable comparisons to be made with the result of previous experiments using a non‐adaptive system.     

Exploring perceived support of postgraduate medical science research students

There is still much to learn about the support required by postgraduate research students, across academic disciplines, to facilitate successful completion of a research degree. The primary aim of this study was to explore postgraduate medical science research students’ perceptions of academic and mentoring support at different stages during their degree programme. A second aim was to explore the feasibility and acceptability of peer mentoring as a strategy to enhance student support in this population. A mixed method study design was used. Students first completed an online questionnaire, which was then supplemented with focus group discussion to explore emergent findings in greater depth. The main results indicated that the nature and quality of academic supervision support have a significant influence on research student training and development. ‘Functional’ and ‘relationship development’ concepts of supervisory styles were highlighted as important aspects to perceived support in this research population. The main facilitators to enhance academic support were effective communication, project planning and timely feedback. There was a high degree of acceptability for a peer mentoring programme as a complementary approach to enhance student support. Peer mentoring psychosocial functions such as friendship, counselling and career guidance were considered potentially beneficial to enhancing student support. Students also discussed peer coaching as central to their learning and research skill development. This work is a useful starting point to explore perceptions of research student support in the target population. Further work is required to develop strategies to enhance student support in academic practice.     

Learning in and beyond school gardens with cyber-physical systems

This design-based research study considers the learner-generated design and refinement of a school garden. We report one enactment of the Connected Gardening project in order to illuminate and understand how a fourth-grade class organizes and refines its garden plot using observations of the physical environment and evaluations of data from a networked digital probe. By examining the ways individuals, materials, and activities influence, and are influenced by, one another, our qualitative analysis characterizes interplay among an ecosystem, a garden and graphical representations of environmental indicators in real time and over time. We consider the novel affordances of such a cyber-physical systems for supporting participatory culture within yet beyond school classrooms.     

Reading Words In and Out of Connected Text: The Impact of Context on Semantic and Orthographic Processing

The majority of naturalistic reading occurs within passages. Therefore, it is important to understand how reading in context affects the division of labor between semantic and orthographic processing. However, it is difficult to compare the cognitive processes elicited by reading in context and lists because of the perceptual differences that define them. In 2 experiments, undergraduate students read 72 different words divided across three conditions (context, semantic-list, and orthographic-list). Participants then completed a memory task that was used to estimate either the semantic processing (surprise recall; Experiment 1) or orthographic processing (word stem completion; Experiment 2) elicited during reading. In both experiments, memory performance for words read in context more closely resembled words read in the semantic-list condition and differed greatly from those read in the orthographic-list condition. We interpret these results as showing that contextual reading biases the division of labor toward semantic processing and away from orthographic processing.     

The Development of Intra-Departmental Stratification and Competition for Resources: A Case Study of a Non-Research Based Higher Education Institution

Fluctuations in the financial welfare of institutions of higher education have long been tied to our country’s economic well-being. For many institutions the most recent financial downturns have led to historic revenue and enrollment difficulties that have necessitated the use of cost containment strategies to conserve dwindling resources. Included in these tactics are resource allotment decisions that reflect administrative favor towards some academic departments, leading to the development of a prestige-based stratification system and competition driven funding. A case study of a non-research based institution is used to take a preliminary look at the impact of institutional resource conservation on intra-departmental competition for resources and disparate funding allocations across disciplines in this setting. Special attention is given to the trends in enrollment and the selection of particular academic majors that have occurred across time and in response to the institution’s continued fiscal difficulties.     

The Effect of English Language Proficiency Level and Educational Background on Academic Achievement

The English Proficiency Level (EPL) of 205 first year business students from 16 Asian countries was assessed on arrival in Australia using the Australian Second Language Proficiency Ratings (ASLPR). Academic grades were recorded for their first, second and third semesters. Statistical analysis of the students' records shows that educational background is the major determinant of success in business courses, with no statistically significant effect coming from EPL. In practice, English proficiency is used as a major selection criterion in its application to the entry of full fee paying international students; on the basis of the evidence presented here, there is no need for a stringent EPL criterion to be applied, which is an important finding for those involved in the selection of international students who wish to study in Australian institutions. An important policy impinging on academic achievement is that students who fail their first semester are allowed to continue their studies; the policy leads to an estimated 39% of students allowed such grace going on to obtain a pass for the course; EPL bears no relationship to academic achievement for students in this category, the major determinant being their educational background. Thus, it is important that stringent conditions are applied to potential international students' educational background, but that they are not disadvantaged by their English language ability.