Assessment activities at large,research universities

Assessment and outcomes measurement is receiving considerable attention in higher education nationwide. But what are colleges and universities doing and calling assessment? To answer these and other questions, a telephone survey was conducted with a sample of large, research universities. Responses to the survey are presented and discussed in this paper. Results indicated limited university involvement in activities commonly associated with the current assessment “movement,” i.e., measures of added value or student progress and growth. Instead, much of the reported activities are “traditional” testing and evaluation activities such as placement testing and student evaluation of instruction. In sum, assessmentis evaluation at large, research universities.     

Factors influencing success in introductory college chemistry

Previous research has found a wide range of predictors of student performance in introductory college chemistry. These predictors are associated with both the students' backgrounds and their high school learning experiences. The purpose of this research study was to examine the link between high school chemistry pedagogical experiences and performance in introductory college chemistry while accounting for individual educational and demographic differences. The researchers surveyed 1531 students enrolled in first‐semester introductory college chemistry courses for science and engineering majors at 12 different U.S. colleges and universities. Using multiple regression analysis, the researchers uncovered several interesting high school pedagogical experiences that appeared to be linked with varying levels of performance in college chemistry. Most notably, the researchers found that repeating chemistry labs for understanding was associated with higher student grades, whereas overemphasis on lab procedure in high school chemistry was associated with lower grades in college. These results suggest that high school teachers' pedagogical choices may have a link to future student performance. © 2005 Wiley Periodicals, Inc. J Res Sci Teach 42: 987–1012, 2005     

No comparison: Distance education finds a new use for ‘No significant difference’

Media comparison studies have long been criticized as an inappropriate research design for measuring the effectiveness of instructional technology. However, a resurgence in their use has recently been noted in distance education for program evaluation purposes. An analysis of the research design will detail why such a methodology is an inappropriate approach to such an investigation. Increased access to such programming does not seem to serve as a satisfactory benefit for the implementation of distance education efforts. Stakeholders desire to prove that participants in distance-delivered courses receive the same quality of instruction off-campus as those involved in the traditional classroom setting. However, the desire to prove that the quality of such distributed offerings is equal to the quality of on-campus programming often results in comparisons of achievement between the two groups of student participants. Statistically, such a research design almost guarantees that the desired outcome will be attained—that indeed distance learners perform as well as campus-based students.     

The reflective institution: Assuring and enhancing the quality of teaching and learning

Three definitions of ``quality' have entered the qualityassurance (QA) debate: quality as value for money, quality as fitfor the purpose of the institution, quality as transforming. The firstis pivotal for retrospective QA, which sees QA in terms ofaccountability, and conforming to externally imposed standards. The lasttwo are pivotal for prospective QA, which sees QA asmaintaining and enhancing the quality of teaching and learning in theinstitution. In this paper, the reflective practitioner is taken as themodel for prospective QA. Three stages are involved in institutionalreflective practice: articulating an espoused theory of teaching, thequality model (QM); continually improving on current practicethrough quality enhancement (QE), in which staff development should playan important role; and making quality feasible (QF), by removingimpediments to good teaching, which often arise through distortedpriorities in institutional policy and procedures. These three stages,QM, QE, and QF, are essential ingredients in prospective QA.     

Kinds of Keys of student ratings of faculty teaching effectiveness

Three substudies of effects of different formats on student ratings of faculty teaching effectiveness were conducted. One substudy, Kinds of Keys, investigated three main kinds of keys: Agreement, Evaluation, and Needs Improvement. The second, NO TUP, investigated numbers of positive rating categories. The third, Item Wording Direction, investigated the same items worded positively, negatively, and neutrally, respectively. Practically important differences in level of ratings obtained in Kinds of Keys and practically and statistically significant differences obtained in NO TUP and Item Wording Direction. It was concluded that additional research is necessary to determine if apparent differences in teaching effectiveness are actually differences in teaching effectiveness or differences due to the methods of measurement.     

The impact of blatant pay disclosure in a university environment

Using a self-report survey, this investigation described university employees' reactions to the publication of their salaries in a local campus newspaper. Correlational analyses indicated associations between impact of the disclosure and salary level, salary equity/satisfaction, instrumentality of performance-reward outcomes, internal salary attributions, and salary discussion. Further analysis found differences in respondent perceptions to be contingent upon job category (academic, professional, and support staff) and faculty level. Qualitative analysis suggested that individual responses to the salary disclosure took various forms: no effect at all, planning to leave one's job, attempting to correct salary inequities, reducing personal effort, and working harder. The findings are discussed in relation to the literature on open pay systems and invasion of privacy.This paper was presented in part at the 43rd Annual Meeting of the Academy of Management, Dallas, Texas, August 1983.