Use of Knowledge, Skill, and Ability Statements in Developing Licensure and Certification Examinations

The task inventory approach is commonly used in job analysis for establishing content validity evidence supporting the use and interpretation of licensure and certification examinations. Although the results of a task inventory survey provide job task-related information that can be used as a reliable and valid source for test development, it is often the knowledge, skills, and abilities (KSAs) required for performing the tasks, rather than the job tasks themselves, which are tested by licensure and certification exams. This article presents a framework that addresses the important role of KSAs in developing and validating licensure and certification examinations. This includes the use of KSAs in linking job task survey results to the test content outline, transferring job task weights to test specifications, and eventually applying the results to the development of the test items. The impact of using KSAs in the development of test specifications is illustrated from job analyses for two diverse professions. One method for transferring job task weights from the job analysis to test specifications through KSAs is also presented, along with examples. The two examples demonstrated in this article are taken from nursing certification and real estate licensure programs. However, the methodology for using KSAs to link job tasks and test content is also applicable in the development of teacher credentialing examinations.     

Rejoinder: A Further Discussion of Job Analysis and Use of KSAs in Developing Licensure and Certification Examinations: A Response to LaDuca

In his commentary to our paper on the use of knowledge, skill, and ability statements in developing credentialing examinations ( Wang, Schnipke, & Witt, 2005 ), Dr. LaDuca set forth his concerns while commending our paper for providing helpful insights into the importance of careful delineation of KSAs. We believe that there is little substantive disagreement between our position and Dr. LaDuca's. Based on the counterarguments offered in his commentary, we believe that some misunderstanding occurred regarding our main point. Our response here further clarifies our main point to address Dr. LaDuca's criticisms. Additional explanations are provided to indicate that our paper is intended to address job analysis issues over a broader and diverse array of professions/occupations/fields, and our perspective is not limited to the context of credentialing physicians. We recommend that, for such professions/occupations/fields for which task inventory constitutes an appropriate approach to job analysis, the use of KSAs should be considered to establish a linkage between the credentialing examination and the job tasks.     

An NCME Instructional Module on Developing and Administering Practice Analysis Questionnaires

The purpose of a credentialing examination is to assure the public that individuals who work in an occupation or profession have met certain standards. To be consistent with this purpose, credentialing examinations must be job related, and this requirement is typically met by developing test plans based on an empirical job or practice analysis. The purpose of this module is to describe procedures for developing practice analysis surveys, with emphasis on task inventory questionnaires. Editorial guidelines for writing task statements are presented, followed by a discussion of issues related to the development of scales for rating tasks and job responsibilities. The module also offers guidelines for designing and formatting both mail-out and Internet-based questionnaires. It concludes with a brief overview of the types of data analyses useful for practice analysis questionnaires.     

Logos,ethos, pathos and the marketing of higher education

ABSTRACT

This article utilises rhetorical analysis as a method to investigate course level marketing communications for undergraduate fashion marketing degrees in England. The purpose of this method is to explore the persuasive appeals of Aristotle’s triad of logos, ethos and pathos, how they are used and how these appeals could differ by university type. Sixteen course pages were analysed, with the analysis of course web pages shows a clear distinction between ‘types’ of university, with Post 92 institutions relying heavily on appeals to emotion (pathos) and giving more focus to ‘value for money’ that would be a concern to their students. Russell Group and Specialist universities rely more on appeals to ethos (credibility) and logos (fact/data) to market their courses. This research finds evidence of market segmentation, demonstrated through the different use of persuasive appeals to express the course focus, and giving insight to their target audience.     

Assessing task-orientation potential in primary science textbooks: Toward a new approach

Task orientation is currently a prominent concept under discussion in primary school didactics. It focuses on tasks along which pupils acquire competences on distinct levels of competence. The qualitative empirical study TAPSE (Textbook Analysis in Primary Science Education) pursues the question which conception of task orientation is present in current textbooks in primary science education. The study follows two foci: (a) The introduction of a new category system for the analysis of the task-orientation potential of tasks, based on the further development of existing category systems for analyzing tasks; and (b) the analysis of 994 task statements in science textbooks with respect to the didactic quality of their task orientation. The sample included nine primary science textbooks, four from Germany, and five from Luxembourg. Textbooks were selected from the most frequently sold series in the respective country. All tasks of the textbooks were analyzed deductively and inductively by four coders in three steps: (a) Identifying tasks with task-oriented potential; (b) itemizing different types of task-orientation potential; and (c) comparing the textbooks with respect to country- and period-specific manifestations of task orientation. Analysis indicated that (a) there are few tasks which meet the criteria of task orientation; (b) distinct types of task orientation can be generated, among which implicit forms dominate; and (c) differences occur in the characteristics of task orientation between older and newer textbooks as well as between German and Luxembourgish ones. Central points of discussion ensue from this: The need to develop models for social and cognitive activation for tasks, challenges for professional development for teachers, and support for pupils—in particular high achieving heterogenization.     

The effects of being a reader and of observing readers on fifth-grade students’ argumentative writing and revising

Opportunities to read and analyze others?? writing or to observe readers as they analyze writing might enhance one??s own sense of audience and improve one??s own writing. This mixed-methods study investigated whether reader and observer activities in comparison to writing practice activities affected fifth-grade students?? persuasive writing and revising. After writing a first draft of a persuasive letter, 87 fifth-grade students were randomly assigned to one of three conditions: being a reader, observing readers, or practicing writing. The reader group read and discussed three persuasive letters, considering whether they were persuasive and why and selecting the most persuasive. The observer group listened to the reader group??s discussions and took notes; then they had their own discussion to generate a list of criteria for what made the letters persuasive. The practice-writing control group practiced writing persuasive letters. Afterwards, all groups revised their first drafts. The reader group produced second drafts that were of better quality and contained more evidence of audience awareness than the control group. The observer group did not differ from either group. The groups did not differ on a transfer task occurring 1-week later. The authors discuss implications for designing writing curriculums that utilize reader and observer activities.     

On the Superior Statistical Properties of Frequency Scales in Job Analyses

This study compared the statistical properties of four job analysis task survey response scale types: criticality, difficulty in learning, importance, and frequency. We used nine job analysis studies spanning two fields, medical imaging and allied health professionals, to compare the job analysis scales in terms of variability and interrater agreement. Results showed that frequency scales using absolute anchors had greater between-task variability and higher interrater agreement for all nine studies. This may have occurred due to what has been described by past research as self-presentation bias. In this case, an aggregate base percentage of respondents always responded that tasks in their domain are highly critical, highly important, and easy to learn. These results showed that frequency scales with absolute anchors yielded data with better statistical performance than other more subjective scales. These properties do not answer the question of whether a scale matches an exam's purpose, which is the most important consideration for job analyses. They do, however, suggest that, if statistics are a primary deciding factor, strong consideration should be given to using frequency scales with absolute anchors.     

A Comparison of Two Alternate Scaling Approaches Employed for Task Analyses in Credentialing Examination Development

Credentialing examination developers rely on task (job) analyses for establishing inventories of task and knowledge areas in which competency is required for safe and successful practice in target occupations. There are many ways in which task‐related information may be gathered from practitioner ratings, each with its own advantage and limitation. Two of the myriad alternative task analysis rating approaches are compared in situ: one establishing relative task saliency through a single scale of rated importance and another employing a composite of several independent scales. Outcomes regarding tasks ranked by two practitioner groups are compared. A relatively high degree of association is observed between tasks ranked through each approach, yielding comparable, though not identical examination blueprints.     

The Effects of Task Choice on the Quality of Writing Obtained in a Statewide Assessment

The purpose of this study was to examine the effects of presenting a choice of writing tasks on the quality of essays produced by 11th-grade students. The effects of task choice were examined for interactions with the gender and race of students. Fifteen writing tasks, designed to elicit persuasive essays, were administered to 34,200 students in Georgia. Approximately half the students received an assigned task, whereas the other half were presented a choice of two tasks. A multivariate analysis of variance (MANOVA) was conducted using four domain scores as the dependent variables assessing writing quality and four independent variables (gender, race, writing tasks, and choice condition). The student characteristics of gender and race and the writing task variable had a significant effect in the MANOVA and all four univariate analyses. Female students wrote essays of higher quality than male students and White students wrote essays of higher quality than Black students. The choice condition had no substantive effect on the quality of essays. The writing task variable had a significant interaction with the other independent variables.     

Prediction of learning and comprehension when adolescents read multiple texts: the roles of word-level processing, strategic approach, and reading motivation

Sixty-five Norwegian 10th graders used the software Read&Answer 2.0 (Vidal-Abarca et al., 2011) to read five different texts presenting conflicting views on the controversial scientific issue of sun exposure and health. Participants were administered a multiple-choice topic-knowledge measure before and after reading, a word recognition task, and a reading motivation inventory that included two dimensions: Science reading self-efficacy, focusing on readers’ beliefs about their capabilities to comprehend what they read in science, and science reading task value, focusing on readers’ beliefs about how important, useful, and interesting it is to comprehend science texts. In addition, strategic reading pattern was assessed in terms of the degree of non-linear reading behavior. Multiple regression analysis showed that word recognition skills strongly predicted learning from the texts, as assessed by participants’ increase in topic knowledge. However, when multiple-text comprehension indicated by performance on open-ended short-essay questions was the dependent variable, not only word recognition but also strategic reading pattern and science reading self-efficacy emerged as unique predictors when topic knowledge was controlled for. Science reading task value was not related to performance. This study provides new evidence that new literacy competencies needed in a knowledge society, such as synthesizing or integrating across multiple conflicting sources of information, still largely involve word-level, strategic, and motivational processes that may profitably be targeted through systematic instruction.     

Exploring the relationship between dialogic teacher talk and students’ persuasive writing

Studies have documented the importance of dialogic classroom discourse for supporting academic outcomes such as reading comprehension and vocabulary development. This study examines the relationship between teacher talk during whole-classroom discussions in 42 classrooms and post-discussion persuasive essays from students in grades four through seven (n = 471). Teacher talk was coded by type of question (contestable, semi-open, or quiz-like) and teachers' follow-ups (prompting, pressing for reasoning, active listening), and further categorized as indicating either high or low levels of dialogic talk. Multilevel modeling that accounts for student participation rate, discussion topic, and students' demographic information shows that high dialogic teacher talk positively predicts students’ persuasive essay scores, while low dialogic teacher talk negatively predicts their scores. The study supports existing hypotheses about the role of teacher dialogic talk in whole-class settings.     

致贤用才 科举先声——葛洪的人才观与考试观辨析

人才观与考试观,属于广义的考试文化范畴。本文从科举学的视角,辨析葛洪的人才观与考试观的内涵、特征、地位与影响。葛洪认为,治国以致贤任能为首务,用才取士不可以不精择、详试,考试选才可励勤学、绝人事因缘。从考试文化的历史演变来看,葛洪有关人才价值与标准、选才原则与途径、考试功能与方法的系统论述,成为隋唐科举考试之先声。其独具一格的人才观与考试观,在科举文化史上占有重要地位,对于当今考试文化建设亦有一定的启发意义。     

企业内领导-成员交换的多维结构对工作绩效的影响

采用实证研究的方法探讨了企业内领导-成员交换（LMX）的结构维度及其与工作绩效的关系。研究表明,我国企业内领导-成员交换的因素结构包括贡献、尊敬、支持、忠诚维度,LMX及任务结构性特征对工作绩效有直接的预测作用,任务多样性特征对工作绩效的预测作用没有达到显著性水平。     

Complex Systems and Educational Change: Towards a new research agenda

How might we usefully apply concepts and procedures derived from the study of other complex dynamical systems to analyzing systemic change in education? In this article we begin to define possible agendas for research toward developing systematic frameworks and shared terminology for such a project. We illustrate the plausibility of defining such frameworks and raise the question of the relation between such frameworks and the crucial task of aggregating data across ‘systemic experiments’, such as those conducted under the Urban Systemic Initiative sponsored by the US National Science Foundation. Our discussion includes a review of key issues identified by groups of researchers regarding (1) Defining the System, (2) Structural Analysis, (3) Relationships Among Subsystems and Levels, (4) Drivers for Change, and (5) Modeling Methods.     

The effect of high-stakes examination systems on teacher beliefs: Egyptian teachers’ conceptions of assessment

Egypt is currently attempting to introduce a greater formative use of assessment while maintaining a public examination system. This study investigates teacher beliefs about the purposes of assessment in Egypt, using the Teachers’ Conceptions of Assessment (TCoA) inventory. The TCoA inventory elicits responses about four main factors: Improvement, School Accountability, Student Accountability and Irrelevance. A large sample of (n?=?507) Egyptian pre-service and in-service teachers completed an Arabic version of the TCoA inventory. Confirmatory factor analysis was used to test the Egyptian teachers’ responses against the pre-existing New Zealand model, which was found to be inadmissible. Consequently, an ecologically rational three-factor model was found. The model yielded a strong positive relationship between Improvement and Student Accountability, consistent with previous studies. It is argued that greater changes to the examination system are required if teacher beliefs are expected to be more positive about the priority of formative, improvement-oriented uses of assessment.     

工作描述指标在工作岗位分析中的应用

工作岗位分析是人力资源管理的基本工作。工作岗位分析过程中存在不同层次的描述指标，如职位、职责、任务、动作或要素等。各种描述指标的意义不同，其代表的含义及其在人力资源管理实践中的应用也不同。     

Addressing Needs of Employers,Older Workers,and Retirees: An Educational Approach

The Retirement Research Foundation of Chicago supported a collaborative to collect demographic data about working and aging, conduct a survey of older job seekers, and interview businesses in the region to assess their awareness and attitudes about mature workers. The 2005 project was titled the 60 + Success Project. A regional task force oversaw the research components and product development. Data collection occurred through 13 focus groups, individual interviews with private, public and nonprofit sector leaders, surveying of mature and aging job seekers, and online surveying of employers. Based upon this multipronged methodology, four major products were produced: Report and Key Findings; Human Resources Handbook and Curriculum; Opportunities for Mature Workers (brochure); and Mature Worker Profile. These products are the first steps toward better understanding the needs of older workers and shaping an action plan for this region. They can serve as catalysts to spur similar educational efforts in other parts of the country.     

A conceptual framework for job change

Change related to the job is identified as an exigent issue in the field of career development. This paper presents an effort to conceptualize a job change framework. The intent is increase awareness, generate discussion, and stimulate empirical research in this area.The conceptual framework for job change has been predicated on client concerns. The framework involves the unique relationship of several life factors which influence individual job change, and provides a means for systematic personal decision-making. A schematic diagram is also included as a tool that can be used for counseling and research applications.