A General Evaluation Framework for Topical Crawlers

Topical crawlers are becoming important tools to support applications such as specialized Web portals, online searching, and competitive intelligence. As the Web mining field matures, the disparate crawling strategies proposed in the literature will have to be evaluated and compared on common tasks through well-defined performance measures. This paper presents a general framework to evaluate topical crawlers. We identify a class of tasks that model crawling applications of different nature and difficulty. We then introduce a set of performance measures for fair comparative evaluations of crawlers along several dimensions including generalized notions of precision, recall, and efficiency that are appropriate and practical for the Web. The framework relies on independent relevance judgements compiled by human editors and available from public directories. Two sources of evidence are proposed to assess crawled pages, capturing different relevance criteria. Finally we introduce a set of topic characterizations to analyze the variability in crawling effectiveness across topics. The proposed evaluation framework synthesizes a number of methodologies in the topical crawlers literature and many lessons learned from several studies conducted by our group. The general framework is described in detail and then illustrated in practice by a case study that evaluates four public crawling algorithms. We found that the proposed framework is effective at evaluating, comparing, differentiating and interpreting the performance of the four crawlers. For example, we found the IS crawler to be most sensitive to the popularity of topics.Partially supported by National Science Foundation CAREER grant No. IIS-0133124/0348940.     

Evaluating the sustainability of SPARK physical education: a case study of translating research into practice

Dissemination and sustainability of evidence-based physical education programs (PE) has been studied rarely. The sustainability of a health-related PE program (SPARK) was independently evaluated in 111 elementary schools in 7 states. Surveys were mailed to schools that had received SPARK curriculum books, training and follow-up (response rate = 47%). Up to 80% of schools that adopted SPARK PE reported sustained use up to 4 years later. Schools using SPARK had more frequent PE classes. Sustained use was related to support from the principal, not previously having a standard PE program, having adequate equipment, and teachers being physically active. Program sustainability was similar in advantaged and disadvantaged schools. Evidence-based PE programs can be sustained up to 4 years.     

A single session of resistance exercise does not reduce postprandial lipaemia

This study investigated the effect of a single session of resistance exercise on postprandial lipaemia. Eleven healthy normolipidaemic men with a mean age of 23 (standard error = 1.4) years performed two trials at least 1 week apart in a counterbalanced randomized design. In each trial, participants consumed a test meal (1.2 g fat, 1.1 g carbohydrate, 0.2 g protein and 68 kJ x kg(-1) body mass) between 08.00 and 09.00 h following a 12 h fast. The afternoon before one trial, the participants performed an 88 min bout of resistance exercise. Before the other trial, the participants were inactive (control trial). Resistance exercise was performed using free weights and included four sets of 10 repetitions of each of 11 exercises. Sets were performed at 80% of 10-repetition maximum with a 2 min work and rest interval. Venous blood samples were obtained in the fasted state and at intervals for 6 h postprandially. Fasting plasma triacylglycerol (TAG) concentration did not differ significantly between control (1.03 +/- 0.13 mmol x l(-1)) and exercise (0.94 +/- 0.09 mmol x l(-1)) trials (mean +/- standard error). Similarly, the 6 h total area under the plasma TAG concentration versus time curve did not differ significantly between the control (9.84 +/- 1.40 mmol l(-1) x 6 h(-1)) and exercise (9.38 +/- 1.12 mmol x l(-1) x 6 h(-1)) trials. These findings suggest that a single session of resistance exercise does not reduce postprandial lipaemia.     

Competitive State Anxiety Inventory-2 (CSAI-2): evaluating the Swedish version by confirmatory factor analyses

The Competitive State Anxiety Inventory-2 (CSAI-2) is one of the most frequently used instruments when assessing competitive state anxiety in sport psychology research. However, doubts have been expressed about the factorial validity of both the English and the Greek versions of the scale. Hence, a revised version of the inventory (CSAI-2R) has recently been suggested to be more psychometrically sound (Cox et al., 2003). In the present study, the aim was to evaluate the psychometric properties of the Swedish version of the CSAI-2 using confirmatory factor analyses. A total of 969 athletes (571 men and 398 women) competing in 26 different sports completed the Swedish version of the CSAI-2. Three different factor structures were evaluated: the original three-factor model (with cognitive anxiety, somatic anxiety and self-confidence), a two-factor model in which self-confidence was excluded, and a three-factor model containing 17 items (CSAI-2R). The results revealed that only the 17-item model displayed an acceptable fit to the data. Although some doubts remain about the amount of variance that can be attributed to error variance in the subscales, the results suggest that it is better to use the CSAI-2R rather than the original CSAI-2.