Scoring research output using statistical quantile plotting

In this paper, we propose two methods for scoring scientific output based on statistical quantile plotting. First, a rescaling of journal impact factors for scoring scientific output on a macro level is proposed. It is based on normal quantile plotting which allows to transform impact data over several subject categories to a standardized distribution. This can be used in comparing scientific output of larger entities such as departments working in quite different areas of research. Next, as an alternative to the Hirsch index [Hirsch, J.E. (2005). An index to quantify an individuals scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569–16572], the extreme value index is proposed as an indicator for assessment of the research performance of individual scientists. In case of Lotkaian–Zipf–Pareto behaviour of citation counts of an individual, the extreme value index can be interpreted as the slope in a Pareto–Zipf quantile plot. This index, in contrast to the Hirsch index, is not influenced by the number of publications but stresses the decay of the statistical tail of citation counts. It appears to be much less sensitive to the science field than the Hirsch index.     

利用文中数据识别统计学错误

医学期刊中存在着或大或小的数据方面的问题,尽管笔误较为常见,但也有些问题已经影响到所得结论的正确性.通过分析医学论文中常见的数据错误,建议编辑应该提高责任心、避免低级错误,同时注意增强医学专业与统计素养、借助权威软件并善于利用各种手头资源及开源软件,以增强对数据的审查能力,从而提高医学论文的编校水平.     

医学论文统计学报告水平评价量表的研制及其意义

作为实时、内部评价医学论文科学水平的一部分,在系列研究的基础上研制出含27个项目的医学论文统计学报告水平评价量表。经过信度和效度的外考核,该量表在不同人之间评价信度较好,对不同级别杂志的区分效度也好,可用于医学论文的评价。本量表适用于医学编辑对未发表论文科学水平的实时内部评价,也适用于同行或管理部门对已发表论文的评价,其适用对象是有对照的临床研究论文。     

医学论文关键词的选取原则

医学论文关键词的标引应遵循4条原则:词性宜实不宜虚,范围宜小不宜大,构成宜短不宜长,时效宜新不宜旧.关键词标引存在的4个问题是遗漏标引、过度标引、重复标引和偏离标引.     

Creating critical objectives and assessments using a critical communication pedagogical framework

ABSTRACT

Courses: Instructional Communication, Graduate Teaching Assistant Training Programs

Objectives: Students will (1) understand critical communication pedagogy (CCP); (2) evaluate traditional and critical objectives and assessment procedures; and (3) create critical objectives and assessment procedures.     

正交试验类论文的规范化表达

为进一步做好科技论文的编辑加工工作,审读科技期刊中采用正交试验设计方法的论文,针对正交试验类论文中常见的表达问题,如内容混乱、过度使用表格、盲目照搬教科书中的表达和滥用因素代号等,探讨相应的规范化表达方式,以期为正交试验类论文的规范化表达提供参考。     

Experiments with dictionary-based CLIR using graded relevance assessments: Improving effectiveness by pseudo-relevance feedback

Research on cross-language information retrieval (CLIR) has typically been restricted to settings using binary relevance assessments. In this paper, we present evaluation results for dictionary-based CLIR using graded relevance assessments in a best match retrieval environment. A text database containing newspaper articles and a related set of 35 search topics were used in the tests. First, monolingual baseline queries were automatically formed from the topics. Secondly, source language topics (in English, German, and Swedish) were automatically translated into the target language (Finnish), using structured target queries. The effectiveness of the translated queries was compared to that of the monolingual queries. Thirdly, pseudo-relevance feedback was used to expand the original target queries. CLIR performance was evaluated using three relevance thresholds: stringent, regular, and liberal. When regular or liberal threshold was used, a reasonable performance was achieved. Using stringent threshold, equally high performance could not be achieved. On all the relevance thresholds the performance of the translated queries was successfully raised by pseudo-relevance feedback based query expansion. However, the performance of the stringent threshold in relation to the other thresholds could not be raised by this method.     

Leadership competencies and the importance of research methods and statistical analysis in decision making and research and publication: A study of citation patterns

The roles of academic librarians and administrators include the use of statistical analysis and general analytical abilities in their decision-making processes, as well as in their roles as researchers, in developing research collections, and in providing instruction and reference assistance for students and other researchers. The research presented in this article addresses the original research published in frequently cited library and information science (LIS) journals to consider the extent to which academic librarians and administrators conduct and publish original research and to evaluate the range of research methodologies used and the level of collaboration among academic librarians, LIS faculty members, and others. The research results extend the prior self-report research in this area and indicate that academic librarians, administrators, and LIS faculty are authors of most of the published research in highly ranked journals. The level of collaboration among those in different types of roles is limited, however. In addition, most of the research articles have been authored or coauthored by those in research university libraries.     

The problem of citation impact assessments for recent publication years in institutional evaluations

Bibliometrics has become an indispensable tool in the evaluation of institutions (in the natural and life sciences). An evaluation report without bibliometric data has become a rarity. However, evaluations are often required to measure the citation impact of publications in very recent years in particular. As a citation analysis is only meaningful for publications for which a citation window of at least three years is guaranteed, very recent years cannot (should not) be included in the analysis. This study presents various options for dealing with this problem in statistical analysis. The publications from two universities from 2000 to 2011 are used as a sample dataset (n = 2652, univ 1 = 1484 and univ 2 = 1168). One option is to show the citation impact data (percentiles) in a graphic and to use a line for percentiles regressed on ‘distant’ publication years (with confidence interval) showing the trend for the ‘very recent’ publication years. Another way of dealing with the problem is to work with the concept of samples and populations. The third option (very related to the second) is the application of the counterfactual concept of causality.     

On the demand for efficiency assessments on reports of geologic studies

This paper gives the results of an analysis of the demand for scientific products giving an assessment of the efficiency of subsoil resources management that were needed by various organizations. The lists of organizations that supplied and demanded such products are discussed, as well as the list of the most demanded products and their distribution over the regions of the Russian Federation. The study was performed using the SKORNI automatic system that operates in the All-Russian Institute for the Economics of Mineral Resources and Resource Management (VIEMS).     

Teaching qualitative research methods using Undercover Boss

Course(s): Research Methods, Qualitative Research Methods, Organizational Communication, Business Communication

Objectives: After completing this class exercise, students should be able to identify the major components of a qualitative research study, along with the ethical dilemmas that come with doing qualitative research.     

On information retrieval metrics designed for evaluation with incomplete relevance assessments

Modern information retrieval (IR) test collections have grown in size, but the available manpower for relevance assessments has more or less remained constant. Hence, how to reliably evaluate and compare IR systems using incomplete relevance data, where many documents exist that were never examined by the relevance assessors, is receiving a lot of attention. This article compares the robustness of IR metrics to incomplete relevance assessments, using four different sets of graded-relevance test collections with submitted runs—the TREC 2003 and 2004 robust track data and the NTCIR-6 Japanese and Chinese IR data from the crosslingual task. Following previous work, we artificially reduce the original relevance data to simulate IR evaluation environments with extremely incomplete relevance data. We then investigate the effect of this reduction on discriminative power, which we define as the proportion of system pairs with a statistically significant difference for a given probability of Type I Error, and on Kendall’s rank correlation, which reflects the overall resemblance of two system rankings according to two different metrics or two different relevance data sets. According to these experiments, Q′, nDCG′ and AP′ proposed by Sakai are superior to bpref proposed by Buckley and Voorhees and to Rank-Biased Precision proposed by Moffat and Zobel. We also point out some weaknesses of bpref and Rank-Biased Precision by examining their formal definitions.

Two-stage statistical language models for text database selection

As the number and diversity of distributed Web databases on the Internet exponentially increase, it is difficult for user to know which databases are appropriate to search. Given database language models that describe the content of each database, database selection services can provide assistance in locating databases relevant to the information needs of users. In this paper, we propose a database selection approach based on statistical language modeling. The basic idea behind the approach is that, for databases that are categorized into a topic hierarchy, individual language models are estimated at different search stages, and then the databases are ranked by the similarity to the query according to the estimated language model. Two-stage smoothed language models are presented to circumvent inaccuracy due to word sparseness. Experimental results demonstrate that such a language modeling approach is competitive with current state-of-the-art database selection approaches.     

学术期刊正交试验类稿件的审读方法

以农林类A+和A类期刊题名或关键词含有"正交试验"或"正交实验"的论文为研究对象,依据正交试验原理,对各论文进行审读和统计分析。结果表明:正交表记号错误的占调查论文总数的20.29%,k值错误的占28.77%,R值错误的占27.97%,因素主次排列错误的占17.01%,最佳组合错误的占26.80%;经验证,有31.86%的论文方差分析各因素水平间均不显著。由于各种错误最终导致63.13%的论文得出了错误结论或试验设计失败。可见,正交试验类论文的编辑工作应予高度重视。作者从编辑的视角给出了识别、修正这些错误的方法。     

医学论文中等级资料统计方法误用的案例辨析

医学论文内涉及大量的等级资料,等级资料统计方法的误用情况较多。作者列举公开发表的文章以及在编辑文章过程中所涉及等级资料的统计方法误用的多个案例,辨析了等级资料作为组别和作为效应量时的统计方法误用类型,并提出了正确的使用方法,以供医学编辑同人参考。     

科技期刊编辑部统计指标体系的分析及建立

针对科技期刊编辑部门内部数据统计的重要性,建立了一套基于Excel和网络统计数据库的编辑部内部统计指标体系,提出了融合不同类别的统计指标进行综合分析的方法。通过综合分析这些指标,可以为专业编辑制订报道计划、组织稿件、把握稿件初审的尺度提供参考依据,对增加稿源数量并提高质量、扩大期刊发行量、拓展广告客户、寻找创收点等方面的经营决策具有重要作用,同时对规范审稿机制、控制审稿周期及业务流程等具有一定的监督及评价作用。     

近五年《大学图书情报学刊》载文引文统计分析

文章运用文献计量学的方法,对2001-2005年2月<大学图书情报学刊>的载文、引文情况进行了统计分析,为该刊今后的发展提供参考数据.     

医学期刊中容易误用的统计学方法辨析

对医学期刊中容易误用的几种统计学方法进行辨析,包括重复测量方差分析的误用、非参数检验的误用,并对多元线性回归与Logistic回归进行了差异性分析,使编辑能够分辨论文统计方法的正误,并作出正确处理,以提高论文的科学性和期刊质量。