Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)

Altmetrics have been proposed as a way to assess the societal impact of research. Although altmetrics are already in use as impact or attention metrics in different contexts, it is still not clear whether they really capture or reflect societal impact. This study is based on altmetrics, citation counts, research output and case study data from the UK Research Excellence Framework (REF), and peers’ REF assessments of research output and societal impact. We investigated the convergent validity of altmetrics by using two REF datasets: publications submitted as research output (PRO) to the REF and publications referenced in case studies (PCS). Case studies, which are intended to demonstrate societal impact, should cite the most relevant research papers. We used the MHq’ indicator for assessing impact – an indicator which has been introduced for count data with many zeros. The results of the first part of the analysis show that news media as well as mentions on Facebook, in blogs, in Wikipedia, and in policy-related documents have higher MHq’ values for PCS than for PRO. Thus, the altmetric indicators seem to have convergent validity for these data. In the second part of the analysis, altmetrics have been correlated with REF reviewers’ average scores on PCS. The negative or close to zero correlations question the convergent validity of altmetrics in that context. We suggest that they may capture a different aspect of societal impact (which can be called unknown attention) to that seen by reviewers (who are interested in the causal link between research and action in society).     

基于PLOS ALM的altmetrics指标可用性分析

[目的/意义] altmetrics有利于完善新环境下的科研评价体系,但由于数据易被操控、用户行为具有偶然性、数据来源则具有不稳定性等因素,其可用性受到质疑。本文试图基于实际数据集对altmetrics的可用性做客观评价。[方法/过程] 基于PLOS ALM数据,对当前主要的altmetrics指标进行覆盖率、稳定性、时效性和交叉性分析,对指标的使用价值做较为全面和客观的评价,为altmetrics的深入研究和实践利用提供借鉴和参考。[结果/结论] 数据分析结果表明altmetrics指标来源广泛、形式多样,在覆盖率、稳定性和时效性上存在差异,反映了不同维度的文献价值,评价工作中需要根据指标自身的优势、劣势和适用范围,并考虑指标之间的交叉性,合理构建全面的指标体系,满足当前科研评价的需求。     

基于情感分析的altmetrics学术质量评价方法研究

［目的/意义］Altmetrics通过API跟踪和分析学术文献的网络活动,根据影响力分值评价学术成果的影响力。然而,其评价学术影响力不考察读者态度极性,仅提供简单的公众关注度信息,不能直接体现学术成果的质量。为此研究altmetrics评价学术质量的可行性方案。［方法/过程］将情感分析与altmetrics相结合,并以新闻媒体、社交网站、文献数据库、学术论坛的提及、评论、引用、讨论指标为例,探讨altmetrics量化指标与情感分析相结合的理论框架。［结果/结论］构建基于情感分析的altmetrics加权综合运算模型,该模型虽有情感分析技术实现难度较大、计算过程复杂且缺乏实证研究的不足,但作为评价学术质量的一种尝试,值得探讨。     

altmetrics:从理论假说、术语提出到内涵的重新界定

[目的/意义]引介国外近期关于altmetrics的理论思想和研究共识,以期对我国的altmetrics研究带来启示。[方法/过程]采取多种信息检索方法,如网络检索、博客跟踪、浏览会议网站的方法,查找国内外相关信息,考察altmetrics的早期理论假说、术语提出的方式和过程;引介和分析国外专家的研究共识;研究我国相关的期刊论文和博客文章,总结国内altmetrics的研究现状与问题。[结果/结论]研究发现,国外专家普遍认为altmetrics是对传统引文方法的补充,而不是替代;altmetrics测量的是科学研究的关注度和影响力,而不一定是科学研究的质量;altmetrics应该重新命名为"alternative indicators";传统引文评价方法存在的引文动机、发表时间、学科和地域差异等问题在altmetrics评价中仍然存在。因此,在用altmetrics指标进行评价的过程中,不能仅观察altmetrics应用工具提供的数字,还要考察数据源的类型、具体评价内容,最后通过定量和定性评价方法相结合做出正确的判断。我国altmetrics的相关研究虽然发展迅速,但与国际研究水平仍有较大差距。     

altmetrics工具与机构知识库的整合与效果——以PlumX为例

[目的/意义]altmetrics指标是对传统文献计量指标的有力补充。随着altmetrics研究的发展,国际上许多机构知识库已经应用相关工具,取得了一定的效果。那么,altmetrics工具在我国机构知识库中的应用是否必要和可行是一个现阶段极受关注的问题。[方法/过程]在altmetrics应用背景扫描和可行性分析基础上,分别从应用工具的选择、嵌入步骤和插件类型等方面梳理altmetrics工具在机构知识库中应用的相关问题;总结国外基金、科研、医院和高校等机构在整合altmetrics工具后取得的实际效果。[结果/结论]研究发现,在我国已建立的机构知识库中嵌入PlumX插件是一个十分切实可行的方法。国外的PlumX相关实践已显示出6个方面的成效:可视化展示基金投入的产出情况;帮助年轻的科研人员展示成果影响力;基于学术交流指标预测引文影响力;激励科研成果的缴存,提供重要的决策支持信息;更好地满足对小学科小专业科研成果评价的需要;提升机构成果的国际可见度和同行认可度。     

The development of information-education materials for systems of distance learning: “Protection of Intellectual Property,” an example of a course of study

The existing open-source object-oriented systems that can be used as an environment to upload and to store information-educational resources for distance learning (open-source LMS\LCMS: ATutor, Claroline, Dokeos, Sakai, and Moodle), are analyzed. The use of Moodle (a Modular Object-Oriented Dynamic Learning Environment) as the environment for the learning portal of the Mendeleyev University of Chemical Technology of Russia () is justified. The capabilities of Moodle with regard to the development of information-educational resources are explored and educational materials are elaborated for a course of study, viz., “Protection of Intellectual Property,” e.g., theoretical materials, seminar and colloquia exercises, tests for interim and final control of student’s knowledge level, as well as the elements of a learning process management system for a course of study.     

Comparison of Performances of the Governments＇ Websites of Chinese Provinces and Those of USA --Based on Transformed Cost-Benefit Analysis

通过一种改进的成本效益分析法来对比中关政府网站绩效：将成本简化为运营费用和全职人员数量两个指标,通过“申请政府信息公开”获取中国省级政府网站的数据,用美国州政府网站“联系我们”、“实时帮助”等栏目获取美国数据,而效益数据来源于全球通用的互联网统计工具的监测数据。利用统计软件分析两国政府网站在成本、效益上的差异,进而结合网民规模计算出绩效因子,以判别中美政府网站的绩效水平。最后给出结论并归纳出本研究存在的问题。     

Analysis of council management of China＇s sci-tech periodicals based on the practice of Chinese Journal of Natural Medicines

以《中国天然药物》理事会经营模式的实践为基础,分析科技期刊理事会经营过程中的效果、优势、劣势及相关措施。力图理论与实践相结合,为科技期刊的经营创新提供参考。     

The Study of Impact Factors＇ Measurement of the Quality of Digital Reference Service of Library Based on Factor Analysis

以黑龙江省为例,针对数字参考咨询服务质量问题,以问卷调查的形式进行调研,选取19个主要因素进行测评,采取描述分析、因子分析方法找出影响数字参考咨询服务的主要因素,并从图书馆定位、管理、合作等多角度提出有效的改进措施,以期为提升图书馆数字参考咨询服务工作质量提供参考。     

An experimental study of the effects of speech organization upon attitudes of college students∗

The social skill deficit theory of depression states that a lack of social skill is related to the development of depression. However, the findings on this relationship are mixed, possibly due to a variety of variables surrounding the conceptualization and assessment of social skill, as well as the type of subjects used in these investigations. A meta‐analysis was conducted to determine the magnitude of the relationship between depression and social skill as measured by self‐reports, observer‐ratings, and behavioral assessments. The results showed moderate, but not unequivocal, support for the social skill deficit theory. Depression was most strongly related to social skill deficits when they were measured via self‐reports. Observer‐ratings and behavioral analyses of social skill revealed weaker and more sporadic relationships with depression. Several moderator variables as well as a tendency toward negative self‐evaluation in depression appear to influence these relationships.     

An exploratory study of word‐of‐mouth communication in a hierarchy of effects context

Word‐of‐mouth (WOM) communication is introduced within a hierarchy‐of‐effects context. The results of a laboratory experiment suggest that amount of WOM information about products is less important than valence of that information. Counter to previous research implying a disproportionate influence of negative information on product evaluation, negative WOM information in the experiment reported resulted in less familiarity with the mentioned brand. Further, a somewhat surprising finding indicated that brand‐specific negative WOM communication can have the effect of decreasing primary demand for an entire product category.     

A cross‐cultural comparison of implicit theories of requesting

The primary aim of this paper is to identify cross‐cultural similarities and differences in people's implicit theories of requesting. Implicit theories are conceptualized as containing information about five interactive constraints that influence choices about requests: (1) Clarity, (2) Perceived imposition, (3) Consideration for the other's feelings, (4) Risking disapproval for self, and (5) Effectiveness. The paper compares how these five constraints are perceived and rated across cultures and traces possible links between the constraints and perceptions of the likelihood of using various request strategies. Participants are a total of 595 undergraduates: 296 Koreans (native speakers of Korean) and 299 Americans (native American English speakers) studying in their respective countries. After reading a hypothetical request situation, participants evaluated request strategies along the five constraint dimensions as well as for likelihood of use. The rank‐ordering of the request strategies along the dimensions were similar across cultures except for effectiveness of strategies. Striking cross‐cultural differences were found in the rank and mean strategy ratings for effectiveness judgments: U.S. participants considered the direct statement strategy as the most effective way of making a request, while Korean participants rated it as the least effective strategy. Regarding the incompatibility among interactive constraints, U.S. participants saw clarity to be closely related to effectiveness of strategies; for Korean participants clarity of strategies was counterproductive to effectiveness. Theoretical and practical implications of these findings are discussed.     

Grace in Disgrace——Analysis of salvation of David

库切的代表作《耻》一直得到了来自学术界的广泛关注。与以往的论文研究该作中《耻》的表现不同,本论文尝试揭示主人公通过救赎而表现出荣耀的一面。本文分为两方面：主人公对女儿的爱和自己对性的虚荣心的瓦解。     

Current Situation of Theoretical Research of Library Science in China

Since1980s,Chinahasmadegreatprogressinthetheoreticalresearchoflibraryscience.Themostim-portantcharacteristicsmaybedescribedasfollows:　　·Thelibraryscienceresearchhascometoevadebeinglimitedonlytodescribeexperimentallythecon-creteworkinthelibrary,andpaymoreandmoreattentiontotheconnotationandtheoreticalsystemofthediscipline;　　·Ithascomeoutofthemicro-worldofthelibrary,andbeenspeculatingabouttheactualmacro-prob-lemsbothundertheperipheralenvironmentandinthesociety;　　·Ithasintroducedmanyachi…     

Theoretical approaches to defining the concept of the “perception of the meaning of information”

This paper sets the problem of development of information culture and advances the hypothesis about understanding of the meaning of information as its basis. Five ideas related to the problems of the paper are distinguished in the theory of understanding. The paper describes the concept of adequate and inadequate understanding the meaning of information and develops the criteria of understanding the meaning of information. The concept of the “understanding of the meaning of information” is defined.     

Discursive Constructions of the Meaning of “Family” in Online Narratives of Foster Adoptive Parents

Framed by relational dialectics theory, discursive constructions of the meaning of “family” were examined in 100 online foster adoption narratives. Parental narratives manifested struggles between biogenetic and discursive constructions of “family,” identified here as the discourse of biological normativity (DBN) and discourse of constitutive kinning (DCK). The DBN reinscribes the dominant cultural and foster care system preference for biogenetically connected families. The DCK resists the DBN, maintaining that enacted behaviors and shared affections, rather than shared genetics, constitute legitimate families. Contrapuntal analysis revealed a high degree of polemic interplay; both discourses competed to be centered rather than marginalized through the discursive practices of negating, countering, and entertaining. Implications for theorizing definitions of family and studying families in context are discussed     

A test of the initial processes of the goal‐planning‐action model of interpersonal influence

Dillard's goals‐planning‐action (GPA) model of interpersonal influence encompasses two different process models depending on the initial weighing of primary and secondary goals. In contrast to the GPA's prediction that the ordering of the intervening processes is moderated by the initial weighing of these two types of goals, a simplified version was found that fit the data both when the primary goal was greater than the secondary goal and when the secondary goal was greater than the primary goal. In both conditions, the two types of goals have simultaneous, direct relationships with the persuaders’ decisions to engage their targets, and indirect effects on subsequent plan generation.     

What determines success of an e-government service? Validation of an integrative model of e-filing continuance usage

The purpose of this study is to validate an integrated model of e-filing continuance usage. The model has its theoretical basis in the expectancy confirmation theory and the DeLone and McLean's IS Success model. The model is extended to include two additional constructs relevant to e-filing continuance usage: perceived risks and habit. The model is tested using data collected from a sample of 645 e-filing users in Mauritius. Structural equation modeling was used to test the hypotheses. Findings suggest that citizens' continuance usage intention of e-filing is influenced by system quality, user satisfaction and habit. User satisfaction had the strongest impact on e-filing continuance usage intention. This study makes a valuable contribution to knowledge through the extension and validation of the ECM and IS Success model to explore salient factors affecting e-filing continuance usage intention. The practical implications of the findings for tax collection agencies are discussed.     

The phonetic aspect of Joshua Steele's system of prosody∗

This paper identifies the essential characteristics of victimage rhetoric in American justifications for war. The Johnson administration's insistence on the aggression‐from‐the‐North thesis is the starting point for the analysis. Close inspection of the administration's efforts reveals that the enemy is portrayed as a savage, i.e., an aggressor, driven by irrational desires for conquest, who is seeking to subjugate others by force of arms. This image of the enemy is intensified by a contrasting image of the United States as a representative of civilization who is rational, tolerant of diversity, and pacific. Further investigation confirms that the contrasts of force vs. freedom, irrationality vs. rationality, and aggression vs. defense permeate the substance and style of the call‐to‐arms throughout American history. They provide the internal dynamic which integrates recurrent form into a genre of rhetorical discourse.