Retrieval effectiveness on the web

Search engines play an essential role in the usability of Internet-based information systems and without them the web would certainly break down or, at the very least would develop at a much slower rate. Our main objective is to analyze and evaluate the retrieval effectiveness of various indexing and searching strategies on a new web text collection, using a rigorous evaluation methodology. Our second aim is to describe and evaluate different preprocessing techniques that might be implemented in order to improve retrieval effectiveness. As a third objective, this paper will evaluate whether or not hyperlinks may serve as useful sources of evidence in improving retrieval algorithms.     

The effect of user characteristics on search effectiveness in information retrieval

This paper investigates the influence of user characteristics (e.g. search experience and cognitive skills) on user effectiveness. A user study was conducted to investigate this effect, 56 participants completed searches for 56 topics using the TREC test collection. Results indicated that participants with search experience and high cognitive skills were more effective than those with less experience and slower perceptual abilities. However, all users rated themselves with the same level of satisfaction with the search results despite the fact they varied substantially in their effectiveness. Therefore, information retrieval evaluators should take these factors into consideration when investigating the impact of system effectiveness on user effectiveness.     

The effectiveness of Web search engines for retrieving relevant ecommerce links

Ecommerce is developing into a fast-growing channel for new business, so a strong presence in this domain could prove essential to the success of numerous commercial organizations. However, there is little research examining ecommerce at the individual customer level, particularly on the success of everyday ecommerce searches. This is critical for the continued success of online commerce. The purpose of this research is to evaluate the effectiveness of search engines in the retrieval of relevant ecommerce links. The study examines the effectiveness of five different types of search engines in response to ecommerce queries by comparing the engines’ quality of ecommerce links using topical relevancy ratings. This research employs 100 ecommerce queries, five major search engines, and more than 3540 Web links. The findings indicate that links retrieved using an ecommerce search engine are significantly better than those obtained from most other engines types but do not significantly differ from links obtained from a Web directory service. We discuss the implications for Web system design and ecommerce marketing campaigns.     

专利检索与分析方法的选择研究

随着专利数量的逐年大幅增长,获取有效目标专利的难度也越来越大,专利检索如何实现检准率和检全率的合理平衡成为研究难点。以德温特专利数据库中3G技术专利为检索对象,比较了传统主题检索和手工代码检索两种方式所对应检索及其分析结果的异同,研究表明选择合理的专利检索和分析方法有助于保证分析结果的权威性。     

An experimental comparison of the effectiveness of computers and humans as search intermediaries.

An experimental computer intermediary system, CONIT, that assists users in accessing and searching heterogeneous retrieval systems has been enhanced with various search aids. Controlled experiments have been conducted to compare the effectiveness of the enhanced CONIT intermediary with that of human expert intermediary search specialists. Some 16 end users, none of whom had previously operated either CONIT or any of the four connected retrieval systems, performed searches on 20 different topics using CONIT with no assistance other than that provided by CONIT itself (except to recover from computer/software bugs). These same users also performed searches on the same topics with the help of human expert intermediaries who searched using the retrieval systems directly. Sometimes CONIT and sometimes the human expert were clearly superior in terms of such parameters as recall and search time. In general, however, users searching alone with CONIT achieved somewhat higher online recall at the expense of longer session times. We conclude that advanced experimental intermediary techniques are now capable of providing search assistance whose effectiveness at least approximates that of human intermediaries in some contexts. Also analyzed is the cost effectiveness of current intermediary systems. Finally, consideration is given to the prospects for much more advanced systems which would perform such functions as automatic data-base selection and the simulation of human experts, and thereby make information retrieval more effective for all classes of users.     

Identification and control of delayed SISO systems through pattern search methods

In this study, an approach to identify and control stable, unstable and integrating systems with unknown delays, framed on the generalized Pattern Search Method is presented. The proposed method inherits the global convergence properties of the generalized Pattern Search Method, allowing us to make a stability analysis of the proposed approach and delay identification capabilities. The proposed approach identifies the delay and guarantees closed-loop stability, which could be a difficult task since in unstable and integrating cases, open-loop experiments are not feasible. Simulation examples show the usefulness of the proposed strategy proving that the scheme is capable of identifying the delay and stabilizing the system even with long delay.     

Evaluating subtopic retrieval methods: Clustering versus diversification of search results

To address the inability of current ranking systems to support subtopic retrieval, two main post-processing techniques of search results have been investigated: clustering and diversification. In this paper we present a comparative study of their performance, using a set of complementary evaluation measures that can be applied to both partitions and ranked lists, and two specialized test collections focusing on broad and ambiguous queries, respectively. The main finding of our experiments is that diversification of top hits is more useful for quick coverage of distinct subtopics whereas clustering is better for full retrieval of single subtopics, with a better balance in performance achieved through generating multiple subsets of diverse search results. We also found that there is little scope for improvement over the search engine baseline unless we are interested in strict full-subtopic retrieval, and that search results clustering methods do not perform well on queries with low divergence subtopics, mainly due to the difficulty of generating discriminative cluster labels.     

Finding information on the World Wide Web: the retrieval effectiveness of search engines

Search engines are essential for finding information on the World Wide Web. We conducted a study to see how effective eight search engines are. Expert searchers sought information on the Web for users who had legitimate needs for information, and these users assessed the relevance of the information retrieved. We calculated traditional information retrieval measures of recall and precision at varying numbers of retrieved documents and used these as the bases for statistical comparisons of retrieval effectiveness among the eight search engines. We also calculated the likelihood that a document retrieved by one search engine was retrieved by other search engines as well.     

知识检索与信息检索的检索效率比较

本文在对知识检索与信息检索的检索机制分析的基础上，对知识检索与信息检索的检全率、检准率进行了比较，认为知识检索的检索效率优于传统信息检索，同时对影响知识检索效率的因素进行了讨论，指出信息检索要向知识检索过渡和发展，并针对目前网络检索的现状，提出了一些改进措施。     

混合式评审及其学术效果评析——以《经济研究》杂志为例

[目的]探讨混合式评审是否是期刊论文的较为理想的评审方式。[方法]分析《经济研究》杂志近21年论文引用数据的阶段性差异来比较不同评审方式的效果。[结果]从月平均引用量和前30%高引用文章占总引用比例两个指标来看,混合式评审对于《经济研究》杂志而言优于匿名评审和公开评审。[结论]需要以实证数据为依据,进一步探讨何种评审方式最有利于学术发展。     

网络信息检索工具评价实现（II）—中、英文搜索引擎检索评价实验

本文介绍了一个中、英文搜索引擎对评价实验，实验使用H.Vernon Leighton和JaideepSrvastava提出的“前X命中记录查准率”作为主要评价指标，对几种典型的中，英文搜索引擎做了评价。     

信息检索中文献漏检误检因素分析

文章分析了信息检索中文献漏检和误检的因素,从数据库的选择、检索词的确定、检索策略的制定等方面提出了避免漏检误检的对策。     

检索语言在文献检索教学中的定位

Focused on the use of retrieval language in document retrieval teaching, this article discusses the influence of retrieval language on retrieval tool, retrieval mode and retrieval efficiency. It suggests that a retrieval language system be constructed and points out its proportion to document retrieval teaching.     

联机检索与网络信息检索的成本——收益分析

From the angle of cost and benefit,this paper describes two important methods for sharing information resources—online retrieval and Web retrieval.Their current characteristics are qualitatively analyzed.Some inspirations drawn from cost-benefit analysis are given.     

科技文献检索策略的失误因素与检索技巧

从实用文献信息学角度，对科技文献的检索途径和策略做了探讨，并从检索理论和实际运作的角度，提出了文献检索中常出现的误差因素及修正措施。对科技人员运用规范的检索语言和检索技术，开发和利用科技文献，对文献进行技术标引，达到最佳检索效率等方面，具有指导意义。     

馆藏资源检索与Dialog联机检索在高校科技查新中的应用对比研究

基于调查分析与实例对比,从检索速度、检索费用、检全率、检准率、操作难易及压力感受等几个方面,对馆藏资源检索与Dialog联机检索在高校科技查新中的应用情况进行比较分析.     

Multimedia search capabilities of Chinese language search engines

This paper reports results from a study exploring the multimedia search functionality of Chinese language search engines. Web searching in Chinese (Mandarin) is a growing research area and a technical challenge for popular commercial Web search engines. Few studies have been conducted on Chinese language search engines. We investigate two research questions: which Chinese language search engines provide multimedia searching, and what multimedia search functionalities are available in Chinese language Web search engines. Specifically, we examine each Web search engine’s (1) features permitting Chinese language multimedia searches, (2) extent of search personalization and user control of multimedia search variables, and (3) the relationships between Web search engines and their features in the Chinese context. Key findings show that Chinese language Web search engines offer limited multimedia search functionality, and general search engines provide a wider range of features than specialized multimedia search engines. Study results have implications for Chinese Web users, Website designers and Web search engine developers.     

Web检索工具性能效果比较研究

利用Web检索工具的帮助文件，比较研究了Yahoo!、AltaVista、Infoseek、Excite、Web Crawler和Magellan的检索性能，并通过教育、科普和体育方面的三个查询实例比较研究了Yahoo!、Alta Vista和Excite的检索效果。对全面获取有效信息提出了建议。