An analysis on document length retrieval trends in language modeling smoothing

Document length is widely recognized as an important factor for adjusting retrieval systems. Many models tend to favor the retrieval of either short or long documents and, thus, a length-based correction needs to be applied for avoiding any length bias. In Language Modeling for Information Retrieval, smoothing methods are applied to move probability mass from document terms to unseen words, which is often dependant upon document length. In this article, we perform an in-depth study of this behavior, characterized by the document length retrieval trends, of three popular smoothing methods across a number of factors, and its impact on the length of documents retrieved and retrieval performance. First, we theoretically analyze the Jelinek–Mercer, Dirichlet prior and two-stage smoothing strategies and, then, conduct an empirical analysis. In our analysis we show how Dirichlet prior smoothing caters for document length more appropriately than Jelinek–Mercer smoothing which leads to its superior retrieval performance. In a follow up analysis, we posit that length-based priors can be used to offset any bias in the length retrieval trends stemming from the retrieval formula derived by the smoothing technique. We show that the performance of Jelinek–Mercer smoothing can be significantly improved by using such a prior, which provides a natural and simple alternative to decouple the query and document modeling roles of smoothing. With the analysis of retrieval behavior conducted in this article, it is possible to understand why the Dirichlet Prior smoothing performs better than the Jelinek–Mercer, and why the performance of the Jelinek–Mercer method is improved by including a length-based prior.

Discoverability and Access in Book Publishing

Search engine discoverability programs have changed the fundamentals of book marketing by enabling content inside the book to be used as the source of marketing itself via search results inside books. The internet trifecta of search, browse, buy is the end game but the complexities of making this work is explored along with an in-depth overview of the potential upside and difficulties of online content purchase models.     

Experimentation and Innovation in U.S. Publishing Today: Findings from the Book Industry Study Group

In February 2008 the Book Industry Study Group (BISG) conducted a survey of U.S. publishers to determine the extent of technology-driven innovation and experimentation. The survey findings were published alongside a set of 10 case studies in May 2008 as “From experimentation to innovation in the digital age—case studies from the North American Book Industry 2008”. This article, written by Michael Healy, Executive Director of the BISG, summarizes the circumstances that led to the survey and shares the key findings.     

Archival Science in Brazil: the establishment of a scientific discipline and its impact on training archivists in the era of information and knowledge

This article addresses the trajectory of Archival Science in Brazil, its extracurricular characteristics and its particular relationship with Information Science within academics, its institutional associations, and some considerations regarding current training for archivists in Brazil. The methodological procedures used included analyzing documents from the National Archive Fonds of Brazil, reviewing archive literature, and interviewing people involved in consolidating Archival Science. This study concludes that Archival Science research is taking place in graduate programs throughout public Brazilian universities and points out that people working with archives now have more advanced training, such as undergraduate degrees in Archival Science or other. This study also focuses on archives as information units, while presenting and reflecting on the demands of training archivists who are faced with the challenges of the working world and the era of information and knowledge—challenges that go beyond merely technical procedures and encompass dynamic planning and orientation activities.     

A compressed self-index using a Ziv–Lempel dictionary

A compressed full-text self-index for a text T, of size u, is a data structure used to search for patterns P, of size m, in T, that requires reduced space, i.e. space that depends on the empirical entropy (H _k or H ₀) of T, and is, furthermore, able to reproduce any substring of T. In this paper we present a new compressed self-index able to locate the occurrences of P in O((m + occ)log u) time, where occ is the number of occurrences. The fundamental improvement over previous LZ78 based indexes is the reduction of the search time dependency on m from O(m ²) to O(m). To achieve this result we point out the main obstacle to linear time algorithms based on LZ78 data compression and expose and explore the nature of a recurrent structure in LZ-indexes, the suffix tree. We show that our method is very competitive in practice by comparing it against other state of the art compressed indexes.

MicroRNAs: Tiny genetic switches in our genome

Gary Ruvkun is a winner of the 2015 Breakthrough Prize in Life Sciences. He is a co-discoverer of microRNAs (with Victor Ambros, University of Massachusetts), regarded as one of the seminal discoveries of 21st century molecular biology. In addition to the Breakthrough Prize, Ruvkun and Ambros have received the Warren Triennial Prize, the Laskar Foundation Award, and numerous other awards and prizes. Professor Ruvkun obtained his PhD from Harvard University, did his postdoctoral research at MIT, and subsequently accepted a faculty position at Harvard, where he is currently Professor of Genetics. His laboratory conducts research on basic cellular processes, using the worm C. elegans as a model system.     

Multi-core microprocessors

Multi-core microprocessor is an interconnected set of independent processors called cores integrated on a single silicon chip. These processing cores communicate and cooperate with one another to execute one or more programs faster than a single core processor. In this article we describe how and why these types of processors evolved. We also describe the basics of how multi-core microprocessors are programmed.     

Dutch Publishing Industry Seeks Startups Through the Renew the Book Competition

In order to find new ways of growing the market, the Dutch General Publishers Association developed an innovation-competition for startups worldwide to bring innovative thinking and ideas into the Dutch Publishing Industry. The competition is the first and only program dedicated to startups leveraging new and creative business ideas around all the elements of book publishing and has its second edition this year. The competition is for startups, who are active in areas such as publishing automation, book retail, data analytics, authoring, book content development, and audience engagement.     

UAE’s Publishing Industry: A Vision of an Avant-Garde Nation

This article outlines in detail the ten strategic goals that the UAE publishing industry has identified to lead a comprehensive transformation of the industry and to cement its position as a regional leader. The main goals revolve around building regional and global partnerships, developing a global publishing hub, improving legal framework for the all the stakeholders of the industry, building quality Arabic content for local and regional readers, supporting educational publishing, launching initiatives to encourage reading for pleasure, improving distribution networks and retail, transforming libraries, and instilling a sense of pride and understanding of local culture while supporting creative talents and skills. Also, this article will share information about some leading initiatives being implemented in Sharjah and the United Arab Emirates, and future initiatives to be implemented to achieve the ten goals.