Increasing cheat robustness of crowdsourcing tasks |
| |
Authors: | Carsten Eickhoff Arjen P de Vries |
| |
Institution: | 1. Delft University of Technology, Delft, The Netherlands 2. CWI, Amsterdam, The Netherlands
|
| |
Abstract: | Crowdsourcing successfully strives to become a widely used means of collecting large-scale scientific corpora. Many research fields, including Information Retrieval, rely on this novel way of data acquisition. However, it seems to be undermined by a significant share of workers that are primarily interested in producing quick generic answers rather than correct ones in order to optimise their time-efficiency and, in turn, earn more money. Recently, we have seen numerous sophisticated schemes of identifying such workers. Those, however, often require additional resources or introduce artificial limitations to the task. In this work, we take a different approach by investigating means of a priori making crowdsourced tasks more resistant against cheaters. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|