Inproceedings,
CrowdForge: crowdsourcing complex work
Proceedings of the 24th annual ACM symposium on User interface software and technology, page 43--52. New York, NY, USA, ACM, (2011)
DOI: 10.1145/2047196.2047202
Abstract
Micro-task markets such as Amazon's Mechanical Turk represent a new paradigm for accomplishing work, in which employers can tap into a large population of workers around the globe to accomplish tasks in a fraction of the time and money of more traditional methods. However, such markets have been primarily used for simple, independent tasks, such as labeling an image or judging the relevance of a search result. Here we present a general purpose framework for accomplishing complex and interdependent tasks using micro-task markets. We describe our framework, a web-based prototype, and case studies on article writing, decision making, and science journalism that demonstrate the benefits and limitations of the approach.
Tags
Users
Comments and Reviewsshow / hide
- @jaeschke 12 years agoReally cool paper! Based on the map-reduce idea they split up complex tasks into simpler ones and thereby allow humans to solve the small tasks, e.g., writing an article. They can even show that such a collaboratively created article is cheaper and better than an article created by a single worker! The partitioning of a larger task can be described using a simple web form. This probably is not sufficient for more complex tasks, still, the approach is quite simple and appealing.