
Abstract Motivation: Bioinformatics is faced with a variety of problems that require human involvement. Tasks like genome annotation, image analysis, knowledge-base population and protein structure determination all benefit from human input. In some cases, people are needed in vast quantities, whereas in others, we need just a few with rare abilities. Crowdsourcing encompasses an emerging collection of approaches for harnessing such distributed human intelligence. Recently, the bioinformatics community has begun to apply crowdsourcing in a variety of contexts, yet few resources are available that describe how these human-powered systems work and how to use them effectively in scientific domains. Results: Here, we provide a framework for understanding and applying several different types of crowdsourcing. The framework considers two broad classes: systems for solving large-volume ‘microtasks’ and systems for solving high-difficulty ‘megatasks’. Within these classes, we discuss system types, including volunteer labor, games with a purpose, microtask markets and open innovation contests. We illustrate each system type with successful examples in bioinformatics and conclude with a guide for matching problems to crowdsourcing solutions that highlights the positives and negatives of different approaches. Contact: bgood@scripps.edu
Volunteers, Social and Information Networks (cs.SI), FOS: Computer and information sciences, Physics - Physics and Society, Computational Biology, FOS: Physical sciences, Computer Science - Social and Information Networks, Physics and Society (physics.soc-ph), Quantitative Biology - Quantitative Methods, Computer Science - Computers and Society, Games, Experimental, FOS: Biological sciences, Computers and Society (cs.CY), Crowdsourcing, Sequence Alignment, Quantitative Methods (q-bio.QM)
Volunteers, Social and Information Networks (cs.SI), FOS: Computer and information sciences, Physics - Physics and Society, Computational Biology, FOS: Physical sciences, Computer Science - Social and Information Networks, Physics and Society (physics.soc-ph), Quantitative Biology - Quantitative Methods, Computer Science - Computers and Society, Games, Experimental, FOS: Biological sciences, Computers and Society (cs.CY), Crowdsourcing, Sequence Alignment, Quantitative Methods (q-bio.QM)
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 106 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 1% |
