Evaluating Crowdsourcing Participants in the Absence of Ground-Truth: Paper and Code

Get our free extension to see links to code for papers anywhere online!Free add-on: code for papers everywhere!Free add-on: See code for papers anywhere!

Add to Chrome

Add to Firefox

Add to Edge

Evaluating Crowdsourcing Participants in the Absence of Ground-Truth

May 30, 2016
Ramanathan Subramanian, Romer Rosales, Glenn Fung, Jennifer Dy

Figure 1 for Evaluating Crowdsourcing Participants in the Absence of Ground-Truth

Figure 2 for Evaluating Crowdsourcing Participants in the Absence of Ground-Truth

Figure 3 for Evaluating Crowdsourcing Participants in the Absence of Ground-Truth

Figure 4 for Evaluating Crowdsourcing Participants in the Absence of Ground-Truth

Share this with someone who'll enjoy it:

Given a supervised/semi-supervised learning scenario where multiple annotators are available, we consider the problem of identification of adversarial or unreliable annotators.

* 4 pages, 5 figures, Workshop on Human Computation for Science and Computational Sustainability, NIPS 2012, Lake Tahoe, NV. 7 Dec 2012

View paper on

Share this with someone who'll enjoy it: