Journal Article

The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces

Fulltext URI

Document type

Text/Journal Article

Additional Information

Date

2023

Journal Title

Journal ISSN

Volume Title

Publisher

Springer

Abstract

Micro-task crowdsourcing marketplaces like Figure Eight (F8) connect a large pool of workers to employers through a single online platform, by aggregating multiple crowdsourcing platforms (channels) under a unique system. This paper investigates the F8 channels’ demographic distribution and reward schemes by analysing more than 53k crowdsourcing tasks over four years, collecting survey data and scraping marketplace metadata. We reveal an heterogeneous per-channel demographic distribution, and an opaque channel commission scheme, that varies over time and is not communicated to the employer when launching a task: workers often will receive a smaller payment than expected by the employer. In addition, the impact of channel commission schemes on the relationship between requesters and crowdworkers is explored. These observations uncover important issues on ethics, reliability and transparency of crowdsourced experiment when using this kind of marketplaces, especially for academic research.

Description

Xie, Haoyu; Maddalena, Eddy; Qarout, Rehab; Checco, Alessandro (2023): The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces. Computer Supported Cooperative Work (CSCW): Vol. 32, No. 3. DOI: 10.1007/s10606-023-09464-9. Springer. ISSN: 1573-7551. pp. 439-474

Citation

Tags