Journal Article

Turking in a Global Labour Market

Thumbnail Image

Fulltext URI

Document type

Text/Journal Article

Additional Information

Date

2016, 2016

Authors

Journal Title

Journal ISSN

Volume Title

Source

Computer Supported Cooperative Work (CSCW): Vol. 25, No. 1

Publisher

Springer

Abstract

This paper examines how working in the global labour market of Amazon Mechanical Turk (AMT) impacts upon and is understood by two different groups of workers. To do this we report on two qualitative studies; one of US and another of Indian crowdworkers (or ‘Turkers’) that we analysed from an ethnomethodological orientation. Our data is naturalistic and comes from a variety of sources—interviews, observations and forum posts—where Turkers describe their work, and their understandings of that work and of the transnational market they work in. We compare and contrast their situations, their reflections on the marketplace and its global reach, and we take a look at their understandings of one another. Our focus is on ‘the work to making turking work’ (Martin et al. 2014 ). That is, the work that turkers do to organise and make sense of their work as they operate in the AMT marketplace, such that they can do so effectively. AMT is a technologically mediated marketplace—that is the distribution, completion and payment of work is done online, almost completely through the AMT platform. The design of the platform has important consequences for how Turkers experience and understand the market (including its global or transnational nature). We discuss how our findings relate to a variety of CSCW issues and provide an initial examination of how they relate to globalisation both as a mundanely experienced phenomenon and as a topic of academic interest. We finish the article by drawing on our own experiences in research and design to look at how technology can be used to intervene in a market like this to try to address imbalances in power and agency between employers and workers.

Description

Martin, David; O’Neill, Jacki; Gupta, Neha; Hanrahan, Benjamin V. (2016): Turking in a Global Labour Market. Computer Supported Cooperative Work (CSCW): Vol. 25, No. 1. DOI: 10.1007/s10606-015-9241-6. Springer. PISSN: 1573-7551. pp. 39-77

Keywords

activism, amazon mechanical turk (AMT), crowdsourcing, ethnography, ethnomethodology, globalisation, transnational markets, turkers

Citation

DOI

10.1007/s10606-015-9241-6

URI

URI

http://dx.doi.org/10.1007/s10606-015-9241-6
 https://dl.eusset.eu/handle/20.500.12015/3834

Collections

JCSCW Vol. 25 (2016)

Endorsement

Review

Supplemented By

Referenced By

Number of citations to item: 59

  • Michaelanne Dye, Neha Kumar, Ari Schlesinger, Marisol Wong-Villacres, Morgan G. Ames, Rajesh Veeraraghavan, Jacki O'Neill, Joyojeet Pal, Mary L. Gray (2018): Solidarity Across Borders, In: Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/3272973.3273007
  • Airi Lampinen, Moira McGregor, Rob Comber, Barry Brown (2018): Member-Owned Alternatives, In: Proceedings of the ACM on Human-Computer Interaction CSCW(2), doi:10.1145/3274369
  • Mohammad Hossein Jarrahi, Will Sutherland (2019): Algorithmic Management and Algorithmic Competencies: Understanding and Appropriating Algorithms in Gig Work, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-15742-5_55
  • Valeria Borsotti, Pernille Bjørn (2022): Humor and Stereotypes in Computing: An Equity-focused Approach to Institutional Accountability, In: Computer Supported Cooperative Work (CSCW) 4(31), doi:10.1007/s10606-022-09440-9
  • Luigina Ciolfi, Myriam Lewkowicz, Kjeld Schmidt (2023): Computer-Supported Cooperative Work, In: Handbook of Human Computer Interaction, doi:10.1007/978-3-319-27648-9_30-1
  • Syed Ishtiaque Ahmed, Nicola J. Bidwell, Himanshu Zade, Srihari H. Muralidhar, Anupama Dhareshwar, Baneen Karachiwala, Cedrick N. Tandong, Jacki O'Neill (2016): Peer-to-peer in the Workplace, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858393
  • Manoj Kumar Kamila, Sahil Singh Jasrotia, Pooja Singh Kushwaha (2024): Understanding digital sweatshops: A qualitative investigation of workers’ perspectives, In: Asian Journal of Business Ethics 2(13), doi:10.1007/s13520-024-00210-y
  • Pietari Keskinen, Heike Winschiers‐Theophilus, Shilumbe Chivuno‐Kuria, Anna Müller, Marko Nieminen (2021): Digital microwork as a livelihood strategy in a Namibian informal settlement, In: THE ELECTRONIC JOURNAL OF INFORMATION SYSTEMS IN DEVELOPING COUNTRIES 1(88), doi:10.1002/isd2.12197
  • Kellie Dunn, Irina Shklovski, Pernille Bjørn (2024): What Research through Art can bring to CSCW: exploring ambiguous futures of work, In: i-com 1(23), doi:10.1515/icom-2023-0038
  • Ujwal Gadiraju, Mengdie Zhuang (2019): What You Sow, So Shall You Reap! Toward Preselection Mechanisms for Macrotask Crowdsourcing, In: Human–Computer Interaction Series, doi:10.1007/978-3-030-12334-5_6
  • Penny Williams, Paula McDonald, Robyn Mayes (2021): The Growing “Gig Economy”, In: Handbook Series in Occupational Health Sciences, doi:10.1007/978-3-030-24936-6_32-1
  • Xiao Ma, Lara Khansa, Sung S. Kim (2018): Active Community Participation and Crowdworking Turnover: A Longitudinal Model and Empirical Test of Three Mechanisms, In: Journal of Management Information Systems 4(35), doi:10.1080/07421222.2018.1523587
  • Clara Tuco, Cécile Boulard, Romane Calleau, Shreepriya Shreepriya (2021): Food Delivery Eco-System: When Platforms Get Enterprises and Gig-Workers to Implicitly Cooperate, In: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/3462204.3481757
  • Julie S. Hui, Matthew W. Easterday, Elizabeth M. Gerber (2018): Distributed Apprenticeship in Online Communities, In: Human–Computer Interaction 4(34), doi:10.1080/07370024.2018.1469409
  • Sara Kingsley, Michael Six Silberman, Clara Wang, Robert Lambeth, Jiayin Zhi, Motahhare Eslami, Beibei Li, Jeffrey Bigham (2024): ‘Your Duties Are To Sweep A Floor Remotely’: Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers’ Successful Use of Digital Platforms, In: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work, doi:10.1145/3663384.3663403
  • Onyi Nwafor, Xiao Ma, Jinghui (Jove) Hou, Norman Johnson (2022): Online communities and discontinuance of information technology-enabled on-demand workers: Impacts of informal social interactions through dual commitments, In: International Journal of Information Management, doi:10.1016/j.ijinfomgt.2022.102540
  • Shaimaa Lazem, Danilo Giglitto, Makuochi Samuel Nkwo, Hafeni Mthoko, Jessica Upani, Anicia Peters (2021): Challenges and Paradoxes in Decolonising HCI: A Critical Discussion, In: Computer Supported Cooperative Work (CSCW) 2(31), doi:10.1007/s10606-021-09398-0
  • Deepika Yadav, Kasper Karlgren, Riyaj Shaikh, Karey Helms, Donald Mcmillan, Barry Brown, Airi Lampinen (2024): Bodywork at Work: Attending to Bodily Needs in Gig, Shift, and Knowledge Work, In: Proceedings of the CHI Conference on Human Factors in Computing Systems, doi:10.1145/3613904.3642416
  • Xiao Ma, Jungwon Kuem, Jinghui (Jove) Hou, Lara Khansa, Zhuo Zhu (2020): Are All Contributions Equal? Investigating the Role of Community Participation in Crowdwork, In: Decision Sciences 6(52), doi:10.1111/deci.12471
  • Nelson Tenório, Pernille Bjørn (2019): Online Harassment in the Workplace: the Role of Technology in Labour Law Disputes, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09351-2
  • Dan Richardson, Bronwyn J. Cumbo, Tom Bartindale, Delvin Varghese, Manika Saha, Pratyasha Saha, Syed Ishtiaque Ahmed, Gillian C. Oliver, Patrick Olivier (2022): Critically Engaging with Embedded Values through Constrained Technology Design, In: Designing Interactive Systems Conference, doi:10.1145/3532106.3533570
  • Pietari Keskinen (2020): Worker Empowerment in the Era of Sharing Economy Platforms in Global South, In: Proceedings of the 16th Participatory Design Conference 2020 - Participation(s) Otherwise - Volume 2, doi:10.1145/3384772.3385147
  • Penny Williams, Paula McDonald, Robyn Mayes (2022): The Growing “Gig Economy”, In: Handbook Series in Occupational Health Sciences, doi:10.1007/978-3-030-29010-8_32
  • Yihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Michael Saker, Alan Chamberlain, Vassilis-Javed Khan, Hai-Ning Liang, Yong Yue (2023): Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This Matters, In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3544548.3581418
  • Katherine C. Kellogg, Melissa A. Valentine, Angéle Christin (2020): Algorithms at Work: The New Contested Terrain of Control, In: Academy of Management Annals 1(14), doi:10.5465/annals.2018.0174
  • Vishal Goel, Balakrishnan R. Unny, Samik Shome, Yuvika Gupta (2023): Digital labour: a systematic literature review and bibliometric analysis, In: International Journal of Organizational Analysis 5(32), doi:10.1108/ijoa-12-2022-3558
  • Rachel N. Simons, Danna Gurari, Kenneth R. Fleischmann (2020): "I Hope This Is Helpful", In: Proceedings of the ACM on Human-Computer Interaction CSCW2(4), doi:10.1145/3415176
  • Caitlin Lustig, Sean Rintel, Liane Scult, Siddharth Suri (2020): Stuck in the middle with you: The Transaction Costs of Corporate Employees Hiring Freelancers, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(4), doi:10.1145/3392842
  • Christine Gerber (2022): Gender and precarity in platform work: Old inequalities in the new world of work, In: New Technology, Work and Employment 2(37), doi:10.1111/ntwe.12233
  • Karin Hansson, Anna Näslund Dahlgren (2021): Crowdsourcing historical photographs: autonomy and control at the Copenhagen City Archives, In: Computer Supported Cooperative Work (CSCW) 1(31), doi:10.1007/s10606-021-09418-z
  • Liping Qiu, Yixue Duan, Yang Zhou, Feng Xu, Hanyu Zheng, Xin Cai, Zhibin Jiang (2024): Impact of digital empowerment on labor employment in manufacturing enterprises: Evidence from China, In: Heliyon 8(10), doi:10.1016/j.heliyon.2024.e29040
  • Juan Carlos Alvarez de la Vega, Marta E. Cecchinato, John Rooksby (2021): “Why lose control?” A Study of Freelancers’ Experiences with Gig Economy Platforms, In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3411764.3445305
  • Eliscia Kinder, Mohammad Hossein Jarrahi, Will Sutherland (2019): Gig Platforms, Tensions, Alliances and Ecosystems, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359314
  • David Martin, Sheelagh Carpendale, Neha Gupta, Tobias Hoßfeld, Babak Naderi, Judith Redi, Ernestasia Siahaan, Ina Wechsung (2017): Understanding the Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-66435-4_3
  • Srihari Hulikal Muralidhar, Sean Rintel, Siddharth Suri (2022): Collaboration, Invisible Work, and The Costs of Macrotask Freelancing, In: Proceedings of the ACM on Human-Computer Interaction CSCW2(6), doi:10.1145/3555175
  • Ujwal Gadiraju, Besnik Fetahu, Ricardo Kawase, Patrick Siehndel, Stefan Dietze (2017): Using Worker Self-Assessments for Competence-Based Pre-Selection in Crowdsourcing Microtasks, In: ACM Transactions on Computer-Human Interaction 4(24), doi:10.1145/3119930
  • Srihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2019): Rethinking Financial Inclusion: from Access to Autonomy, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09356-x
  • Ujwal Gadiraju, Alessandro Checco, Neha Gupta, Gianluca Demartini (2017): Modus Operandi of Crowd Workers, In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3(1), doi:10.1145/3130914
  • Haoyu Xie, Eddy Maddalena, Rehab Qarout, Alessandro Checco (2023): The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces, In: Computer Supported Cooperative Work (CSCW) 3(32), doi:10.1007/s10606-023-09464-9
  • Shreepriya Gonzalez-Jimenez, Cecile Boulard, Clara Tuco, Romane Calleau (2022): Designing Food Delivery Gig-platforms for Courier Needs: the Case of Batched Orders, In: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/3500868.3559452
  • Benjamin V. Hanrahan, Anita Chen, JiaHua Ma, Ning F. Ma, Anna Squicciarini, Saiph Savage (2021): The Expertise Involved in Deciding which HITs are Worth Doing on Amazon Mechanical Turk, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(5), doi:10.1145/3449202
  • Anoush Margaryan (2019): Workplace learning in crowdwork, In: Journal of Workplace Learning 4(31), doi:10.1108/jwl-10-2018-0126
  • Asmita Bhutani, Peter Sawchuk (2022): Global Implications for Work-based Learning in Platform Economies, In: Springer International Handbooks of Education, doi:10.1007/978-3-030-67930-9_17-1
  • Ellie Harmon, M. Six Silberman (2018): Rating Working Conditions on Digital Labor Platforms, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9313-5
  • Paul M. Di Gangi, Charn P. McAllister, Jack L. Howard, Jason Bennett Thatcher, Gerald R. Ferris (2022): Can you see opportunity knocking? An examination of technology-based political skill on opportunity recognition in online communities for MTurk workers, In: Internet Research 4(32), doi:10.1108/intr-03-2021-0175
  • Naja Holten Møller, Maren Gausdal Eriksen, Claus Bossen (2020): A Worker-Driven Common Information Space: Interventions into a Digital Future, In: Computer Supported Cooperative Work (CSCW) 5(29), doi:10.1007/s10606-020-09379-9
  • Paul Thomas, Gabriella Kazai, Ryen White, Nick Craswell (2022): The Crowd is Made of People, In: ACM SIGIR Conference on Human Information Interaction and Retrieval, doi:10.1145/3498366.3505815
  • Jo Bates, Elli Gerakopoulou, Alessandro Checco (2023): Addressing labour exploitation in the data science pipeline: views of precarious US-based crowdworkers on adversarial and co-operative interventions, In: Journal of Information, Communication and Ethics in Society 3(21), doi:10.1108/jices-08-2022-0069
  • Srihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2022): Between a Rock and a Hard Place: Negotiating Dependencies and Precarity in the On-Demand Economy, In: Computer Supported Cooperative Work (CSCW) 3(31), doi:10.1007/s10606-022-09434-7
  • Paula Rodríguez-Modroño, Annarosa Pesole, Purificación López-Igual (2022): Assessing gender inequality in digital labour platforms in Europe, In: Internet Policy Review 1(11), doi:10.14763/2022.1.1622
  • M. S. Silberman, B. Tomlinson, R. LaPlante, J. Ross, L. Irani, A. Zaldivar (2018): Responsible research with crowds, In: Communications of the ACM 3(61), doi:10.1145/3180492
  • Asmita Bhutani, Peter H. Sawchuk (2023): Global Implications for Work-based Learning in Platform Economies, In: Springer International Handbooks of Education, doi:10.1007/978-3-031-19592-1_17
  • Ning F. Ma, Chien Wen Yuan, Moojan Ghafurian, Benjamin V. Hanrahan (2018): Using Stakeholder Theory to Examine Drivers' Stake in Uber, In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3173574.3173657
  • Karin Hansson, Thomas Ludwig, Tanja Aitamurto (2018): Capitalizing Relationships: Modes of Participation in Crowdsourcing, In: Computer Supported Cooperative Work (CSCW) 5(28), doi:10.1007/s10606-018-9341-1
  • Uma Rani, Marianne Furrer (2020): Digital labour platforms and new forms of flexible work in developing countries: Algorithmic management of work and workers, In: Competition & Change 2(25), doi:10.1177/1024529420905187
  • Jorge Goncalves, Simo Hosio, Niels van Berkel, Simon Klakegg (2019): Addressing Cooperation Issues in Situated Crowdsourcing, In: Human–Computer Interaction Series, doi:10.1007/978-3-030-12334-5_4
  • Andrew Chong, Ji Su Yoo, Coye Cheshire (2024): Perceptions of Fairness in Technology-Mediated Marketplaces, In: Proceedings of the CHI Conference on Human Factors in Computing Systems, doi:10.1145/3613904.3642678
  • Paul M. Di Gangi, Jack L. Howard, Samuel H. Goh, Jason Bennett Thatcher (2023): Do you see what I see? A social capital perspective on microtask gig worker opportunity recognition within electronic networks of practice, In: International Journal of Information Management, doi:10.1016/j.ijinfomgt.2022.102615
  • Ning F. Ma, Benjamin V. Hanrahan (2020): Unpacking Sharing in the Peer-to-Peer Economy: The Impact of Shared Needs and Backgrounds on Ride-Sharing, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(4), doi:10.1145/3392865
Please note: Providing information about citations is only possible thanks to to the open metadata APIs provided by crossref.org and opencitations.net. These lists may be incomplete due to unavailable citation data.source: opencitations.net, crossref.org