Turking in a Global Labour Market

dc.contributor.authorMartin, David
dc.contributor.authorO’Neill, Jacki
dc.contributor.authorGupta, Neha
dc.contributor.authorHanrahan, Benjamin V.
dc.date.accessioned2020-06-06T13:06:30Z
dc.date.available2020-06-06T13:06:30Z
dc.date.issued2016
dc.date.issued2016
dc.description.abstractThis paper examines how working in the global labour market of Amazon Mechanical Turk (AMT) impacts upon and is understood by two different groups of workers. To do this we report on two qualitative studies; one of US and another of Indian crowdworkers (or ‘Turkers’) that we analysed from an ethnomethodological orientation. Our data is naturalistic and comes from a variety of sources—interviews, observations and forum posts—where Turkers describe their work, and their understandings of that work and of the transnational market they work in. We compare and contrast their situations, their reflections on the marketplace and its global reach, and we take a look at their understandings of one another. Our focus is on ‘the work to making turking work’ (Martin et al. 2014 ). That is, the work that turkers do to organise and make sense of their work as they operate in the AMT marketplace, such that they can do so effectively. AMT is a technologically mediated marketplace—that is the distribution, completion and payment of work is done online, almost completely through the AMT platform. The design of the platform has important consequences for how Turkers experience and understand the market (including its global or transnational nature). We discuss how our findings relate to a variety of CSCW issues and provide an initial examination of how they relate to globalisation both as a mundanely experienced phenomenon and as a topic of academic interest. We finish the article by drawing on our own experiences in research and design to look at how technology can be used to intervene in a market like this to try to address imbalances in power and agency between employers and workers.de
dc.identifier.doi10.1007/s10606-015-9241-6
dc.identifier.pissn1573-7551
dc.identifier.urihttp://dx.doi.org/10.1007/s10606-015-9241-6
dc.identifier.urihttps://dl.eusset.eu/handle/20.500.12015/3834
dc.publisherSpringer
dc.relation.ispartofComputer Supported Cooperative Work (CSCW): Vol. 25, No. 1
dc.relation.ispartofseriesComputer Supported Cooperative Work (CSCW)
dc.subjectactivism
dc.subjectamazon mechanical turk (AMT)
dc.subjectcrowdsourcing
dc.subjectethnography
dc.subjectethnomethodology
dc.subjectglobalisation
dc.subjecttransnational markets
dc.subjectturkers
dc.titleTurking in a Global Labour Marketde
dc.typeText/Journal Article
gi.citation.endPage77
gi.citation.startPage39
gi.citations.count62
gi.citations.elementPenny Williams, Paula McDonald, Robyn Mayes (2021): The Growing “Gig Economy”, In: Handbook Series in Occupational Health Sciences, doi:10.1007/978-3-030-24936-6_32-1
gi.citations.elementJorge Goncalves, Simo Hosio, Niels van Berkel, Simon Klakegg (2019): Addressing Cooperation Issues in Situated Crowdsourcing, In: Human–Computer Interaction Series, doi:10.1007/978-3-030-12334-5_4
gi.citations.elementDavid Martin, Sheelagh Carpendale, Neha Gupta, Tobias Hoßfeld, Babak Naderi, Judith Redi, Ernestasia Siahaan, Ina Wechsung (2017): Understanding the Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-66435-4_3
gi.citations.elementChien Wen (Tina) Yuan, Ai-Ju Huang (2025): Viva les fans! Exploring social sourcing for research tasks on social networking sites, In: Behaviour & Information Technology, doi:10.1080/0144929x.2025.2471908
gi.citations.elementPaul M. Di Gangi, Jack L. Howard, Samuel H. Goh, Jason Bennett Thatcher (2023): Do you see what I see? A social capital perspective on microtask gig worker opportunity recognition within electronic networks of practice, In: International Journal of Information Management, doi:10.1016/j.ijinfomgt.2022.102615
gi.citations.elementXiao Ma, Jungwon Kuem, Jinghui (Jove) Hou, Lara Khansa, Zhuo Zhu (2020): Are All Contributions Equal? Investigating the Role of Community Participation in Crowdwork, In: Decision Sciences 6(52), doi:10.1111/deci.12471
gi.citations.elementSyed Ishtiaque Ahmed, Nicola J. Bidwell, Himanshu Zade, Srihari H. Muralidhar, Anupama Dhareshwar, Baneen Karachiwala, Cedrick N. Tandong, Jacki O'Neill (2016): Peer-to-peer in the Workplace, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858393
gi.citations.elementKarin Hansson, Anna Näslund Dahlgren (2021): Crowdsourcing historical photographs: autonomy and control at the Copenhagen City Archives, In: Computer Supported Cooperative Work (CSCW) 1(31), doi:10.1007/s10606-021-09418-z
gi.citations.elementOnyi Nwafor, Xiao Ma, Jinghui (Jove) Hou, Norman Johnson (2022): Online communities and discontinuance of information technology-enabled on-demand workers: Impacts of informal social interactions through dual commitments, In: International Journal of Information Management, doi:10.1016/j.ijinfomgt.2022.102540
gi.citations.elementPaula Rodríguez-Modroño, Annarosa Pesole, Purificación López-Igual (2022): Assessing gender inequality in digital labour platforms in Europe, In: Internet Policy Review 1(11), doi:10.14763/2022.1.1622
gi.citations.elementPietari Keskinen, Heike Winschiers‐Theophilus, Shilumbe Chivuno‐Kuria, Anna Müller, Marko Nieminen (2021): Digital microwork as a livelihood strategy in a Namibian informal settlement, In: THE ELECTRONIC JOURNAL OF INFORMATION SYSTEMS IN DEVELOPING COUNTRIES 1(88), doi:10.1002/isd2.12197
gi.citations.elementNaja Holten Møller, Maren Gausdal Eriksen, Claus Bossen (2020): A Worker-Driven Common Information Space: Interventions into a Digital Future, In: Computer Supported Cooperative Work (CSCW) 5(29), doi:10.1007/s10606-020-09379-9
gi.citations.elementNing F. Ma, Chien Wen Yuan, Moojan Ghafurian, Benjamin V. Hanrahan (2018): Using Stakeholder Theory to Examine Drivers' Stake in Uber, In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3173574.3173657
gi.citations.elementXiao Ma, Lara Khansa, Sung S. Kim (2018): Active Community Participation and Crowdworking Turnover: A Longitudinal Model and Empirical Test of Three Mechanisms, In: Journal of Management Information Systems 4(35), doi:10.1080/07421222.2018.1523587
gi.citations.elementDeepika Yadav, Kasper Karlgren, Riyaj Shaikh, Karey Helms, Donald Mcmillan, Barry Brown, Airi Lampinen (2024): Bodywork at Work: Attending to Bodily Needs in Gig, Shift, and Knowledge Work, In: Proceedings of the CHI Conference on Human Factors in Computing Systems, doi:10.1145/3613904.3642416
gi.citations.elementKatherine C. Kellogg, Melissa A. Valentine, Angéle Christin (2020): Algorithms at Work: The New Contested Terrain of Control, In: Academy of Management Annals 1(14), doi:10.5465/annals.2018.0174
gi.citations.elementMohammad Hossein Jarrahi, Will Sutherland (2019): Algorithmic Management and Algorithmic Competencies: Understanding and Appropriating Algorithms in Gig Work, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-15742-5_55
gi.citations.elementRachel N. Simons, Danna Gurari, Kenneth R. Fleischmann (2020): "I Hope This Is Helpful", In: Proceedings of the ACM on Human-Computer Interaction CSCW2(4), doi:10.1145/3415176
gi.citations.elementM. S. Silberman, B. Tomlinson, R. LaPlante, J. Ross, L. Irani, A. Zaldivar (2018): Responsible research with crowds, In: Communications of the ACM 3(61), doi:10.1145/3180492
gi.citations.elementPietari Keskinen (2020): Worker Empowerment in the Era of Sharing Economy Platforms in Global South, In: Proceedings of the 16th Participatory Design Conference 2020 - Participation(s) Otherwise - Volume 2, doi:10.1145/3384772.3385147
gi.citations.elementAnoush Margaryan (2019): Workplace learning in crowdwork, In: Journal of Workplace Learning 4(31), doi:10.1108/jwl-10-2018-0126
gi.citations.elementAiri Lampinen, Moira McGregor, Rob Comber, Barry Brown (2018): Member-Owned Alternatives, In: Proceedings of the ACM on Human-Computer Interaction CSCW(2), doi:10.1145/3274369
gi.citations.elementAsmita Bhutani, Peter Sawchuk (2022): Global Implications for Work-based Learning in Platform Economies, In: Springer International Handbooks of Education, doi:10.1007/978-3-030-67930-9_17-1
gi.citations.elementSiwan Noh, Kyung-Hyune Rhee (2024): Transparent and Accountable Training Data Sharing in Decentralized Machine Learning Systems, In: Computers, Materials & Continua 3(79), doi:10.32604/cmc.2024.050949
gi.citations.elementClara Tuco, Cécile Boulard, Romane Calleau, Shreepriya Shreepriya (2021): Food Delivery Eco-System: When Platforms Get Enterprises and Gig-Workers to Implicitly Cooperate, In: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/3462204.3481757
gi.citations.elementNing F. Ma, Benjamin V. Hanrahan (2020): Unpacking Sharing in the Peer-to-Peer Economy: The Impact of Shared Needs and Backgrounds on Ride-Sharing, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(4), doi:10.1145/3392865
gi.citations.elementUjwal Gadiraju, Besnik Fetahu, Ricardo Kawase, Patrick Siehndel, Stefan Dietze (2017): Using Worker Self-Assessments for Competence-Based Pre-Selection in Crowdsourcing Microtasks, In: ACM Transactions on Computer-Human Interaction 4(24), doi:10.1145/3119930
gi.citations.elementJo Bates, Elli Gerakopoulou, Alessandro Checco (2023): Addressing labour exploitation in the data science pipeline: views of precarious US-based crowdworkers on adversarial and co-operative interventions, In: Journal of Information, Communication and Ethics in Society 3(21), doi:10.1108/jices-08-2022-0069
gi.citations.elementChristine Gerber (2022): Gender and precarity in platform work: Old inequalities in the new world of work, In: New Technology, Work and Employment 2(37), doi:10.1111/ntwe.12233
gi.citations.elementJulie S. Hui, Matthew W. Easterday, Elizabeth M. Gerber (2018): Distributed Apprenticeship in Online Communities, In: Human–Computer Interaction 4(34), doi:10.1080/07370024.2018.1469409
gi.citations.elementLiping Qiu, Yixue Duan, Yang Zhou, Feng Xu, Hanyu Zheng, Xin Cai, Zhibin Jiang (2024): Impact of digital empowerment on labor employment in manufacturing enterprises: Evidence from China, In: Heliyon 8(10), doi:10.1016/j.heliyon.2024.e29040
gi.citations.elementUjwal Gadiraju, Mengdie Zhuang (2019): What You Sow, So Shall You Reap! Toward Preselection Mechanisms for Macrotask Crowdsourcing, In: Human–Computer Interaction Series, doi:10.1007/978-3-030-12334-5_6
gi.citations.elementNelson Tenório, Pernille Bjørn (2019): Online Harassment in the Workplace: the Role of Technology in Labour Law Disputes, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09351-2
gi.citations.elementKellie Dunn, Irina Shklovski, Pernille Bjørn (2024): What Research through Art can bring to CSCW: exploring ambiguous futures of work, In: i-com 1(23), doi:10.1515/icom-2023-0038
gi.citations.elementPenny Williams, Paula McDonald, Robyn Mayes (2022): The Growing “Gig Economy”, In: Handbook Series in Occupational Health Sciences, doi:10.1007/978-3-030-29010-8_32
gi.citations.elementAsmita Bhutani, Peter H. Sawchuk (2023): Global Implications for Work-based Learning in Platform Economies, In: Springer International Handbooks of Education, doi:10.1007/978-3-031-19592-1_17
gi.citations.elementMichaelanne Dye, Neha Kumar, Ari Schlesinger, Marisol Wong-Villacres, Morgan G. Ames, Rajesh Veeraraghavan, Jacki O'Neill, Joyojeet Pal, Mary L. Gray (2018): Solidarity Across Borders, In: Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/3272973.3273007
gi.citations.elementYihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Michael Saker, Alan Chamberlain, Vassilis-Javed Khan, Hai-Ning Liang, Yong Yue (2023): Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This Matters, In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3544548.3581418
gi.citations.elementShaimaa Lazem, Danilo Giglitto, Makuochi Samuel Nkwo, Hafeni Mthoko, Jessica Upani, Anicia Peters (2021): Challenges and Paradoxes in Decolonising HCI: A Critical Discussion, In: Computer Supported Cooperative Work (CSCW) 2(31), doi:10.1007/s10606-021-09398-0
gi.citations.elementJuan Carlos Alvarez de la Vega, Marta E. Cecchinato, John Rooksby (2021): “Why lose control?” A Study of Freelancers’ Experiences with Gig Economy Platforms, In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3411764.3445305
gi.citations.elementUma Rani, Marianne Furrer (2020): Digital labour platforms and new forms of flexible work in developing countries: Algorithmic management of work and workers, In: Competition & Change 2(25), doi:10.1177/1024529420905187
gi.citations.elementManoj Kumar Kamila, Sahil Singh Jasrotia, Pooja Singh Kushwaha (2024): Understanding digital sweatshops: A qualitative investigation of workers’ perspectives, In: Asian Journal of Business Ethics 2(13), doi:10.1007/s13520-024-00210-y
gi.citations.elementSrihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2019): Rethinking Financial Inclusion: from Access to Autonomy, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09356-x
gi.citations.elementPaul M. Di Gangi, Charn P. McAllister, Jack L. Howard, Jason Bennett Thatcher, Gerald R. Ferris (2022): Can you see opportunity knocking? An examination of technology-based political skill on opportunity recognition in online communities for MTurk workers, In: Internet Research 4(32), doi:10.1108/intr-03-2021-0175
gi.citations.elementValeria Borsotti, Pernille Bjørn (2022): Humor and Stereotypes in Computing: An Equity-focused Approach to Institutional Accountability, In: Computer Supported Cooperative Work (CSCW) 4(31), doi:10.1007/s10606-022-09440-9
gi.citations.elementDan Richardson, Bronwyn J. Cumbo, Tom Bartindale, Delvin Varghese, Manika Saha, Pratyasha Saha, Syed Ishtiaque Ahmed, Gillian C. Oliver, Patrick Olivier (2022): Critically Engaging with Embedded Values through Constrained Technology Design, In: Designing Interactive Systems Conference, doi:10.1145/3532106.3533570
gi.citations.elementKarin Hansson, Thomas Ludwig, Tanja Aitamurto (2018): Capitalizing Relationships: Modes of Participation in Crowdsourcing, In: Computer Supported Cooperative Work (CSCW) 5(28), doi:10.1007/s10606-018-9341-1
gi.citations.elementAbdul Shaban (2024): New Digital Economic Geography, In: Digital Geographies—Urbanisation, Economy, and Modelling, doi:10.1007/978-981-97-9278-8_6
gi.citations.elementShreepriya Gonzalez-Jimenez, Cecile Boulard, Clara Tuco, Romane Calleau (2022): Designing Food Delivery Gig-platforms for Courier Needs: the Case of Batched Orders, In: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/3500868.3559452
gi.citations.elementSrihari Hulikal Muralidhar, Sean Rintel, Siddharth Suri (2022): Collaboration, Invisible Work, and The Costs of Macrotask Freelancing, In: Proceedings of the ACM on Human-Computer Interaction CSCW2(6), doi:10.1145/3555175
gi.citations.elementBenjamin V. Hanrahan, Anita Chen, JiaHua Ma, Ning F. Ma, Anna Squicciarini, Saiph Savage (2021): The Expertise Involved in Deciding which HITs are Worth Doing on Amazon Mechanical Turk, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(5), doi:10.1145/3449202
gi.citations.elementEliscia Kinder, Mohammad Hossein Jarrahi, Will Sutherland (2019): Gig Platforms, Tensions, Alliances and Ecosystems, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359314
gi.citations.elementCaitlin Lustig, Sean Rintel, Liane Scult, Siddharth Suri (2020): Stuck in the middle with you: The Transaction Costs of Corporate Employees Hiring Freelancers, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(4), doi:10.1145/3392842
gi.citations.elementUjwal Gadiraju, Alessandro Checco, Neha Gupta, Gianluca Demartini (2017): Modus Operandi of Crowd Workers, In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3(1), doi:10.1145/3130914
gi.citations.elementEllie Harmon, M. Six Silberman (2018): Rating Working Conditions on Digital Labor Platforms, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9313-5
gi.citations.elementSara Kingsley, Michael Six Silberman, Clara Wang, Robert Lambeth, Jiayin Zhi, Motahhare Eslami, Beibei Li, Jeffrey Bigham (2024): ‘Your Duties Are To Sweep A Floor Remotely’: Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers’ Successful Use of Digital Platforms, In: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work, doi:10.1145/3663384.3663403
gi.citations.elementSrihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2022): Between a Rock and a Hard Place: Negotiating Dependencies and Precarity in the On-Demand Economy, In: Computer Supported Cooperative Work (CSCW) 3(31), doi:10.1007/s10606-022-09434-7
gi.citations.elementPaul Thomas, Gabriella Kazai, Ryen White, Nick Craswell (2022): The Crowd is Made of People, In: ACM SIGIR Conference on Human Information Interaction and Retrieval, doi:10.1145/3498366.3505815
gi.citations.elementVishal Goel, Balakrishnan R. Unny, Samik Shome, Yuvika Gupta (2023): Digital labour: a systematic literature review and bibliometric analysis, In: International Journal of Organizational Analysis 5(32), doi:10.1108/ijoa-12-2022-3558
gi.citations.elementLuigina Ciolfi, Myriam Lewkowicz, Kjeld Schmidt (2023): Computer-Supported Cooperative Work, In: Handbook of Human Computer Interaction, doi:10.1007/978-3-319-27648-9_30-1
gi.citations.elementHaoyu Xie, Eddy Maddalena, Rehab Qarout, Alessandro Checco (2023): The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces, In: Computer Supported Cooperative Work (CSCW) 3(32), doi:10.1007/s10606-023-09464-9
gi.citations.elementAndrew Chong, Ji Su Yoo, Coye Cheshire (2024): Perceptions of Fairness in Technology-Mediated Marketplaces, In: Proceedings of the CHI Conference on Human Factors in Computing Systems, doi:10.1145/3613904.3642678

Files