Conference Paper

Turk-Life in India

Thumbnail Image

Fulltext URI

Document type

Text/Conference Paper

Additional Information

Date

2014

Authors

Journal Title

Journal ISSN

Volume Title

Source

Proceedings of the 2014 ACM International Conference on Supporting Group Work

Publisher

Association for Computing Machinery

Abstract

Previous studies on Amazon Mechanical Turk (AMT), the most well-known marketplace for microtasks, show that the largest population of workers on AMT is U.S. based, while the second largest is based in India. In this paper, we present insights from an ethnographic study conducted in India to introduce some of these workers or Turkers" -- who they are, how they work and what turking means to them. We examine the work they do to maintain their reputations and their work-life balance. In doing this, we illustrate how AMT's design practically impacts on turk-work. Understanding the "lived work" of crowdwork is a valuable first step for technology design."

Description

Gupta, Neha; Martin, David; Hanrahan, Benjamin V.; O'Neill, Jacki (2014): Turk-Life in India. Proceedings of the 2014 ACM International Conference on Supporting Group Work. DOI: 10.1145/2660398.2660403. Association for Computing Machinery. pp. 1–11. Sanibel Island, Florida, USA

Keywords

relationship-based crowdsourcing, amazon mechanical turk (amt), requesters, turkers, crowdworkers, ethnography, crowdsourcing

Citation

DOI

10.1145/2660398.2660403

URI

URI

https://dl.eusset.eu/handle/20.500.12015/4421

Collections

GROUP 2014

Endorsement

Review

Supplemented By

Referenced By

Number of citations to item: 62

  • Brian McInnis, Dan Cosley, Chaebong Nam, Gilly Leshed (2016): Taking a HIT, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858539
  • Yihong Wang, Konstantinos Papangelis, Michael Saker, Ioanna Lykourentzou, Alan Chamberlain, Vassilis-Javed Khan (2020): Crowdsourcing in China: Exploring the Work Experiences of Solo Crowdworkers and Crowdfarm Workers, In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3313831.3376473
  • (2016): Bibliography, In: Collaborative Annotation for Reliable Natural Language Processing, doi:10.1002/9781119306696.biblio
  • Denise J. Wilkins, Srihari Hulikal Muralidhar, Max Meijer, Laura Lascau, Siân Lindley (2022): Gigified Knowledge Work: Understanding Knowledge Gaps When Knowledge Work and On-Demand Work Intersect, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(6), doi:10.1145/3512940
  • Airi Lampinen, Moira McGregor, Rob Comber, Barry Brown (2018): Member-Owned Alternatives, In: Proceedings of the ACM on Human-Computer Interaction CSCW(2), doi:10.1145/3274369
  • Airi Lampinen, Barry Brown (2017): Market Design for HCI, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025515
  • Lynette Hirschman, Karën Fort, Stéphanie Boué, Nikos Kyrpides, Rezarta Islamaj Doğan, Kevin Bretonnel Cohen (2016): Crowdsourcing and curation: perspectives from biology and natural language processing, In: Database, doi:10.1093/database/baw115
  • Yihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Vassilis-Javed Khan, Michael Saker, Yong Yue, Jonathan Grudin (2022): The dawn of crowdfarms, In: Communications of the ACM 8(65), doi:10.1145/3490698
  • Esther Greenglass, Daniel Chiacchia, Lisa Fiskenbaum (2021): Investigating <scp>COVID</scp>‐19 stress and coping: Substance use and behavioural disengagement, In: International Journal of Psychology 3(57), doi:10.1002/ijop.12820
  • Syed Ishtiaque Ahmed, Nicola J. Bidwell, Himanshu Zade, Srihari H. Muralidhar, Anupama Dhareshwar, Baneen Karachiwala, Cedrick N. Tandong, Jacki O'Neill (2016): Peer-to-peer in the Workplace, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858393
  • Mashael Yousef Almoqbel, Donghee Yvette Wohn (2019): Individual and Collaborative Behaviors of Rideshare Drivers in Protecting their Safety, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359319
  • Xiao Ma, Lara Khansa, Sung S. Kim (2018): Active Community Participation and Crowdworking Turnover: A Longitudinal Model and Empirical Test of Three Mechanisms, In: Journal of Management Information Systems 4(35), doi:10.1080/07421222.2018.1523587
  • Laura Lascau, Sandy J. J. Gould, Anna L. Cox, Elizaveta Karmannaya, Duncan P. Brumby (2019): Monotasking or Multitasking, In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3290605.3300649
  • Kotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, Jeffrey P. Bigham (2018): A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk, In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3173574.3174023
  • Michael A. Hedderich, Antti Oulasvirta (2024): Explaining crowdworker behaviour through computational rationality, In: Behaviour &amp; Information Technology 3(44), doi:10.1080/0144929x.2024.2329616
  • M. Six Silberman (2016): Reading Elinor Ostrom In Silicon Valley, In: Proceedings of the 19th International Conference on Supporting Group Work, doi:10.1145/2957276.2957311
  • Alex J. Wood, Vili Lehdonvirta, Mark Graham (2018): Workers of the Internet unite? Online freelancer organisation among remote gig economy workers in six Asian and African countries, In: New Technology, Work and Employment 2(33), doi:10.1111/ntwe.12112
  • Benjamin V. Hanrahan, David Martin, Jutta Willamowski, John M. Carroll (2018): Investigating the Amazon Mechanical Turk Market Through Tool Design, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9312-6
  • Stephen Uzor, Jason T. Jacques, John J Dudley, Per Ola Kristensson (2021): Investigating the Accessibility of Crowdwork Tasks on Mechanical Turk, In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3411764.3445291
  • Sara Kingsley, Michael Six Silberman, Clara Wang, Robert Lambeth, Jiayin Zhi, Motahhare Eslami, Beibei Li, Jeffrey Bigham (2024): ‘Your Duties Are To Sweep A Floor Remotely’: Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers’ Successful Use of Digital Platforms, In: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work, doi:10.1145/3663384.3663403
  • Ann Light, Jo Briggs (2017): Crowdfunding Platforms and the Design of Paying Publics, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025979
  • Mary L. Gray, Siddharth Suri, Syed Shoaib Ali, Deepti Kulkarni (2016): The Crowd is a Collaborative Network, In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work &amp; Social Computing, doi:10.1145/2818048.2819942
  • R. Borgo, L. Micallef, B. Bach, F. McGee, B. Lee (2018): Information Visualization Evaluation Using Crowdsourcing, In: Computer Graphics Forum 3(37), doi:10.1111/cgf.13444
  • Garrett Allen, Andrea Hu, Ujwal Gadiraju (2023): What You Show is What You Get! Gestures for Microtask Crowdsourcing, In: 28th International Conference on Intelligent User Interfaces, doi:10.1145/3581754.3584175
  • Rachel N. Simons, Danna Gurari, Kenneth R. Fleischmann (2020): "I Hope This Is Helpful", In: Proceedings of the ACM on Human-Computer Interaction CSCW2(4), doi:10.1145/3415176
  • Caitlin Lustig, Sean Rintel, Liane Scult, Siddharth Suri (2020): Stuck in the middle with you: The Transaction Costs of Corporate Employees Hiring Freelancers, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(4), doi:10.1145/3392842
  • Alex Wood, Vili Lehdonvirta (2019): Platform Labour and Structured Antagonism: Understanding the Origins of Protest in the Gig Economy, In: SSRN Electronic Journal, doi:10.2139/ssrn.3357804
  • Eliscia Kinder, Mohammad Hossein Jarrahi, Will Sutherland (2019): Gig Platforms, Tensions, Alliances and Ecosystems, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359314
  • David Martin, Sheelagh Carpendale, Neha Gupta, Tobias Hoßfeld, Babak Naderi, Judith Redi, Ernestasia Siahaan, Ina Wechsung (2017): Understanding the Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-66435-4_3
  • Lilly Irani (2017): Amazon Mechanical Turk, In: The Blackwell Encyclopedia of Sociology, doi:10.1002/9781405165518.wbeos0994
  • Ding Wang, Shantanu Prabhat, Nithya Sambasivan (2022): Whose AI Dream? In search of the aspiration in data annotation., In: CHI Conference on Human Factors in Computing Systems, doi:10.1145/3491102.3502121
  • Babak A. Farshchian, Hanne Ekran Thomassen (2019): Co-Creating Platform Governance Models Using Boundary Resources: a Case Study from Dementia Care Services, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09353-0
  • Srihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2019): Rethinking Financial Inclusion: from Access to Autonomy, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09356-x
  • Ujwal Gadiraju, Alessandro Checco, Neha Gupta, Gianluca Demartini (2017): Modus Operandi of Crowd Workers, In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3(1), doi:10.1145/3130914
  • Haoyu Xie, Eddy Maddalena, Rehab Qarout, Alessandro Checco (2023): The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces, In: Computer Supported Cooperative Work (CSCW) 3(32), doi:10.1007/s10606-023-09464-9
  • Carlos Toxtli, Christopher Curtis, Saiph Savage (2024): A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles, In: Proceedings of the ACM on Human-Computer Interaction CSCW2(8), doi:10.1145/3686899
  • Ujwal Gadiraju, Stefan Dietze (2017): Improving learning through achievement priming in crowdsourced information finding microtasks, In: Proceedings of the Seventh International Learning Analytics &amp; Knowledge Conference, doi:10.1145/3027385.3027402
  • Karin Hansson, Michael Muller, Tanja Aitamurto, Lilly Irani, Athanasios Mazarakis, Neha Gupta, Thomas Ludwig (2016): Crowd Dynamics, In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, doi:10.1145/2851581.2856505
  • Benjamin V. Hanrahan, Anita Chen, JiaHua Ma, Ning F. Ma, Anna Squicciarini, Saiph Savage (2021): The Expertise Involved in Deciding which HITs are Worth Doing on Amazon Mechanical Turk, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(5), doi:10.1145/3449202
  • Aditya Vashistha, Fabian Okeke, Richard Anderson, Nicola Dell (2018): 'You Can Always Do Better!", In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3173574.3174126
  • Mark E. Whiting, Dilrukshi Gamage, Snehalkumar (Neil) S. Gaikwad, Aaron Gilbee, Shirish Goyal, Alipta Ballav, Dinesh Majeti, Nalin Chhibber, Angela Richmond-Fuller, Freddie Vargus, Tejas Seshadri Sarma, Varshine Chandrakanthan, Teogenes Moura, Mohamed Hashim Salih, Gabriel Bayomi Tinoco Kalejaiye, Adam Ginzberg, Catherine A. Mullings, Yoni Dayan, Kristy Milland, Henrique Orefice, Jeff Regino, Sayna Parsi, Kunz Mainali, Vibhor Sehgal, Sekandar Matin, Akshansh Sinha, Rajan Vaish, Michael S. Bernstein (2017): Crowd Guilds, In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/2998181.2998234
  • Jesse Chandler, Danielle Shapiro (2016): Conducting Clinical Research Using Crowdsourced Convenience Samples, In: Annual Review of Clinical Psychology 1(12), doi:10.1146/annurev-clinpsy-021815-093623
  • Ali Alkhatib, Michael S. Bernstein, Margaret Levi (2017): Examining Crowd Work and Gig Work Through The Historical Lens of Piecework, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025974
  • Huichuan Xia (2023): Undue Influence or Exploitation — A Qualitative Inquiry into an Ethical Dilemma Around Payment in Crowd Work-Based Research in the U.S., In: Computer Supported Cooperative Work (CSCW) 3(33), doi:10.1007/s10606-023-09472-9
  • Ellie Harmon, M. Six Silberman (2018): Rating Working Conditions on Digital Labor Platforms, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9313-5
  • Kimberly A. Barchard, Kelly E. Grob, Matthew J. Roe (2016): Is sadness blue? The problem of using figurative language for emotions on psychological tests, In: Behavior Research Methods 2(49), doi:10.3758/s13428-016-0713-5
  • Kinda El Maarry, Kristy Milland, Wolf-Tilo Balke (2018): A Fair Share of the Work?, In: Proceedings of the 10th ACM Conference on Web Science, doi:10.1145/3201064.3201074
  • Wei Tang, Ming Yin, Chien-Ju Ho (2019): Leveraging Peer Communication to Enhance Crowdsourcing, In: The World Wide Web Conference, doi:10.1145/3308558.3313554
  • Srihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2022): Between a Rock and a Hard Place: Negotiating Dependencies and Precarity in the On-Demand Economy, In: Computer Supported Cooperative Work (CSCW) 3(31), doi:10.1007/s10606-022-09434-7
  • Ming Yin, Mary L. Gray, Siddharth Suri, Jennifer Wortman Vaughan (2016): The Communication Network Within the Crowd, In: Proceedings of the 25th International Conference on World Wide Web, doi:10.1145/2872427.2883036
  • Karin Hansson, Michael Muller, Tanja Aitamurto, Ann Light, Athanasios Mazarakis, Neha Gupta, Thomas Ludwig (2016): Toward a Typology of Participation in Crowdwork, In: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, doi:10.1145/2818052.2855510
  • Yihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Hai-Ning Liang, Irwyn Sadien, Evangelia Demerouti, Vassilis-Javed Khan (2020): In Their Shoes, In: Proceedings of the ACM on Human-Computer Interaction GROUP(4), doi:10.1145/3375187
  • Yihong Wang, Konstantinos Papangelis, Michel Saker, Ioanna Lykourentzou, Vassilis-Javed Khan, Alan Chamberlain, Jonathan Grudin (2021): An Examination of the Work Practices of Crowdfarms, In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3411764.3445603
  • Jacki O’Neill, Anupama Dhareshwar, Srihari H. Muralidhar (2017): Working Digital Money into a Cash Economy: The Collaborative Work of Loan Payment, In: Computer Supported Cooperative Work (CSCW) 4-6(26), doi:10.1007/s10606-017-9289-6
  • Chenhang Zhou, Yu Chen, Roger Wattenhofer, Ye Wang (2023): Print Your Money: Cash-Like Experiences with Digital Money, In: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3544549.3585772
  • Lisa Posch, Arnim Bleier, Clemens M. Lechner, Daniel Danner, Fabian Flöck, Markus Strohmaier (2019): Measuring Motivations of Crowdworkers, In: ACM Transactions on Social Computing 2(2), doi:10.1145/3335081
  • Karin Hansson, Thomas Ludwig (2018): Crowd Dynamics: Conflicts, Contradictions, and Community in Crowdsourcing, In: Computer Supported Cooperative Work (CSCW) 5(28), doi:10.1007/s10606-018-9343-z
  • Paul M. Di Gangi, Jack L. Howard, Samuel H. Goh, Jason Bennett Thatcher (2023): Do you see what I see? A social capital perspective on microtask gig worker opportunity recognition within electronic networks of practice, In: International Journal of Information Management, doi:10.1016/j.ijinfomgt.2022.102615
  • Ryo Suzuki, Niloufar Salehi, Michelle S. Lam, Juan C. Marroquin, Michael S. Bernstein (2016): Atelier, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858121
  • Vili Lehdonvirta (2018): Flexibility in the gig economy: managing time on three online piecework platforms, In: New Technology, Work and Employment 1(33), doi:10.1111/ntwe.12102
  • Moira McGregor, Nicola J. Bidwell, Vidya Sarangapani, Jonathan Appavoo, Jacki O'Neill (2019): Talking about Chat at Work in the Global South, In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3290605.3300463
  • Alex J Wood, Vili Lehdonvirta (2021): Antagonism beyond employment: how the ‘subordinated agency’ of labour platforms generates conflict in the remote gig economy, In: Socio-Economic Review 4(19), doi:10.1093/ser/mwab016
Please note: Providing information about citations is only possible thanks to to the open metadata APIs provided by crossref.org and opencitations.net. These lists may be incomplete due to unavailable citation data.source: opencitations.net, crossref.org