Turk-Life in India

dc.contributor.authorGupta, Neha
dc.contributor.authorMartin, David
dc.contributor.authorHanrahan, Benjamin V.
dc.contributor.authorO'Neill, Jacki
dc.date.accessioned2023-03-17T22:48:21Z
dc.date.available2023-03-17T22:48:21Z
dc.date.issued2014
dc.description.abstractPrevious studies on Amazon Mechanical Turk (AMT), the most well-known marketplace for microtasks, show that the largest population of workers on AMT is U.S. based, while the second largest is based in India. In this paper, we present insights from an ethnographic study conducted in India to introduce some of these workers or Turkers" -- who they are, how they work and what turking means to them. We examine the work they do to maintain their reputations and their work-life balance. In doing this, we illustrate how AMT's design practically impacts on turk-work. Understanding the "lived work" of crowdwork is a valuable first step for technology design."en
dc.identifier.doi10.1145/2660398.2660403
dc.identifier.urihttps://dl.eusset.eu/handle/20.500.12015/4421
dc.language.isoen
dc.publisherAssociation for Computing Machinery
dc.relation.ispartofProceedings of the 2014 ACM International Conference on Supporting Group Work
dc.subjectrelationship-based crowdsourcing
dc.subjectamazon mechanical turk (amt)
dc.subjectrequesters
dc.subjectturkers
dc.subjectcrowdworkers
dc.subjectethnography
dc.subjectcrowdsourcing
dc.titleTurk-Life in Indiaen
dc.typeText/Conference Paper
gi.citation.startPage1–11
gi.citations.count62
gi.citations.elementUjwal Gadiraju, Stefan Dietze (2017): Improving learning through achievement priming in crowdsourced information finding microtasks, In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, doi:10.1145/3027385.3027402
gi.citations.elementHaoyu Xie, Eddy Maddalena, Rehab Qarout, Alessandro Checco (2023): The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces, In: Computer Supported Cooperative Work (CSCW) 3(32), doi:10.1007/s10606-023-09464-9
gi.citations.elementAlex J. Wood, Vili Lehdonvirta, Mark Graham (2018): Workers of the Internet unite? Online freelancer organisation among remote gig economy workers in six Asian and African countries, In: New Technology, Work and Employment 2(33), doi:10.1111/ntwe.12112
gi.citations.elementSara Kingsley, Michael Six Silberman, Clara Wang, Robert Lambeth, Jiayin Zhi, Motahhare Eslami, Beibei Li, Jeffrey Bigham (2024): ‘Your Duties Are To Sweep A Floor Remotely’: Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers’ Successful Use of Digital Platforms, In: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work, doi:10.1145/3663384.3663403
gi.citations.elementR. Borgo, L. Micallef, B. Bach, F. McGee, B. Lee (2018): Information Visualization Evaluation Using Crowdsourcing, In: Computer Graphics Forum 3(37), doi:10.1111/cgf.13444
gi.citations.elementAditya Vashistha, Fabian Okeke, Richard Anderson, Nicola Dell (2018): 'You Can Always Do Better!", In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3173574.3174126
gi.citations.elementDavid Martin, Sheelagh Carpendale, Neha Gupta, Tobias Hoßfeld, Babak Naderi, Judith Redi, Ernestasia Siahaan, Ina Wechsung (2017): Understanding the Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-66435-4_3
gi.citations.elementKimberly A. Barchard, Kelly E. Grob, Matthew J. Roe (2016): Is sadness blue? The problem of using figurative language for emotions on psychological tests, In: Behavior Research Methods 2(49), doi:10.3758/s13428-016-0713-5
gi.citations.elementRachel N. Simons, Danna Gurari, Kenneth R. Fleischmann (2020): "I Hope This Is Helpful", In: Proceedings of the ACM on Human-Computer Interaction CSCW2(4), doi:10.1145/3415176
gi.citations.elementEllie Harmon, M. Six Silberman (2018): Rating Working Conditions on Digital Labor Platforms, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9313-5
gi.citations.elementJesse Chandler, Danielle Shapiro (2016): Conducting Clinical Research Using Crowdsourced Convenience Samples, In: Annual Review of Clinical Psychology 1(12), doi:10.1146/annurev-clinpsy-021815-093623
gi.citations.elementKarin Hansson, Thomas Ludwig (2018): Crowd Dynamics: Conflicts, Contradictions, and Community in Crowdsourcing, In: Computer Supported Cooperative Work (CSCW) 5(28), doi:10.1007/s10606-018-9343-z
gi.citations.elementBabak A. Farshchian, Hanne Ekran Thomassen (2019): Co-Creating Platform Governance Models Using Boundary Resources: a Case Study from Dementia Care Services, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09353-0
gi.citations.elementDing Wang, Shantanu Prabhat, Nithya Sambasivan (2022): Whose AI Dream? In search of the aspiration in data annotation., In: CHI Conference on Human Factors in Computing Systems, doi:10.1145/3491102.3502121
gi.citations.elementKotaro Hara, Abigail Adams, Kristy Milland, Saiph Savage, Chris Callison-Burch, Jeffrey P. Bigham (2018): A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk, In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3173574.3174023
gi.citations.elementGarrett Allen, Andrea Hu, Ujwal Gadiraju (2023): What You Show is What You Get! Gestures for Microtask Crowdsourcing, In: 28th International Conference on Intelligent User Interfaces, doi:10.1145/3581754.3584175
gi.citations.elementKarin Hansson, Michael Muller, Tanja Aitamurto, Lilly Irani, Athanasios Mazarakis, Neha Gupta, Thomas Ludwig (2016): Crowd Dynamics, In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, doi:10.1145/2851581.2856505
gi.citations.elementStephen Uzor, Jason T. Jacques, John J Dudley, Per Ola Kristensson (2021): Investigating the Accessibility of Crowdwork Tasks on Mechanical Turk, In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3411764.3445291
gi.citations.elementLynette Hirschman, Karën Fort, Stéphanie Boué, Nikos Kyrpides, Rezarta Islamaj Doğan, Kevin Bretonnel Cohen (2016): Crowdsourcing and curation: perspectives from biology and natural language processing, In: Database, doi:10.1093/database/baw115
gi.citations.elementSrihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2019): Rethinking Financial Inclusion: from Access to Autonomy, In: Computer Supported Cooperative Work (CSCW) 3-4(28), doi:10.1007/s10606-019-09356-x
gi.citations.elementLisa Posch, Arnim Bleier, Clemens M. Lechner, Daniel Danner, Fabian Flöck, Markus Strohmaier (2019): Measuring Motivations of Crowdworkers, In: ACM Transactions on Social Computing 2(2), doi:10.1145/3335081
gi.citations.elementJacki O’Neill, Anupama Dhareshwar, Srihari H. Muralidhar (2017): Working Digital Money into a Cash Economy: The Collaborative Work of Loan Payment, In: Computer Supported Cooperative Work (CSCW) 4-6(26), doi:10.1007/s10606-017-9289-6
gi.citations.elementMark E. Whiting, Dilrukshi Gamage, Snehalkumar (Neil) S. Gaikwad, Aaron Gilbee, Shirish Goyal, Alipta Ballav, Dinesh Majeti, Nalin Chhibber, Angela Richmond-Fuller, Freddie Vargus, Tejas Seshadri Sarma, Varshine Chandrakanthan, Teogenes Moura, Mohamed Hashim Salih, Gabriel Bayomi Tinoco Kalejaiye, Adam Ginzberg, Catherine A. Mullings, Yoni Dayan, Kristy Milland, Henrique Orefice, Jeff Regino, Sayna Parsi, Kunz Mainali, Vibhor Sehgal, Sekandar Matin, Akshansh Sinha, Rajan Vaish, Michael S. Bernstein (2017): Crowd Guilds, In: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, doi:10.1145/2998181.2998234
gi.citations.elementKarin Hansson, Michael Muller, Tanja Aitamurto, Ann Light, Athanasios Mazarakis, Neha Gupta, Thomas Ludwig (2016): Toward a Typology of Participation in Crowdwork, In: Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion, doi:10.1145/2818052.2855510
gi.citations.elementSrihari Hulikal Muralidhar, Claus Bossen, Jacki O’Neill (2022): Between a Rock and a Hard Place: Negotiating Dependencies and Precarity in the On-Demand Economy, In: Computer Supported Cooperative Work (CSCW) 3(31), doi:10.1007/s10606-022-09434-7
gi.citations.elementSyed Ishtiaque Ahmed, Nicola J. Bidwell, Himanshu Zade, Srihari H. Muralidhar, Anupama Dhareshwar, Baneen Karachiwala, Cedrick N. Tandong, Jacki O'Neill (2016): Peer-to-peer in the Workplace, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858393
gi.citations.elementLaura Lascau, Sandy J. J. Gould, Anna L. Cox, Elizaveta Karmannaya, Duncan P. Brumby (2019): Monotasking or Multitasking, In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3290605.3300649
gi.citations.elementYihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Vassilis-Javed Khan, Michael Saker, Yong Yue, Jonathan Grudin (2022): The dawn of crowdfarms, In: Communications of the ACM 8(65), doi:10.1145/3490698
gi.citations.elementAlex J Wood, Vili Lehdonvirta (2021): Antagonism beyond employment: how the ‘subordinated agency’ of labour platforms generates conflict in the remote gig economy, In: Socio-Economic Review 4(19), doi:10.1093/ser/mwab016
gi.citations.elementDenise J. Wilkins, Srihari Hulikal Muralidhar, Max Meijer, Laura Lascau, Siân Lindley (2022): Gigified Knowledge Work: Understanding Knowledge Gaps When Knowledge Work and On-Demand Work Intersect, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(6), doi:10.1145/3512940
gi.citations.elementHuichuan Xia (2023): Undue Influence or Exploitation — A Qualitative Inquiry into an Ethical Dilemma Around Payment in Crowd Work-Based Research in the U.S., In: Computer Supported Cooperative Work (CSCW) 3(33), doi:10.1007/s10606-023-09472-9
gi.citations.elementWei Tang, Ming Yin, Chien-Ju Ho (2019): Leveraging Peer Communication to Enhance Crowdsourcing, In: The World Wide Web Conference, doi:10.1145/3308558.3313554
gi.citations.elementYihong Wang, Konstantinos Papangelis, Michel Saker, Ioanna Lykourentzou, Vassilis-Javed Khan, Alan Chamberlain, Jonathan Grudin (2021): An Examination of the Work Practices of Crowdfarms, In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3411764.3445603
gi.citations.elementMichael A. Hedderich, Antti Oulasvirta (2024): Explaining crowdworker behaviour through computational rationality, In: Behaviour & Information Technology 3(44), doi:10.1080/0144929x.2024.2329616
gi.citations.elementEliscia Kinder, Mohammad Hossein Jarrahi, Will Sutherland (2019): Gig Platforms, Tensions, Alliances and Ecosystems, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359314
gi.citations.elementMary L. Gray, Siddharth Suri, Syed Shoaib Ali, Deepti Kulkarni (2016): The Crowd is a Collaborative Network, In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, doi:10.1145/2818048.2819942
gi.citations.elementAiri Lampinen, Barry Brown (2017): Market Design for HCI, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025515
gi.citations.elementBrian McInnis, Dan Cosley, Chaebong Nam, Gilly Leshed (2016): Taking a HIT, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858539
gi.citations.elementAiri Lampinen, Moira McGregor, Rob Comber, Barry Brown (2018): Member-Owned Alternatives, In: Proceedings of the ACM on Human-Computer Interaction CSCW(2), doi:10.1145/3274369
gi.citations.elementVili Lehdonvirta (2018): Flexibility in the gig economy: managing time on three online piecework platforms, In: New Technology, Work and Employment 1(33), doi:10.1111/ntwe.12102
gi.citations.elementEsther Greenglass, Daniel Chiacchia, Lisa Fiskenbaum (2021): Investigating <scp>COVID</scp>‐19 stress and coping: Substance use and behavioural disengagement, In: International Journal of Psychology 3(57), doi:10.1002/ijop.12820
gi.citations.elementUjwal Gadiraju, Alessandro Checco, Neha Gupta, Gianluca Demartini (2017): Modus Operandi of Crowd Workers, In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3(1), doi:10.1145/3130914
gi.citations.elementLilly Irani (2017): Amazon Mechanical Turk, In: The Blackwell Encyclopedia of Sociology, doi:10.1002/9781405165518.wbeos0994
gi.citations.elementMashael Yousef Almoqbel, Donghee Yvette Wohn (2019): Individual and Collaborative Behaviors of Rideshare Drivers in Protecting their Safety, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359319
gi.citations.elementAnn Light, Jo Briggs (2017): Crowdfunding Platforms and the Design of Paying Publics, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025979
gi.citations.elementAlex Wood, Vili Lehdonvirta (2019): Platform Labour and Structured Antagonism: Understanding the Origins of Protest in the Gig Economy, In: SSRN Electronic Journal, doi:10.2139/ssrn.3357804
gi.citations.elementYihong Wang, Konstantinos Papangelis, Michael Saker, Ioanna Lykourentzou, Alan Chamberlain, Vassilis-Javed Khan (2020): Crowdsourcing in China: Exploring the Work Experiences of Solo Crowdworkers and Crowdfarm Workers, In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3313831.3376473
gi.citations.elementAli Alkhatib, Michael S. Bernstein, Margaret Levi (2017): Examining Crowd Work and Gig Work Through The Historical Lens of Piecework, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025974
gi.citations.elementM. Six Silberman (2016): Reading Elinor Ostrom In Silicon Valley, In: Proceedings of the 19th International Conference on Supporting Group Work, doi:10.1145/2957276.2957311
gi.citations.elementKinda El Maarry, Kristy Milland, Wolf-Tilo Balke (2018): A Fair Share of the Work?, In: Proceedings of the 10th ACM Conference on Web Science, doi:10.1145/3201064.3201074
gi.citations.elementPaul M. Di Gangi, Jack L. Howard, Samuel H. Goh, Jason Bennett Thatcher (2023): Do you see what I see? A social capital perspective on microtask gig worker opportunity recognition within electronic networks of practice, In: International Journal of Information Management, doi:10.1016/j.ijinfomgt.2022.102615
gi.citations.elementBenjamin V. Hanrahan, Anita Chen, JiaHua Ma, Ning F. Ma, Anna Squicciarini, Saiph Savage (2021): The Expertise Involved in Deciding which HITs are Worth Doing on Amazon Mechanical Turk, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(5), doi:10.1145/3449202
gi.citations.elementXiao Ma, Lara Khansa, Sung S. Kim (2018): Active Community Participation and Crowdworking Turnover: A Longitudinal Model and Empirical Test of Three Mechanisms, In: Journal of Management Information Systems 4(35), doi:10.1080/07421222.2018.1523587
gi.citations.elementCarlos Toxtli, Christopher Curtis, Saiph Savage (2024): A Culturally-Aware AI Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles, In: Proceedings of the ACM on Human-Computer Interaction CSCW2(8), doi:10.1145/3686899
gi.citations.element(2016): Bibliography, In: Collaborative Annotation for Reliable Natural Language Processing, doi:10.1002/9781119306696.biblio
gi.citations.elementCaitlin Lustig, Sean Rintel, Liane Scult, Siddharth Suri (2020): Stuck in the middle with you: The Transaction Costs of Corporate Employees Hiring Freelancers, In: Proceedings of the ACM on Human-Computer Interaction CSCW1(4), doi:10.1145/3392842
gi.citations.elementChenhang Zhou, Yu Chen, Roger Wattenhofer, Ye Wang (2023): Print Your Money: Cash-Like Experiences with Digital Money, In: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3544549.3585772
gi.citations.elementYihong Wang, Konstantinos Papangelis, Ioanna Lykourentzou, Hai-Ning Liang, Irwyn Sadien, Evangelia Demerouti, Vassilis-Javed Khan (2020): In Their Shoes, In: Proceedings of the ACM on Human-Computer Interaction GROUP(4), doi:10.1145/3375187
gi.citations.elementMing Yin, Mary L. Gray, Siddharth Suri, Jennifer Wortman Vaughan (2016): The Communication Network Within the Crowd, In: Proceedings of the 25th International Conference on World Wide Web, doi:10.1145/2872427.2883036
gi.citations.elementRyo Suzuki, Niloufar Salehi, Michelle S. Lam, Juan C. Marroquin, Michael S. Bernstein (2016): Atelier, In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, doi:10.1145/2858036.2858121
gi.citations.elementBenjamin V. Hanrahan, David Martin, Jutta Willamowski, John M. Carroll (2018): Investigating the Amazon Mechanical Turk Market Through Tool Design, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9312-6
gi.citations.elementMoira McGregor, Nicola J. Bidwell, Vidya Sarangapani, Jonathan Appavoo, Jacki O'Neill (2019): Talking about Chat at Work in the Global South, In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3290605.3300463
gi.conference.locationSanibel Island, Florida, USA

Files

Collections