Crisis Crowdsourcing Framework: Designing Strategic Configurations of Crowdsourcing for the Emergency Management Domain
Fulltext URI
Document type
Additional Information
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Crowdsourcing is not a new practice but it is a concept that has gained substantial attention during recent disasters. Drawing from previous work in the crisis informatics, disaster sociology, and computer-supported cooperative work (CSCW) literature, this paper first explains recent conceptualizations of crowdsourcing and how crowdsourcing is a way of leveraging disaster convergence. The CSCW concept of “articulation work” is introduced as an interpretive frame for extracting the salient dimensions of “crisis crowdsourcing.” Then, a series of vignettes are presented to illustrate the evolution of crisis crowdsourcing that spontaneously emerged after the 2010 Haiti earthquake and evolved to more established forms of public engagement during crises. The best practices extracted from the vignettes clarified the efforts to formalize crisis crowdsourcing through the development of innovative interfaces designed to support the articulation work needed to facilitate spontaneous volunteer efforts. Extracting these best practices led to the development of a conceptual framework that unpacks the key dimensions of crisis crowdsourcing. The Crisis Crowdsourcing Framework is a systematic, problem-driven approach to determining the why, who, what, when, where, and how aspects of a crowdsourcing system. The framework also draws attention to the social, technological, organizational, and policy (STOP) interfaces that need to be designed to manage the articulation work involved with reducing the complexity of coordinating across these key dimensions. An example of how to apply the framework to design a crowdsourcing system is offered with a discussion on the implications for applying this framework as well as the limitations of this framework. Innovation is occurring at the social, technological, organizational, and policy interfaces enabling crowdsourcing to be operationalized and integrated into official products and services.
Description
Keywords
Citation
URI
Collections
Endorsement
Review
Supplemented By
Referenced By
Number of citations to item: 89
- Xiaohui Su, Shurui Ma, Xiaokang Qiu, Jiabin Shi, Xiaodong Zhang, Feixiang Chen (2021): Microblog Topic-Words Detection Model for Earthquake Emergency Responses Based on Information Classification Hierarchy, In: International Journal of Environmental Research and Public Health 15(18), doi:10.3390/ijerph18158000
- Paul Haimes, , Stuart Medley, Danielle Brady, Tetsuaki Baba, (2016): Exploring Community Attitudes Towards Sharing of Bushfire Information Online, In: Journal of Disaster Research 3(11), doi:10.20965/jdr.2016.p0552
- Jiang Yu, Qiansheng Zhao, Cheng Siong Chin (2019): Extracting Typhoon Disaster Information from VGI Based on Machine Learning, In: Journal of Marine Science and Engineering 9(7), doi:10.3390/jmse7090318
- Stephanie Matti, Helga Ögmundardóttir (2021): Local knowledge of emerging hazards: Instability above an Icelandic glacier, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2021.102187
- Umar Ali Bukar, Marzanah A. Jabar, Fatimah Sidi, Rozi Nor Haizan Binti Nor, Salfarina Abdullah, Mohamed Othman (2020): Crisis Informatics in the Context of Social Media Crisis Communication: Theoretical Models, Taxonomy, and Open Issues, In: IEEE Access, doi:10.1109/access.2020.3030184
- Hongzhou Shen, Junpeng Shi, Yihan Zhang (2021): CrowdEIM: Crowdsourcing emergency information management tasks to mobile social media users, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2020.102024
- Mohannad A. Alswailim, Hossam S. Hassanein, Mohammad Zulkernine (2017): A Participant Contribution Trust Scheme for Crisis Response Systems, In: GLOBECOM 2017 - 2017 IEEE Global Communications Conference, doi:10.1109/glocom.2017.8253927
- Magdy M. Kabeil, Ahmad M. Kabil (2018): A Proposed Framework for Incorporating Big-Data Technology in National Crisis Management Center, In: Encyclopedia of Information Science and Technology, Fourth Edition, doi:10.4018/978-1-5225-2255-3.ch174
- Nayomi Kankanamge, Tan Yigitcanlar, Ashantha Goonetilleke, Md. Kamruzzaman (2020): Determining disaster severity through social media analysis: Testing the methodology with South East Queensland Flood tweets, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2019.101360
- Ty Hollett, Jeremiah H. Kalir (2016): Mapping Playgrids for Learning Across Space, Time, and Scale, In: TechTrends 3(61), doi:10.1007/s11528-016-0138-0
- Kah Phooi Seng, Li-Minn Ang, Ericmoore Ngharamike, Eno Peter (2023): Ridesharing and Crowdsourcing for Smart Cities: Technologies, Paradigms and Use Cases, In: IEEE Access, doi:10.1109/access.2023.3243264
- Anna Hicks, Jenni Barclay, Jason Chilvers, M. Teresa Armijos, Katie Oven, Peter Simmons, Muki Haklay (2019): Global Mapping of Citizen Science Projects for Disaster Risk Reduction, In: Frontiers in Earth Science, doi:10.3389/feart.2019.00226
- Pekka Luokkala, Jussi Nikander, Jari Korpi, Kirsi Virrantaus, Paulus Torkki (2017): Developing a concept of a context-aware common operational picture, In: Safety Science, doi:10.1016/j.ssci.2016.11.005
- Musabber Ali Chisty, Nesar Ahmed Khan, Syeda Erena Alam Dola, Israt Arif Sumaya, Md. Mostafizur Rahman (2023): Knowledge, Attitude, and Practice Toward Flood Volunteerism in Bangladesh: A Gender-Based Analysis with Policy Implications, In: Global Social Welfare 3(10), doi:10.1007/s40609-023-00276-9
- Jaziar Radianti, Terje Gjøsæter (2021): Metrics for Ensuring Security and Privacy of Information Sharing Platforms for Improved City Resilience, In: Research Anthology on Privatizing and Securing Data, doi:10.4018/978-1-7998-8954-0.ch042
- Nayomi Kankanamge, Tan Yigitcanlar, Ashantha Goonetilleke, Md Kamruzzaman (2019): Can volunteer crowdsourcing reduce disaster risk? A systematic review of the literature, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2019.101097
- Yun Huang, Corey White, Huichuan Xia, Yang Wang (2017): A computational cognitive modeling approach to understand and design mobile crowdsourcing for campus safety reporting, In: International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2016.11.003
- Minsung Hong, Rajendra Akerkar (2019): Analytics and Evolving Landscape of Machine Learning for Emergency Response, In: Learning and Analytics in Intelligent Systems, doi:10.1007/978-3-030-15628-2_11
- Mohammed Benali, Abdessamed Réda Ghomari, Leila Zemmouchi-Ghomari, Mohammed Lazar (2020): Crowdsourcing-Enabled Crisis Collaborative Decision Making, In: International Journal of e-Collaboration 3(16), doi:10.4018/ijec.2020070104
- Daniel Link, Jie Ling, Jannik Hoffjann, Bernd Hellingrath (2019): A Semi-Automated Content Moderation Workflow for Humanitarian Situation Assessments, In: Emergency and Disaster Management, doi:10.4018/978-1-5225-6195-8.ch041
- Nina S. N. Lam, Michelle Meyer, Margaret Reams, Seungwon Yang, Kisung Lee, Lei Zou, Volodymyr Mihunov, Kejin Wang, Ryan Kirby, Heng Cai (2023): Improving social media use for disaster resilience: challenges and strategies, In: International Journal of Digital Earth 1(16), doi:10.1080/17538947.2023.2239768
- Christoph Ernst, Andreas Mladenow, Christine Strauss (2016): Location-based Crowdsourcing in Disaster Response, In: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media, doi:10.1145/3007120.3011076
- Danilo P. Freitas, Marcos R. S. Borges, Paulo Victor R. Carvalho (2017): A framework for dealing collaboratively with interactions from social media in emergency situations, In: 2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD), doi:10.1109/cscwd.2017.8066697
- Chul Hyun Park, Erik W Johnston (2017): A framework for analyzing digital volunteer contributions in emergent crisis response efforts, In: New Media & Society 8(19), doi:10.1177/1461444817706877
- Alexey Voinov, Nagesh Kolagani, Michael K. McCall, Pierre D. Glynn, Marit E. Kragt, Frank O. Ostermann, Suzanne A. Pierce, Palaniappan Ramu (2016): Modelling with stakeholders – Next generation, In: Environmental Modelling & Software, doi:10.1016/j.envsoft.2015.11.016
- Gilberto Marzano, Velta Lubkina (2019): CityBook: A Mobile Crowdsourcing and Crowdsensing Platform, In: Lecture Notes in Networks and Systems, doi:10.1007/978-3-030-12388-8_30
- Marion Lara Tan, David Hoffmann, Elizabeth Ebert, Alicia Cui, David Johnston (2022): Exploring the potential role of citizen science in the warning value chain for high impact weather, In: Frontiers in Communication, doi:10.3389/fcomm.2022.949949
- Elham Shafiei Gol, Mari-Klara Stein, Michel Avital (2019): Crowdwork platform governance toward organizational value creation, In: The Journal of Strategic Information Systems 2(28), doi:10.1016/j.jsis.2019.01.001
- Lin Peng (2017): Crisis crowdsourcing and China’s civic participation in disaster response: Evidence from earthquake relief, In: China Information 3(31), doi:10.1177/0920203x17735668
- Ahmad M. Kabil (2021): Integrating Big Data Technology Into Organizational Decision Support Systems, In: Advances in Logistics, Operations, and Management Science, doi:10.4018/978-1-7998-3473-1.ch078
- Olga A. Basheva, Polina O. Ermolaeva (2020): The phenomenon of digital volunteerism in emergency situations: its essence, types and theoretical framework, In: VESTNIK INSTITUTA SOTZIOLOGII 1(11), doi:10.19181/vis.2020.11.1.625
- J. Rexiline Ragini, P.M. Rubesh Anand, Vidhyacharan Bhaskar (2018): Mining crisis information: A strategic approach for detection of people at risk through social media analysis, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2017.12.002
- Miaomiao Gong, Yuling Sun, Liang He (2019): A Social Network Engaged Crowdsourcing Framework for Expert Tasks, In: 2019 IEEE 23rd International Conference on Computer Supported Cooperative Work in Design (CSCWD), doi:10.1109/cscwd.2019.8791923
- Umar Ali Bukar, Fatimah Sidi, Marzanah A. Jabar, Rozi Nor Haizan Nor, Salfarina Abdullah, Iskandar Ishak, Mustafa Alabadla, Ali Alkhalifah (2022): How Advanced Technological Approaches Are Reshaping Sustainable Social Media Crisis Management and Communication: A Systematic Review, In: Sustainability 10(14), doi:10.3390/su14105854
- Tooran Alizadeh (2018): Crowdsourced Smart Cities versus Corporate Smart Cities, In: IOP Conference Series: Earth and Environmental Science, doi:10.1088/1755-1315/158/1/012046
- Mohammed Benali, Abdessamed Réda Ghomari, Leila Zemmouchi-Ghomari (2018): Crowdsourced Collaborative Decision Making in Crisis Management: Application to Desert Locust Survey and Control, In: IFIP Advances in Information and Communication Technology, doi:10.1007/978-3-319-89743-1_46
- Christian Reuter, Amanda Lee Hughes, Marc-André Kaufhold (2018): Social Media in Crisis Management: An Evaluation and Analysis of Crisis Informatics Research, In: International Journal of Human–Computer Interaction 4(34), doi:10.1080/10447318.2018.1427832
- Christian Reuter, Thomas Ludwig, Patrick Mischur (2018): RescueGlass: Collaborative Applications involving Head-Mounted Displays for Red Cross Rescue Dog Units, In: Computer Supported Cooperative Work (CSCW) 1-2(28), doi:10.1007/s10606-018-9339-8
- Asim B. Khajwal, Arash Noshadravan (2021): An uncertainty-aware framework for reliable disaster damage assessment via crowdsourcing, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2021.102110
- Natalie D. Baker, Magdalena Deham (2019): For a short time, we were the best version of ourselves: Hurricane Harvey and the ideal of community, In: International Journal of Emergency Services 1(9), doi:10.1108/ijes-12-2018-0066
- Yingwei Yan, Chen-Chieh Feng, Wei Huang, Hongchao Fan, Yi-Chen Wang, Alexander Zipf (2020): Volunteered geographic information research in the first decade: a narrative review of selected journal articles in GIScience, In: International Journal of Geographical Information Science 9(34), doi:10.1080/13658816.2020.1730848
- Zainal Ilmi, Adi Wijaya, Jati Kasuma, Dio Caisar Darma (2020): The crowdsourcing data for innovation, In: European Journal of Management Issues 1-2(28), doi:10.15421/192001
- Michael Middelhoff, Adam Widera, Roelof P. van den Berg, Bernd Hellingrath, Daniel Auferbauer, Denis Havlik, Jasmin Pielorz (2016): Crowdsourcing and crowdtasking in crisis management: Lessons learned from a field experiment simulating a flooding in the city of the Hague, In: 2016 3rd International Conference on Information and Communication Technologies for Disaster Management (ICT-DM), doi:10.1109/ict-dm.2016.7857212
- Arie Yulfa, Trias Aditya, Heri Sutanta (2017): Towards SDI services for crowdsourcing spatial data in disaster response, In: 2017 7th International Annual Engineering Seminar (InAES), doi:10.1109/inaes.2017.8068577
- Jenny Lindholm, Klas Backholm, Joachim Högväg (2021): Information Overload!, In: Advances in Human Services and Public Health, doi:10.4018/978-1-7998-6705-0.ch003
- Najeeb Gambo Abdulhamid, Daniel Azerikatoa Ayoung, Armin Kashefi, Boyce Sigweni (2020): A survey of social media use in emergency situations: A literature review, In: Information Development 2(37), doi:10.1177/0266666920913894
- Ahmad M. Kabil (2021): Integrating Big Data Technology Into Organizational Decision Support Systems, In: Research Anthology on Decision Support Systems and Decision Management in Healthcare, Business, and Engineering, doi:10.4018/978-1-7998-9023-2.ch031
- Lisa Thomas, Gary Pritchard, Pam Briggs (2019): Digital Design Considerations for Volunteer Recruitment, In: Proceedings of the 9th International Conference on Communities & Technologies - Transforming Communities, doi:10.1145/3328320.3328368
- Mulalu I. Mulalu (2019): Participatory Geographic Information Systems Within a Crowdsourcing Environment, With Special Reference to Volunteered Geographic Information, In: Environmental Information Systems, doi:10.4018/978-1-5225-7033-2.ch036
- Jaziar Radianti, Terje Gjøsæter (2017): Metrics for Ensuring Security and Privacy of Information Sharing Platforms for Improved City Resilience, In: International Journal of Information Systems for Crisis Response and Management 3(9), doi:10.4018/ijiscram.2017070103
- Shengnan Yang, Pei-Ying Chen, Patrick C. Shih, Jeffrey Bardzell, Shaowen Bardzell (2017): Cross-Strait Frenemies, In: Proceedings of the ACM on Human-Computer Interaction CSCW(1), doi:10.1145/3134750
- Déborah Idier, Axel Aurouet, François Bachoc, Audrey Baills, José Betancourt, Fabrice Gamboa, Thierry Klein, Andrés F. López-Lopera, Rodrigo Pedreros, Jérémy Rohmer, Alexandre Thibault (2021): A User-Oriented Local Coastal Flooding Early Warning System Using Metamodelling Techniques, In: Journal of Marine Science and Engineering 11(9), doi:10.3390/jmse9111191
- Loreta Tauginienė, Eglė Butkevičienė, Katrin Vohland, Barbara Heinisch, Maria Daskolia, Monika Suškevičs, Manuel Portela, Bálint Balázs, Baiba Prūse (2020): Citizen science in the social sciences and humanities: the power of interdisciplinarity, In: Palgrave Communications 1(6), doi:10.1057/s41599-020-0471-y
- Mulalu I. Mulalu (2018): Participatory Geographic Information Systems Within a Crowdsourcing Environment, With Special Reference to Volunteered Geographic Information, In: Advances in Geospatial Technologies, doi:10.4018/978-1-5225-3440-2.ch024
- Zhijun Song, Hui Zhang, Chris Dolan (2020): Promoting Disaster Resilience: Operation Mechanisms and Self-Organizing Processes of Crowdsourcing, In: Sustainability 5(12), doi:10.3390/su12051862
- Marion Lara Tan, Raj Prasanna, Kristin Stock, Emma Hudson-Doyle, Graham Leonard, David Johnston (2017): Mobile applications in crisis informatics literature: A systematic review, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2017.06.009
- Turgut Acikara, Bo Xia, Tan Yigitcanlar, Carol Hon (2023): Contribution of Social Media Analytics to Disaster Response Effectiveness: A Systematic Review of the Literature, In: Sustainability 11(15), doi:10.3390/su15118860
- Mari Karhu, Anna Rantasila, Thomas Olsson, Jonna Häkkilä (2024): Understanding animal-oriented social media collaboration in Australia’s 2019–20 bushfire crisis, In: Frontiers in Communication, doi:10.3389/fcomm.2024.1440311
- Nayomi Kankanamge, Tan Yigitcanlar, Ashantha Goonetilleke (2020): How engaging are disaster management related social media channels? The case of Australian state emergency organisations, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2020.101571
- Thea Riebe, Marc-André Kaufhold, Christian Reuter (2021): The Impact of Organizational Structure and Technology Use on Collaborative Practices in Computer Emergency Response Teams: An Empirical Study, In: Proceedings of the ACM on Human-Computer Interaction CSCW2(5), doi:10.1145/3479865
- Pakhee Kumar (2020): Crowdsourcing to rescue cultural heritage during disasters: A case study of the 1966 Florence Flood, In: International Journal of Disaster Risk Reduction, doi:10.1016/j.ijdrr.2019.101371
- Nayomi Kankanamge, Tan Yigitcanlar, Ashantha Goonetilleke (2022): Gamifying Community Education for Enhanced Disaster Resilience: An Effectiveness Testing Study from Australia, In: Future Internet 6(14), doi:10.3390/fi14060179
- Marina Tavra, Ljiljana Seric, Anka Lisec, Antonia Ivanda, Morena Galesic Divic (2021): Transforming Social Media Posts into Volunteered Geographic Information using Data Mining Methods, In: 2021 6th International Conference on Smart and Sustainable Technologies (SpliTech), doi:10.23919/splitech52315.2021.9566369
- Carolin Klonner, Sabrina Marx, Tomás Usón, João Porto de Albuquerque, Bernhard Höfle (2016): Volunteered Geographic Information in Natural Hazard Analysis: A Systematic Literature Review of Current Approaches with a Focus on Preparedness and Mitigation, In: ISPRS International Journal of Geo-Information 7(5), doi:10.3390/ijgi5070103
- Magdy M. Kabeil, Ahmad M. Kabil (2019): A Proposed Framework for Incorporating Big-Data Technology in National Crisis Management Center, In: Advances in Computer and Electrical Engineering, doi:10.4018/978-1-5225-7598-6.ch045
- D. Auferbauer, H. Tellioğlu (2017): Centralized Crowdsourcing in Disaster Management, In: Proceedings of the 8th International Conference on Communities and Technologies, doi:10.1145/3083671.3083689
- Shadrock Roberts, Tiernan Doyle (2017): Understanding Crowdsourcing and Volunteer Engagement, In: Geophysical Monograph Series, doi:10.1002/9781119217930.ch9
- Carlos A. Iglesias, Alfredo Favenza, Álvaro Carrera (2020): A Big Data Reference Architecture for Emergency Management, In: Information 12(11), doi:10.3390/info11120569
- Tanja Aitamurto, Hélène Landemore (2016): Crowdsourced Deliberation: The Case of the Law on Off-Road Traffic in Finland, In: Policy & Internet 2(8), doi:10.1002/poi3.115
- Jaziar Radianti, Terje Gjøsæter (2017): Secure and Privacy-Preserving Information Sharing for Enhanced Resilience, In: Lecture Notes in Business Information Processing, doi:10.1007/978-3-319-67633-3_17
- Christoph Ernst, Andreas Mladenow, Christine Strauss (2017): Collaboration and crowdsourcing in emergency management, In: International Journal of Pervasive Computing and Communications 2(13), doi:10.1108/ijpcc-03-2017-0026
- Chrysostomi Maria Diakou, Angelika I. Kokkinaki, Styliani Kleanthous (2017): A Methodological Approach Towards Crisis Simulations: Qualifying CI-Enabled Information Systems, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-67074-4_55
- Jenny Lindholm, Klas Backholm, Joachim Högväg (2022): Information Overload!, In: Research Anthology on Managing Crisis and Risk Communications, doi:10.4018/978-1-6684-7145-6.ch030
- Patrick S. Roberts, Shalini Misra, Mark Goldberg-Foss (2022): Open Governance and Disaster Planning, Recovery, and Response: Lessons from the United States, In: Disaster Risk Reduction, doi:10.1007/978-981-19-5646-1_10
- Daniel Link, Jie Ling, Jannik Hoffjann, Bernd Hellingrath (2016): A Semi-Automated Content Moderation Workflow for Humanitarian Situation Assessments, In: International Journal of Information Systems for Crisis Response and Management 2(8), doi:10.4018/ijiscram.2016040103
- Tanja Aitamurto (2016): Collective Intelligence in Law Reforms: When the Logic of the Crowds and the Logic of Policymaking Collide, In: 2016 49th Hawaii International Conference on System Sciences (HICSS), doi:10.1109/hicss.2016.349
- Sara Harrison, Peter Johnson (2019): Challenges in the adoption of crisis crowdsourcing and social media in Canadian emergency management, In: Government Information Quarterly 3(36), doi:10.1016/j.giq.2019.04.002
- Tooran Alizadeh, Somwrita Sarkar, Sandy Burgoyne, Alex Elton-Pym, Robyn Dowling (2020): Enabling Smart Participatory Local Government, In: Smart and Sustainable Cities and Buildings, doi:10.1007/978-3-030-37635-2_12
- Buddhadeb Halder (2015): Approaches of Humanitarian Crisis Management - Associated Risks with the ICT-based Crowdsourcing Paradigm, In: SSRN Electronic Journal, doi:10.2139/ssrn.2568233
- Tanja Aitamurto (2015): Crowdsourcing as a Knowledge-Search Method in Digital Journalism, In: Digital Journalism 2(4), doi:10.1080/21670811.2015.1034807
- Mohammed Benali, Abdessamed Réda Ghomari, Leila Zemmouchi-Ghomari, Mohammed Lazar (2021): Flexible Crowd-Driven Decision Making in Times of Crisis, In: Advances in Social Networking and Online Communities, doi:10.4018/978-1-7998-7764-6.ch001
- Niki Matinrad, Tobias Andersson Granberg, Vangelis Angelakis (2021): Modeling uncertain task compliance in dispatch of volunteers to out-of-hospital cardiac arrest patients, In: Computers & Industrial Engineering, doi:10.1016/j.cie.2021.107515
- Roberto dos Santos Rocha, Adam Widera, Roelof P. van den Berg, João Porto de Albuquerque, Bernd Helingrath (2017): Improving the Involvement of Digital Volunteers in Disaster Management, In: IFIP Advances in Information and Communication Technology, doi:10.1007/978-3-319-68486-4_17
- Danilo P. Freitas, Marcos R. S. Borges, Paulo Victor R. de Carvalho (2019): A conceptual framework for developing solutions that organise social media information for emergency response teams, In: Behaviour & Information Technology 3(39), doi:10.1080/0144929x.2019.1621933
- Refiz Duro, Tanja Gasber, Meng-Ming Chen, Sebastian Sippl, Daniel Auferbauer, Peter Kutschera, Alexandra-Ioana Bojor, Volodymyr Andriychenko, Kuo-Yu slayer Chuang (2019): Satellite Imagery and On-Site Crowdsourcing for Improved Crisis Resilience, In: 2019 15th International Conference on Telecommunications (ConTEL), doi:10.1109/contel.2019.8848564
- Thea Riebe, Julian Bäumler, Marc-André Kaufhold, Christian Reuter (2023): Values and Value Conflicts in the Context of OSINT Technologies for Cybersecurity Incident Response: A Value Sensitive Design Perspective, In: Computer Supported Cooperative Work (CSCW) 2(33), doi:10.1007/s10606-022-09453-4
- Wei Su, Daniel Sui, Xiaodong Zhang (2018): Satellite image analysis using crowdsourcing data for collaborative mapping: current and opportunities, In: International Journal of Digital Earth 6(13), doi:10.1080/17538947.2018.1556352
- Chul Hyun Park, Justin Longo, Erik W. Johnston (2019): Exploring Non-State Stakeholder and Community-Led Open Governance: Beyond the Three Pillars of Open Government, In: Public Performance & Management Review 3(43), doi:10.1080/15309576.2019.1677253
- Leonardo Vasconcelos, Daniela Trevisan, Jose Viterbo (2022): Engagement by Design: A Card-based approach to design crowdsourcing initiatives, In: 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD), doi:10.1109/cscwd54268.2022.9776308