Enabling Large-Scale Deliberation Using Attention-Mediation Metrics
dc.contributor.author | Klein, Mark | |
dc.date.accessioned | 2020-06-06T13:07:05Z | |
dc.date.available | 2020-06-06T13:07:05Z | |
dc.date.issued | 2012 | |
dc.date.issued | 2012 | |
dc.description.abstract | Humanity now finds itself faced with a range of highly complex and controversial challenges—such as climate change, the spread of disease, international security, scientific collaborations, product development, and so on—that call upon us to bring together large numbers of experts and stakeholders to deliberate collectively on a global scale. Collocated meetings can however be impractically expensive, severely limit the concurrency and thus breadth of interaction, and are prone to serious dysfunctions such as polarization and hidden profiles. Social media such as email, blogs, wikis, chat rooms, and web forums provide unprecedented opportunities for interacting on a massive scale, but have yet to realize their potential for helping people deliberate effectively, typically generating poorly-organized, unsystematic and highly redundant contributions of widely varying quality. Large-scale argumentation systems represent a promising approach for addressing these challenges, by virtue of providing a simple systematic structure that radically reduces redundancy and encourages clarity. They do, however, raise an important challenge. How can we ensure that the attention of the deliberation participants is drawn, especially in large complex argument maps, to where it can best serve the goals of the deliberation? How can users, for example, find the issues they can best contribute to, assess whether some intervention is needed, or identify the results that are mature and ready to “harvest”? Can we enable, for large-scale distributed discussions, the ready understanding that participants typically have about the progress and needs of small-scale, collocated discussions?. This paper will address these important questions, discussing (1) the strengths and limitations of current deliberation technologies, (2) how argumentation technology can help address these limitations, and (3) how we can use attention-mediation metrics to enhance the effectiveness of large-scale argumentation-based deliberations. | de |
dc.identifier.doi | 10.1007/s10606-012-9156-4 | |
dc.identifier.pissn | 1573-7551 | |
dc.identifier.uri | http://dx.doi.org/10.1007/s10606-012-9156-4 | |
dc.identifier.uri | https://dl.eusset.eu/handle/20.500.12015/3928 | |
dc.publisher | Springer | |
dc.relation.ispartof | Computer Supported Cooperative Work (CSCW): Vol. 21 | |
dc.relation.ispartofseries | Computer Supported Cooperative Work (CSCW) | |
dc.subject | Argumentation | |
dc.subject | Deliberation | |
dc.subject | Metrics | |
dc.title | Enabling Large-Scale Deliberation Using Attention-Mediation Metrics | de |
dc.type | Text/Journal Article | |
gi.citation.endPage | 473 | |
gi.citation.startPage | 449 | |
gi.citations.count | 69 | |
gi.citations.element | Adam Westerski, Theodore Dalamagas, Carlos A. Iglesias (2013): Classifying and comparing community innovation in Idea Management Systems, In: Decision Support Systems 3(54), doi:10.1016/j.dss.2012.12.004 | |
gi.citations.element | Jordi Ganzer-Ripoll, Natalia Criado, Maite Lopez-Sanchez, Simon Parsons, Juan A. Rodriguez-Aguilar (2018): Combining Social Choice Theory and Argumentation: Enabling Collective Decision Making, In: Group Decision and Negotiation 1(28), doi:10.1007/s10726-018-9594-6 | |
gi.citations.element | Detlef Schoder, Johannes Putzke, Panagiotis Takis Metaxas, Peter A. Gloor, Kai Fischbach (2014): Informationssysteme für „Wicked Problems“, In: WIRTSCHAFTSINFORMATIK 1(56), doi:10.1007/s11576-013-0395-x | |
gi.citations.element | Ravi Santosh Arvapally, Xiaoqing (Frank) Liu (2013): Polarisation assessment in an intelligent argumentation system using fuzzy clustering algorithm for collaborative decision support, In: Argument & Computation 3(4), doi:10.1080/19462166.2013.794163 | |
gi.citations.element | Lesley S. J. Farmer (2019): Cross-Cultural Aspects of Collective Intelligence Online, In: Advances in Higher Education and Professional Development, doi:10.4018/978-1-5225-8286-1.ch001 | |
gi.citations.element | Mark Klein (2015): A Critical Review of Crowd-Scale Online Deliberation Technologies, In: SSRN Electronic Journal, doi:10.2139/ssrn.2652888 | |
gi.citations.element | Claudia Niemeyer, Thomas Wagenknecht, Timm Teubner, Christof Weinhardt (2016): Participatory Crowdfunding: An Approach towards Engaging Employees and Citizens in Institutional Budgeting Decisions, In: 2016 49th Hawaii International Conference on System Sciences (HICSS), doi:10.1109/hicss.2016.351 | |
gi.citations.element | Katsuhide Fujita, Takayuki Ito, Mark Klein (2017): Enabling Large Scale Deliberation Using Ideation and Negotiation-Support Agents, In: 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW), doi:10.1109/icdcsw.2017.75 | |
gi.citations.element | Chunsheng Yang, Wen Gu, Takayuki Ito (2019): Toward Case-based Reasoning Facilitation for Online Discussion in Deliberation, In: 2019 IEEE 23rd International Conference on Computer Supported Cooperative Work in Design (CSCWD), doi:10.1109/cscwd.2019.8791866 | |
gi.citations.element | Matti Nelimarkka, Antti Salovaara, Bryan Semaan, Giulio Jacucci (2017): Theory-Driven Collocated CMC, In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3025453.3025885 | |
gi.citations.element | Mark Klein, Ana Cristina Bicharra Garcia (2015): High-speed idea filtering with the bag of lemons, In: Decision Support Systems, doi:10.1016/j.dss.2015.06.005 | |
gi.citations.element | Nardine Alnemr (2020): Emancipation cannot be programmed: blind spots of algorithmic facilitation in online deliberation, In: Contemporary Politics 5(26), doi:10.1080/13569775.2020.1791306 | |
gi.citations.element | Sanja Tanasijevic, Klemens Bohm (2013): A New Approach to Large-Scale Deliberation, In: 2013 International Conference on Cloud and Green Computing, doi:10.1109/cgc.2013.45 | |
gi.citations.element | Karen Schrier (2016): Designing role-playing video games for ethical thinking, In: Educational Technology Research and Development 4(65), doi:10.1007/s11423-016-9489-7 | |
gi.citations.element | Thomas Wagenknecht, Olga Levina, Christof Weinhardt (2017): Designing Anonymous Collaboration in Computer-Supported Organizational Participation, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-59144-5_6 | |
gi.citations.element | Weichen Liu, Sijia Xiao, Jacob T. Browne, Ming Yang, Steven P. Dow (2018): ConsensUs, In: ACM Transactions on Social Computing 1(1), doi:10.1145/3159649 | |
gi.citations.element | Mark Klein, Ana Cristina Bicharra Garcia (2014): The Bag of Stars: High-Speed Idea Filtering for Open Innovation, In: SSRN Electronic Journal, doi:10.2139/ssrn.2387180 | |
gi.citations.element | Mark Klein (2017): Towards Crowd-Scale Deliberation, In: SSRN Electronic Journal, doi:10.2139/ssrn.2987624 | |
gi.citations.element | Chunsheng Yang, Wen Gu, Takayuki Ito, Xiaohua Yang (2021): Machine learning-based consensus decision-making support for crowd-scale deliberation, In: Applied Intelligence 7(51), doi:10.1007/s10489-020-02118-z | |
gi.citations.element | Saskia Goldberg, André Bächtiger (2018): Wünsche an Demokratie: Politische Einstellungen, Entscheidungsthema und Demokratiepräferenzen von Bürgern, In: Einstellungen und Verhalten in der empirischen Sozialforschung, doi:10.1007/978-3-658-16348-8_13 | |
gi.citations.element | Mark Klein (2015): The CATALYST Deliberation Analytics Server, In: SSRN Electronic Journal, doi:10.2139/ssrn.2962524 | |
gi.citations.element | Mahmood Jasim, Enamul Hoque, Ali Sarvghad, Narges Mahyar (2021): CommunityPulse: Facilitating Community Input Analysis by Surfacing Hidden Insights, Reflections, and Priorities, In: Designing Interactive Systems Conference 2021, doi:10.1145/3461778.3462132 | |
gi.citations.element | Weiyu Zhang, Carol Soon (2017): The Main and Spillover Effects of Online Deliberation: Changes in Opinions, Informational Media Use and Political Activities, In: 2017 Conference for E-Democracy and Open Government (CeDEM), doi:10.1109/cedem.2017.21 | |
gi.citations.element | Lesley S. J. Farmer (2016): Using Virtual Environments to Transform Collective Intelligence, In: Advances in Human and Social Aspects of Technology, doi:10.4018/978-1-4666-9899-4.ch008 | |
gi.citations.element | Takayuki Ito, Takanobu Otsuka, Satoshi Kawase, Akihisa Sengoku, Shun Shiramatsu, Takanori Ito, Eizo Hideshima, Tokuro Matsuo, Tetsuya Oishi, Rieko Fujita, Naoki Fukuta, Katsuhide Fujita (2017): Experimental results on large-scale cyber-physical hybrid discussion support, In: International Journal of Crowd Science 1(1), doi:10.1108/ijcs-01-2017-0003 | |
gi.citations.element | Juan A. Rodriguez-Aguilar, Marc Serramia, Maite Lopez-Sanchez (2016): Aggregation Operators to Support Collective Reasoning, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-45656-0_1 | |
gi.citations.element | Anna De Liddo, Grazia Concilio, Francesca Rizzo (2023): Critical Deliberative Democracy Tech: Questions, Tensions, Norms and Directions for Working with Institutions, Communities and Technologies to Scale Up Democratic Innovations, In: The 11th International Conference on Communities and Technologies (C&T), doi:10.1145/3593743.3593775 | |
gi.citations.element | Luca Iandoli, Ivana Quinto, Anna De Liddo, Simon Buckingham Shum (2015): On online collaboration and construction of shared knowledge: Assessing mediation capability in computer supported argument visualization tools, In: Journal of the Association for Information Science and Technology 5(67), doi:10.1002/asi.23481 | |
gi.citations.element | Kirsikka Grön, Matti Nelimarkka (2020): Party Politics, Values and the Design of Social Media Services, In: Proceedings of the ACM on Human-Computer Interaction CSCW2(4), doi:10.1145/3415175 | |
gi.citations.element | Saskia Goldberg, Dominik Wyss, André Bächtiger (2019): Deliberating or Thinking (Twice) About Democratic Preferences: What German Citizens Want From Democracy, In: Political Studies 2(68), doi:10.1177/0032321719843967 | |
gi.citations.element | Eleonore Fournier-Tombs, Giovanna Di Marzo Serugendo (2019): DelibAnalysis: Understanding the quality of online political discourse with machine learning, In: Journal of Information Science 6(46), doi:10.1177/0165551519871828 | |
gi.citations.element | Najla Althuniyan, Joseph W. Sirrianni, Md Mahfuzer Rahman, Xiaoqing “Frank” Liu (2019): Design of Mobile Service of Intelligent Large-Scale Cyber Argumentation for Analysis and Prediction of Collective Opinions, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-23367-9_10 | |
gi.citations.element | Rafał Olszowski, Marcin Chmielowski (2020): Collective Intelligence in Polish-Ukrainian Internet Projects. Debate Models and Research Methods, In: Future Internet 6(12), doi:10.3390/fi12060106 | |
gi.citations.element | Mark Klein, Ana Cristina Bicharra Garcia (2014): High-Speed Idea Filtering with the Bag of Lemons, In: SSRN Electronic Journal, doi:10.2139/ssrn.2501787 | |
gi.citations.element | Jordi Ganzer-Ripoll, Maite López-Sánchez, Juan Antonio Rodriguez-Aguilar (2017): A Multi-agent Argumentation Framework to Support Collective Reasoning, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-57285-7_7 | |
gi.citations.element | Lu Xiao, Jennifer Stromer-Galley, Ágnes Sándor (2016): Toward the Automated Detection of Individuals’ Rationales in Large-Scale Online Open Participative Activities: A Conceptual Framework, In: Group Decision and Negotiation 5(26), doi:10.1007/s10726-016-9516-4 | |
gi.citations.element | Jordi Ganzer-Ripoll, Maite Lopez-Sanchez, Juan Antonio Rodriguez-Aguilar (2017): A Target-Oriented Discussion Framework to Support Collective Decision Making, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-59294-7_39 | |
gi.citations.element | José Luis Fernández-Martínez, Maite López-Sánchez, Juan Antonio Rodríguez Aguilar, Dionisio Sánchez Rubio, Berenice Zambrano Nemegyei (2020): Co-Designing Participatory Tools for a New Age, In: Natural Language Processing, doi:10.4018/978-1-7998-0951-7.ch042 | |
gi.citations.element | Hiroki Ono, Kaito Koike, Takeshi Morita, Takahira Yamaguchi (2019): Ontologies-Based Pupil Robot Interaction with Group Discussion, In: Procedia Computer Science, doi:10.1016/j.procs.2019.09.380 | |
gi.citations.element | Gafari Lukumon, Mark Klein (2023): Crowd-sourced idea filtering with Bag of Lemons: the impact of the token budget size, In: DECISION 2(50), doi:10.1007/s40622-023-00349-w | |
gi.citations.element | Livia C Gouvea, Ana Cristina B Garcia, Adriana S Vivacqua (2019): Behavior Indicators for Sensemaking of Online Discussions, In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), doi:10.1109/smc.2019.8914182 | |
gi.citations.element | D. Khartabil, C. Collins, S. Wells, B. Bach, J. Kennedy (2021): Design and Evaluation of Visualization Techniques to Facilitate Argument Exploration, In: Computer Graphics Forum 6(40), doi:10.1111/cgf.14389 | |
gi.citations.element | Liang Xiao, Hao Zhou, John Fox (2022): Towards a systematic approach for argumentation, recommendation, and explanation in clinical decision support, In: Mathematical Biosciences and Engineering 10(19), doi:10.3934/mbe.2022489 | |
gi.citations.element | Mark Klein (2015): A Critical Review of Crowd-Scale Online Deliberation Technologies, In: SSRN Electronic Journal, doi:10.2139/ssrn.2658811 | |
gi.citations.element | Mark Klein (2020): Crowd-Scale Deliberation for Group Decision-Making, In: Handbook of Group Decision and Negotiation, doi:10.1007/978-3-030-12051-1_40-1 | |
gi.citations.element | Ilse Verdiesen, Virginia Dignum, Jeroen Van Den Hoven (2018): Measuring Moral Acceptability in E-deliberation, In: ACM Transactions on Internet Technology 4(18), doi:10.1145/3183324 | |
gi.citations.element | Fabio Paglieri (2016): A Plea for Ecological Argument Technologies, In: Philosophy & Technology 2(30), doi:10.1007/s13347-016-0222-6 | |
gi.citations.element | Detlef Schoder, Johannes Putzke, Panagiotis Takis Metaxas, Peter A. Gloor, Kai Fischbach (2014): Information Systems for “Wicked Problems”, In: Business & Information Systems Engineering 1(6), doi:10.1007/s12599-013-0303-3 | |
gi.citations.element | Masaki Matsubara, Yuhei Matsuda, Ryohei Kuzumi, Masanori Koizumi, Atsuyuki Morishima (2020): Collecting and Organizing Citizen Opinions: A Dynamic Microtask Approach and Its Evaluation, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-43687-2_4 | |
gi.citations.element | Dominik Wyss, Simon Beste (2017): Artificial facilitation: Promoting collective reasoning within asynchronous discussions, In: Journal of Information Technology & Politics 3(14), doi:10.1080/19331681.2017.1338175 | |
gi.citations.element | Ko Kitagawa, Shun Shiramatsu, Akira Kamiya (2019): Developing a Method for Quantifying Degree of Discussion Progress Towards Automatic Facilitation of Web-Based Discussion, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-17294-7_12 | |
gi.citations.element | José Luis Fernández-Martínez, Maite López-Sánchez, Juan Antonio Rodríguez Aguilar, Dionisio Sánchez Rubio, Berenice Zambrano Nemegyei (2018): Co-Designing Participatory Tools for a New Age, In: International Journal of Public Administration in the Digital Age 4(5), doi:10.4018/ijpada.2018100101 | |
gi.citations.element | Alberto Cottica, Guy Melançon, Benjamin Renoust (2017): Online community management as social network design: testing for the signature of management activities in online communities, In: Applied Network Science 1(2), doi:10.1007/s41109-017-0049-9 | |
gi.citations.element | Lesley S. J. Farmer (2019): Using Virtual Environments to Transform Collective Intelligence, In: Crowdsourcing, doi:10.4018/978-1-5225-8362-2.ch006 | |
gi.citations.element | Caiquan Xiong, Xuan Li, Yuan Li, Gang Liu (2018): Multi-Documents Summarization Based on TextRank and its Application in Online Argumentation Platform, In: International Journal of Data Warehousing and Mining 3(14), doi:10.4018/ijdwm.2018070104 | |
gi.citations.element | Luca Iandoli, Ivana Quinto, Anna De Liddo, Simon Buckingham Shum (2014): Socially augmented argumentation tools: Rationale, design and evaluation of a debate dashboard, In: International Journal of Human-Computer Studies 3(72), doi:10.1016/j.ijhcs.2013.08.006 | |
gi.citations.element | Guillaume Bouchard, Stephane Clinchant, Gregorio Convertino (2014): E-Participation with Stakeholders' Feedback Platforms, In: Advances in Electronic Government, Digital Divide, and Regional Development, doi:10.4018/978-1-4666-6236-0.ch010 | |
gi.citations.element | Anna Mikhaylovskaya (2024): Enhancing Deliberation with Digital Democratic Innovations, In: Philosophy & Technology 1(37), doi:10.1007/s13347-023-00692-x | |
gi.citations.element | Ravi Santosh Arvapally, Xiaoqing Frank Liu, Donald C. Wunsch (2013): Fuzzy c-Means Clustering Based Polarization Assessment in Intelligent Argumentation System for Collaborative Decision Support, In: 2013 IEEE 37th Annual Computer Software and Applications Conference, doi:10.1109/compsac.2013.12 | |
gi.citations.element | Ruth Shortall, Anatol Itten, Michiel van der Meer, Pradeep Murukannaiah, Catholijn Jonker (2022): Reason against the machine? Future directions for mass online deliberation, In: Frontiers in Political Science, doi:10.3389/fpos.2022.946589 | |
gi.citations.element | Katsuhide FUJITA, Ryosuke WATANABE (2018): On Implementing an Automatic Headline Generation for Discussion BBS Systems —Cases of Citizens' Deliberations for Communities—, In: IEICE Transactions on Information and Systems 4(E101.D), doi:10.1587/transinf.2016iip0017 | |
gi.citations.element | Najla Althuniyan, Joseph W Sirrianni, Md Mahfuzer Rahman, Xiaoqing Frank Liu (2020): Design and Analysis of Mobile App for Large-Scale Cyber-Argumentation, In: 2020 Second International Conference on Transdisciplinary AI (TransAI), doi:10.1109/transai49837.2020.00013 | |
gi.citations.element | Panagiotis Gourgaris, Andreas Kanavos, Nikos Karacapilidis, Vassilis Tampakas (2018): Argumentative Discourse Concepts as Revealed by Traversing a Graph, In: IFIP Advances in Information and Communication Technology, doi:10.1007/978-3-319-92016-0_12 | |
gi.citations.element | Claudia Niemeyer, Timm Teubner, Margeret Hall, Christof Weinhardt (2018): The Impact of Dynamic Feedback and Personal Budgets on Arousal and Funding Behaviour in Participatory Budgeting, In: Group Decision and Negotiation 4(27), doi:10.1007/s10726-018-9578-6 | |
gi.citations.element | Bryan Semaan, Heather Faucett, Scott P. Robertson, Misa Maruyama, Sara Douglas (2015): Designing Political Deliberation Environments to Support Interactions in the Public Sphere, In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, doi:10.1145/2702123.2702403 | |
gi.citations.element | Takayuki Ito, Takanobu Otsuka, Satoshi Kawase, Akihisa Sengoku, Shun Shiramatsu, Tokuro Matsuo, Tetsuya Oishi, Rieko Fujita, Naoki Fukuta, Katsuhide Fujita (2016): Preliminary results on a large-scale cyber-physical hybrid discussion support experiment, In: 2016 11th International Conference on Knowledge, Information and Creativity Support Systems (KICSS), doi:10.1109/kicss.2016.7951436 | |
gi.citations.element | Adam Binks, Alice Toniolo, Miguel A. Nacenta (2022): Representational transformations: Using maps to write essays, In: International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2022.102851 | |
gi.citations.element | Mark Klein (2021): Crowd-Scale Deliberation for Group Decision-Making, In: Handbook of Group Decision and Negotiation, doi:10.1007/978-3-030-49629-6_40 | |
gi.citations.element | Ravi S. Arvapally, Xiaoqing Frank Liu, Fiona Fui‐Hoon Nah, Wei Jiang (2017): Identifying outlier opinions in an online intelligent argumentation system, In: Concurrency and Computation: Practice and Experience 8(33), doi:10.1002/cpe.4107 |