A Task-oriented Multimodal Conversational Interface for a CSCW Immersive Virtual Environment

Simple item page
dc.contributor.authorBarra, Paola
dc.contributor.authorCantone, Andrea Antonio
dc.contributor.authorFrancese, Rita
dc.contributor.authorGiammetti, Marco
dc.contributor.authorSais, Raffaele
dc.contributor.authorSantosuosso, Otino Pio
dc.contributor.authorSepe, Aurelio
dc.contributor.authorSpera, Simone
dc.contributor.authorTortora, Genoveffa
dc.contributor.authorVitiello, Giuliana
dc.date.accessioned2024-06-06T08:23:20Z
dc.date.available2024-06-06T08:23:20Z
dc.date.issued2024
dc.description.abstractIn CSCW immersive Virtual Reality environments, users may be uncomfortable when interacting with a two-dimensional menu. Multimodal conversational interfaces may enhance the interaction enabling users to communicate with the system in different modalities. In this paper, we investigate the use of an embodied multimodal chatbot for improving interaction in a Virtual Reality (VR) environment simulating a working context. In particular, we adopt a User-Centered Design approach to build a multimodal conversational interface, named Muxi, in which a task-oriented voice avatar is enhanced with an interactive board for supporting meeting organization in VR. Users were involved in all the development phases, from task definition to iterative user testing. To assess the usability of the proposed interface, we conducted a controlled experiment involving 32 participants to compare the use of Muxi with a traditional menu-based interface in a CSCW environment. We performed quantitative analysis, concerning efficiency and effectiveness assessment, and qualitative analysis, related to participant cognitive load and perceived usability. Results revealed that our multimodal interface increases usability by greatly alleviating cognitive load and improving user performance, representing a good alternative to a menu-based interface.en
dc.identifier.doi10.48340/ecscw2024_ep05
dc.identifier.eissn2510-2591
dc.identifier.urihttps://dl.eusset.eu/handle/20.500.12015/5119
dc.language.isoen
dc.publisherEuropean Society for Socially Embedded Technologies (EUSSET)
dc.relation.ispartofProceedings of 22nd European Conference on Computer-Supported Cooperative Work
dc.relation.ispartofseriesReports of the European Society for Socially Embedded Technologies: vol. 8, no. 1
dc.subjectUser-Centered Design
dc.subjectMultimodal Conversational Interface
dc.subjectChatbot
dc.titleA Task-oriented Multimodal Conversational Interface for a CSCW Immersive Virtual Environmenten
dc.typeText/Conference Paper
gi.conference.date17 June - 21 June, 2024
gi.conference.locationRimini, Italy
gi.conference.reviewfull
gi.conference.sessiontitleExploratory papers

Files

Original bundle
1 - 1 of 1
Thumbnail Image
Name:
ecscw2024_ep05.pdf
Size:
648.71 KB
Format:
Adobe Portable Document Format
Download

Collections

ECSCW 2024 Exploratory Papers and Notes