Exploring the Impact of Video on Inferred Difficulty Awareness

dc.contributor.authorCarter, Jason
dc.contributor.authorPichiliani, Mauro Carlos
dc.contributor.authorDewan, Prasun
dc.date.accessioned2018-04-30T19:58:19Z
dc.date.available2018-04-30T19:58:19Z
dc.date.issued2018
dc.description.abstractAn important issue in many forms of collaboration technology is how video can help the technology better meet its goals. This paper explores this question for difficulty awareness, which is motivated by academic and industrial collaboration scenarios in which unsolicited help is offered to programmers in difficulty. We performed experiments to determine how well difficulty can be automatically inferred by mining the interaction log and/or videos of programmers. Our observations show that: (a) it is more effective to mine the videos to detect programmer postures rather than facial features; (b) posture- mining benefits from an individual model (training data for a developer is used only for that developer), while in contrast, log-mining benefits from a group model (data of all users are used for each user); (b) posture-mining alone (using an individual model) does not detect difficulties of “calm” programmers, who do not change postures when they are in difficulty; (c) log-mining alone (using a group model) does not detect difficulties of programmers who pause interaction when they are either in difficulty or taking a break; (d) overall, log-mining alone is more effective than posture-mining, alone; (e) both forms of mining have high false negative rates; and (g) multimedia/multimodal detection that mines postures and logs using a group model gives both low false positive and negatives. These results imply that (a) when collaborators can be seen, either directly or through a video, posture changes, though idiosyncratic, are important cues for inferring difficulty; (b) automatically inferred difficulty, using both interaction-logs and postures, when possible and available, is an even more reliable indication of difficulty; (c) video can play an important role in providing unsolicited help in both face-to-face and distributed collaboration; and (d) controlled public environments such as labs and war-rooms should be equipped with cameras that support posture mining.en
dc.identifier.doi10.18420/ecscw2018_9
dc.identifier.pissn2510-2591
dc.language.isoen
dc.publisherEuropean Society for Socially Embedded Technologies (EUSSET)
dc.relation.ispartofProceedings of 16th European Conference on Computer-Supported Cooperative Work - Exploratory Papers
dc.relation.ispartofseriesReports of the European Society for Socially Embedded Technologies: vol. 2, no. 1
dc.subjectvideo
dc.subjectdifficulty awareness
dc.titleExploring the Impact of Video on Inferred Difficulty Awarenessen
dc.typeText/Conference Paper
gi.conference.date4 - 8 June 2018
gi.conference.locationNancy, France
mci.conference.reviewfull

Files

Original bundle
1 - 1 of 1
Loading...
Thumbnail Image
Name:
ecscw2018-exploratory-paper-9.pdf
Size:
3.11 MB
Format:
Adobe Portable Document Format