Providing Information on the Spot: Using Augmented Reality for Situational Awareness in the Security Domain

dc.contributor.authorLukosch, Stephan
dc.contributor.authorLukosch, Heide
dc.contributor.authorDatcu, Dragoş
dc.contributor.authorCidota, Marina
dc.date.accessioned2020-06-06T13:06:39Z
dc.date.available2020-06-06T13:06:39Z
dc.date.issued2015
dc.date.issued2015
dc.description.abstractFor operational units in the security domain that work together in teams, it is important to quickly and adequately exchange context-related information to ensure well-working collaboration. Currently, most information exchange is based on oral communication. This paper reports on different scenarios from the security domain in which augmented reality (AR) techniques are used to support such information exchange. The scenarios have been designed with a User Centred Design approach, in order to make the scenarios as realistic as possible. To support these scenarios, an AR system has been developed and evaluated in two rounds. In the first round, the usability and feasibility of the AR support has been evaluated with experts from different operational units in the security domain. The second evaluation round then focussed on the effect of AR on collaboration and situational awareness within the expert teams. With regard to the usability and feasibility of AR, the evaluation shows that the scenarios are well defined and the AR system can successfully support information exchange in teams operating in the security domain. The second evaluation round showed that AR can especially improve the situational awareness of remote colleagues not physically present at a scene.de
dc.identifier.doi10.1007/s10606-015-9235-4
dc.identifier.pissn1573-7551
dc.identifier.urihttp://dx.doi.org/10.1007/s10606-015-9235-4
dc.identifier.urihttps://dl.eusset.eu/handle/20.500.12015/3861
dc.publisherSpringer
dc.relation.ispartofComputer Supported Cooperative Work (CSCW): Vol. 24, No. 6
dc.relation.ispartofseriesComputer Supported Cooperative Work (CSCW)
dc.subjectAugmented reality
dc.subjectCollaboration quality
dc.subjectInformation exchange
dc.subjectSituational awareness
dc.subjectUsability
dc.titleProviding Information on the Spot: Using Augmented Reality for Situational Awareness in the Security Domainde
dc.typeText/Journal Article
gi.citation.endPage664
gi.citation.startPage613
gi.citations.count52
gi.citations.elementJulia Woodward, Jaime Ruiz (2023): Analytic Review of Using Augmented Reality for Situational Awareness, In: IEEE Transactions on Visualization and Computer Graphics 4(29), doi:10.1109/tvcg.2022.3141585
gi.citations.elementKumaragurubaran T, M. Vasundhara Devi, S. SenthilPandi, M. Tharun (2023): Exploring Extended Reality (XR) in the Workplace - Applications, Challenges: Survey, In: 2023 International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE), doi:10.1109/rmkmate59243.2023.10369447
gi.citations.elementKonstantinos Konstantoudakis, Kyriaki Christaki, Dimitrios Tsiakmakis, Dimitrios Sainidis, Georgios Albanis, Anastasios Dimou, Petros Daras (2022): Drone Control in AR: An Intuitive System for Single-Handed Gesture Control, Drone Tracking, and Contextualized Camera Feed Visualization in Augmented Reality, In: Drones 2(6), doi:10.3390/drones6020043
gi.citations.elementMichael Prilla, Lisa M. Ruhmann (2018): An Analysis Tool for Cooperative Mixed Reality Scenarios, In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct.2018.00026
gi.citations.elementDoris Aschenbrenner, Florian Leutert, Argun Çençen, Jouke Verlinden, Klaus Schilling, Marc Latoschik, Stephan Lukosch (2019): Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial Robots, In: Frontiers in Robotics and AI, doi:10.3389/frobt.2019.00037
gi.citations.elementHossein Salimian, Stephen Brooks, Derek Reilly (2019): MP Remix, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359207
gi.citations.elementBrita Munsinger, Nicole Beebe, Turquoise Richardson (2023): Virtual reality for improving cyber situational awareness in security operations centers, In: Computers & Security, doi:10.1016/j.cose.2023.103368
gi.citations.elementSarah Lehman, Jenna Graves, Carlene Mcaleer, Tania Giovannetti, Chiu C. Tan (2018): A Mobile Augmented Reality Game to Encourage Hydration in the Elderly, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-92046-7_9
gi.citations.elementSatu Rantakokko (2022): Data Handling Process in Extended Reality (XR) When Delivering Technical Instructions, In: Technical Communication 2(69), doi:10.55177/tc734125
gi.citations.elementThomas Wells, Dominic Potts, Steven Houben (2022): A Study into the Effect of Mobile Device Configurations on Co-Located Collaboration using AR, In: Proceedings of the ACM on Human-Computer Interaction MHCI(6), doi:10.1145/3546735
gi.citations.elementMeng Li, Tom Slijkhuis, Remko Huigen, Armagan Albayrak, Daan van Eijk (2021): Two-way Augmented Reality Co-location Under Telemedicine Context, In: 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct54149.2021.00121
gi.citations.elementThomas Wells, Steven Houben (2020): CollabAR Investigating the Mediating Role of Mobile AR Interfaces on Co-Located Group Collaboration, In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3313831.3376541
gi.citations.elementNitin Sukhija, Cory Haser, Elizabeth Bautista (2019): Employing Augmented Reality for Cybersecurity Operations in High Performance Computing Environments, In: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning), doi:10.1145/3332186.3333160
gi.citations.elementJulia Bräker, Anna Osterbrink, Martin Semmann, Manuel Wiesche (2022): User-Centered Requirements for Augmented Reality as a Cognitive Assistant for Safety-Critical Services, In: Business & Information Systems Engineering 2(65), doi:10.1007/s12599-022-00779-3
gi.citations.elementAaron Rowen, Martha Grabowski, Jean-Philippe Rancy (2021): Moving and improving in safety-critical systems: Impacts of head-mounted displays on operator mobility, performance, and situation awareness, In: International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2021.102606
gi.citations.elementChristian Reuter, Thomas Ludwig, Patrick Mischur (2018): RescueGlass: Collaborative Applications involving Head-Mounted Displays for Red Cross Rescue Dog Units, In: Computer Supported Cooperative Work (CSCW) 1-2(28), doi:10.1007/s10606-018-9339-8
gi.citations.elementMarina A. Cidota, Dragos Datcu (2020): Remote Assistance System in Augmented Reality for Early School Dropout Prevention, In: 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct51615.2020.00091
gi.citations.elementHendrik Engelbrecht, Stephan Lukosch (2020): Dangerous or Desirable: Utilizing Augmented Content for Field Policing, In: International Journal of Human–Computer Interaction 15(36), doi:10.1080/10447318.2020.1752473
gi.citations.elementHeide K. Lukosch, Geertje Bekebrede, Shalini Kurapati, Stephan G. Lukosch (2018): A Scientific Foundation of Simulation Games for the Analysis and Design of Complex Systems, In: Simulation & Gaming 3(49), doi:10.1177/1046878118768858
gi.citations.elementJulia Woodward, Jesse Smith, Isaac Wang, Sofia Cuenca, Jaime Ruiz (2020): Examining the Presentation of Information in Augmented Reality Headsets for Situational Awareness, In: Proceedings of the International Conference on Advanced Visual Interfaces, doi:10.1145/3399715.3399846
gi.citations.elementMarina Cidota, Stephan Lukosch, Dragos Datcu, Heide Lukosch (2016): Comparing the Effect of Audio and Visual Notifications on Workspace Awareness Using Head-Mounted Displays for Remote Collaboration in Augmented Reality, In: Augmented Human Research 1(1), doi:10.1007/s41133-016-0003-x
gi.citations.elementFelipe Fernandez, Angel Sanchez, Jose F. Velez, Belen Moreno (2017): A Cognitive Architecture Framework for Critical Situation Awareness Systems, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-59740-9_6
gi.citations.elementJulia Woodward, Jesse Smith, Isaac Wang, Sofia Cuenca, Jaime Ruiz (2023): Designing Critical and Secondary Information in Augmented Reality Headsets for Situational Awareness, In: Journal of Engineering Research and Sciences 3(2), doi:10.55708/js0203001
gi.citations.elementLee Kent, Chris Snider, James Gopsill, Ben Hicks (2021): Mixed reality in design prototyping: A systematic review, In: Design Studies, doi:10.1016/j.destud.2021.101046
gi.citations.elementSeungwon Kim, Mark Billinghurst, Gun Lee (2018): The Effect of Collaboration Styles and View Independence on Video-Mediated Remote Collaboration, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9324-2
gi.citations.element(missing metadata) doi:10.4233/uuid:5fc08214-3d74-434d-ba02-097d221e26ea
gi.citations.elementDragoş Datcu, Stephan G. Lukosch, Heide K. Lukosch (2016): Handheld Augmented Reality for Distributed Collaborative Crime Scene Investigation, In: Proceedings of the 19th International Conference on Supporting Group Work, doi:10.1145/2957276.2957302
gi.citations.elementMelanie Duckert, Louise Barkhuus, Pernille Bjørn (2023): Collocated Distance: A Fundamental Challenge for the Design of Hybrid Work Technologies, In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3544548.3580899
gi.citations.elementClaire Ancient, Richard Teeuw (2020): Augmented Reality Interface Design to Support Visualisation of ‘Risk Landscapes’, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-49760-6_28
gi.citations.elementAloha Hufana Ambe, Ross Brown, Selen Türkay, Joel Harman, Alessandro Soro (2023): Multifocal Realities with Augmenting Reality: An Exploratory Study with Older Creative Writers, In: Proceedings of the 35th Australian Computer-Human Interaction Conference, doi:10.1145/3638380.3638402
gi.citations.elementCailyn Smith, Terran Mott, Tom Williams (2024): Robot, Take the Joystick: Understanding Space Robotics Experts’ Views on Autonomy, In: 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN), doi:10.1109/ro-man60168.2024.10731167
gi.citations.elementAli Abbas, JoonOh Seo, MinKoo Kim (2020): Impact of Mobile Augmented Reality System on Cognitive Behavior and Performance during Rebar Inspection Tasks, In: Journal of Computing in Civil Engineering 6(34), doi:10.1061/(asce)cp.1943-5487.0000931
gi.citations.elementTaehyun Rhee, Stephen Thompson, Daniel Medeiros, Rafael dos Anjos, Andrew Chalmers (2020): Augmented Virtual Teleportation for High-Fidelity Telecollaboration, In: IEEE Transactions on Visualization and Computer Graphics 5(26), doi:10.1109/tvcg.2020.2973065
gi.citations.elementThomas J. Davidson, Penelope M. Sanderson (2021): A review of the effects of head-worn displays on teamwork for emergency response, In: Ergonomics 2(65), doi:10.1080/00140139.2021.1968041
gi.citations.elementHeide Lukosch, Stephan Lukosch, Simon Hoermann, Robert W. Lindeman (2019): Conceptualizing Fidelity for HCI in Applied Gaming, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-22602-2_14
gi.citations.elementFerran Argelaguet Sanz, Bruno Arnaldi, Jean‐Marie Burkhardt, Géry Casiez, Stéphane Donikian, Florian Gosselin, Xavier Granier, Patrick Le Callet, Vincent Lepetit, Maud Marchal, Guillaume Moreau, Jérôme Perret, Toinon Vigier (2018): Complexity and Scientific Challenges, In: Virtual Reality and Augmented Reality, doi:10.1002/9781119341031.ch3
gi.citations.elementHantao Zhao, Tyler Thrash, Fabian Schläfli, Mubbasir Kapadia, Leonel Aguilar, Dirk Helbing, Christoph Hölscher (2022): Collective Intelligence during Emergency Egress: The Mechanisms Underlying Altruistic Information Exchange, In: International Journal of Human–Computer Interaction 14(39), doi:10.1080/10447318.2022.2087274
gi.citations.elementHendrik Engelbrecht, Stephan G. Lukosch (2018): Viability of Augmented Content for Field Policing, In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct.2018.00111
gi.citations.elementFang You, Qianwen Fu, Jingyan Yang, Huiyan Chen, Wei Cui, Jianmin Wang (2023): Team Situation Awareness-Based Augmented Reality Head-Up Display Design for Security Requirements, In: International Journal of Human–Computer Interaction 18(40), doi:10.1080/10447318.2023.2231281
gi.citations.elementAnne Collins McLaughlin, Laura A. Matalenas, Maribeth Gandy Coleman (2018): Design of human centered augmented reality for managing chronic health conditions, In: Aging, Technology and Health, doi:10.1016/b978-0-12-811272-4.00011-7
gi.citations.elementMatt Whitlock, Keke Wu, Danielle Albers Szafir (2019): Designing for Mobile and Immersive Visual Analytics in the Field, In: IEEE Transactions on Visualization and Computer Graphics, doi:10.1109/tvcg.2019.2934282
gi.citations.elementPanagiotis Kourtesis (2024): A Comprehensive Review of Multimodal XR Applications, Risks, and Ethical Challenges in the Metaverse, In: Multimodal Technologies and Interaction 11(8), doi:10.3390/mti8110098
gi.citations.elementPhilipp Ladwig, Christian Geiger (2018): A Literature Review on Collaboration in Mixed Reality, In: Lecture Notes in Networks and Systems, doi:10.1007/978-3-319-95678-7_65
gi.citations.elementTroels Rasmussen, Kaj Grønbæk, Weidong Huang (2024): Supporting tailorability in augmented reality based remote assistance in the manufacturing industry: A user study, In: Computers & Graphics, doi:10.1016/j.cag.2024.104095
gi.citations.elementJuan Garay-Cortes, Alvaro Uribe-Quevedo (2016): Location-based augmented reality game to engage students in discovering institutional landmarks, In: 2016 7th International Conference on Information, Intelligence, Systems & Applications (IISA), doi:10.1109/iisa.2016.7785433
gi.citations.elementThea Riebe, Julian Bäumler, Marc-André Kaufhold, Christian Reuter (2023): Values and Value Conflicts in the Context of OSINT Technologies for Cybersecurity Incident Response: A Value Sensitive Design Perspective, In: Computer Supported Cooperative Work (CSCW) 2(33), doi:10.1007/s10606-022-09453-4
gi.citations.elementJwawon Seo, Ignacio Avellino, Damaruka Priya Rajasagi, Anita Komlodi, Helena M. Mentis (2022): HoloMentor, In: Proceedings of the ACM on Human-Computer Interaction GROUP(7), doi:10.1145/3567561
gi.citations.elementPeng Wang, Xiaoliang Bai, Mark Billinghurst, Shusheng Zhang, Xiangyu Zhang, Shuxia Wang, Weiping He, Yuxiang Yan, Hongyu Ji (2021): AR/MR Remote Collaboration on Physical Tasks: A Review, In: Robotics and Computer-Integrated Manufacturing, doi:10.1016/j.rcim.2020.102071
gi.citations.elementValentin Bobeica, Dan Popescu, Nicoleta Angelescu, Loretta Ichim (2024): Industrial Teleassistance with the Help of Augmented Reality, In: 2024 23rd RoEduNet Conference: Networking in Education and Research (RoEduNet), doi:10.1109/roedunet64292.2024.10722686
gi.citations.elementFatemeh Banani Ardecani, Amit Kumar, Sepehr Sabeti, Omidreza Shoghli (2025): Neural correlates of augmented reality safety warnings: EEG analysis of situational awareness and cognitive performance in roadway work zones, In: Safety Science, doi:10.1016/j.ssci.2025.106802
gi.citations.elementYan Wang, Heide K. Lukosch, Philipp Schwarz (2019): The Role of Serious Gaming in Assisting Humanitarian Operations, In: International Journal of Information Systems for Crisis Response and Management 1(11), doi:10.4018/ijiscram.2019010102
gi.citations.elementBarrett Ens, Joel Lanir, Anthony Tang, Scott Bateman, Gun Lee, Thammathip Piumsomboon, Mark Billinghurst (2019): Revisiting collaboration through mixed reality: The evolution of groupware, In: International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2019.05.011

Files