Providing Information on the Spot: Using Augmented Reality for Situational Awareness in the Security Domain
Loading...
Fulltext URI
Document type
Text/Journal Article
Additional Information
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Abstract
For operational units in the security domain that work together in teams, it is important to quickly and adequately exchange context-related information to ensure well-working collaboration. Currently, most information exchange is based on oral communication. This paper reports on different scenarios from the security domain in which augmented reality (AR) techniques are used to support such information exchange. The scenarios have been designed with a User Centred Design approach, in order to make the scenarios as realistic as possible. To support these scenarios, an AR system has been developed and evaluated in two rounds. In the first round, the usability and feasibility of the AR support has been evaluated with experts from different operational units in the security domain. The second evaluation round then focussed on the effect of AR on collaboration and situational awareness within the expert teams. With regard to the usability and feasibility of AR, the evaluation shows that the scenarios are well defined and the AR system can successfully support information exchange in teams operating in the security domain. The second evaluation round showed that AR can especially improve the situational awareness of remote colleagues not physically present at a scene.
Description
Keywords
Augmented reality, Collaboration quality, Information exchange, Situational awareness, Usability
Citation
URI
Collections
Endorsement
Review
Supplemented By
Referenced By
Number of citations to item: 52
- Julia Woodward, Jaime Ruiz (2023): Analytic Review of Using Augmented Reality for Situational Awareness, In: IEEE Transactions on Visualization and Computer Graphics 4(29), doi:10.1109/tvcg.2022.3141585
- Kumaragurubaran T, M. Vasundhara Devi, S. SenthilPandi, M. Tharun (2023): Exploring Extended Reality (XR) in the Workplace - Applications, Challenges: Survey, In: 2023 International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE), doi:10.1109/rmkmate59243.2023.10369447
- Konstantinos Konstantoudakis, Kyriaki Christaki, Dimitrios Tsiakmakis, Dimitrios Sainidis, Georgios Albanis, Anastasios Dimou, Petros Daras (2022): Drone Control in AR: An Intuitive System for Single-Handed Gesture Control, Drone Tracking, and Contextualized Camera Feed Visualization in Augmented Reality, In: Drones 2(6), doi:10.3390/drones6020043
- Michael Prilla, Lisa M. Ruhmann (2018): An Analysis Tool for Cooperative Mixed Reality Scenarios, In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct.2018.00026
- Doris Aschenbrenner, Florian Leutert, Argun Çençen, Jouke Verlinden, Klaus Schilling, Marc Latoschik, Stephan Lukosch (2019): Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial Robots, In: Frontiers in Robotics and AI, doi:10.3389/frobt.2019.00037
- Hossein Salimian, Stephen Brooks, Derek Reilly (2019): MP Remix, In: Proceedings of the ACM on Human-Computer Interaction CSCW(3), doi:10.1145/3359207
- Brita Munsinger, Nicole Beebe, Turquoise Richardson (2023): Virtual reality for improving cyber situational awareness in security operations centers, In: Computers & Security, doi:10.1016/j.cose.2023.103368
- Sarah Lehman, Jenna Graves, Carlene Mcaleer, Tania Giovannetti, Chiu C. Tan (2018): A Mobile Augmented Reality Game to Encourage Hydration in the Elderly, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-92046-7_9
- Satu Rantakokko (2022): Data Handling Process in Extended Reality (XR) When Delivering Technical Instructions, In: Technical Communication 2(69), doi:10.55177/tc734125
- Thomas Wells, Dominic Potts, Steven Houben (2022): A Study into the Effect of Mobile Device Configurations on Co-Located Collaboration using AR, In: Proceedings of the ACM on Human-Computer Interaction MHCI(6), doi:10.1145/3546735
- Meng Li, Tom Slijkhuis, Remko Huigen, Armagan Albayrak, Daan van Eijk (2021): Two-way Augmented Reality Co-location Under Telemedicine Context, In: 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct54149.2021.00121
- Thomas Wells, Steven Houben (2020): CollabAR Investigating the Mediating Role of Mobile AR Interfaces on Co-Located Group Collaboration, In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3313831.3376541
- Nitin Sukhija, Cory Haser, Elizabeth Bautista (2019): Employing Augmented Reality for Cybersecurity Operations in High Performance Computing Environments, In: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning), doi:10.1145/3332186.3333160
- Julia Bräker, Anna Osterbrink, Martin Semmann, Manuel Wiesche (2022): User-Centered Requirements for Augmented Reality as a Cognitive Assistant for Safety-Critical Services, In: Business & Information Systems Engineering 2(65), doi:10.1007/s12599-022-00779-3
- Aaron Rowen, Martha Grabowski, Jean-Philippe Rancy (2021): Moving and improving in safety-critical systems: Impacts of head-mounted displays on operator mobility, performance, and situation awareness, In: International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2021.102606
- Christian Reuter, Thomas Ludwig, Patrick Mischur (2018): RescueGlass: Collaborative Applications involving Head-Mounted Displays for Red Cross Rescue Dog Units, In: Computer Supported Cooperative Work (CSCW) 1-2(28), doi:10.1007/s10606-018-9339-8
- Marina A. Cidota, Dragos Datcu (2020): Remote Assistance System in Augmented Reality for Early School Dropout Prevention, In: 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct51615.2020.00091
- Hendrik Engelbrecht, Stephan Lukosch (2020): Dangerous or Desirable: Utilizing Augmented Content for Field Policing, In: International Journal of Human–Computer Interaction 15(36), doi:10.1080/10447318.2020.1752473
- Heide K. Lukosch, Geertje Bekebrede, Shalini Kurapati, Stephan G. Lukosch (2018): A Scientific Foundation of Simulation Games for the Analysis and Design of Complex Systems, In: Simulation & Gaming 3(49), doi:10.1177/1046878118768858
- Julia Woodward, Jesse Smith, Isaac Wang, Sofia Cuenca, Jaime Ruiz (2020): Examining the Presentation of Information in Augmented Reality Headsets for Situational Awareness, In: Proceedings of the International Conference on Advanced Visual Interfaces, doi:10.1145/3399715.3399846
- Marina Cidota, Stephan Lukosch, Dragos Datcu, Heide Lukosch (2016): Comparing the Effect of Audio and Visual Notifications on Workspace Awareness Using Head-Mounted Displays for Remote Collaboration in Augmented Reality, In: Augmented Human Research 1(1), doi:10.1007/s41133-016-0003-x
- Felipe Fernandez, Angel Sanchez, Jose F. Velez, Belen Moreno (2017): A Cognitive Architecture Framework for Critical Situation Awareness Systems, In: Lecture Notes in Computer Science, doi:10.1007/978-3-319-59740-9_6
- Julia Woodward, Jesse Smith, Isaac Wang, Sofia Cuenca, Jaime Ruiz (2023): Designing Critical and Secondary Information in Augmented Reality Headsets for Situational Awareness, In: Journal of Engineering Research and Sciences 3(2), doi:10.55708/js0203001
- Lee Kent, Chris Snider, James Gopsill, Ben Hicks (2021): Mixed reality in design prototyping: A systematic review, In: Design Studies, doi:10.1016/j.destud.2021.101046
- Seungwon Kim, Mark Billinghurst, Gun Lee (2018): The Effect of Collaboration Styles and View Independence on Video-Mediated Remote Collaboration, In: Computer Supported Cooperative Work (CSCW) 3-6(27), doi:10.1007/s10606-018-9324-2
- (missing metadata) doi:10.4233/uuid:5fc08214-3d74-434d-ba02-097d221e26ea
- Dragoş Datcu, Stephan G. Lukosch, Heide K. Lukosch (2016): Handheld Augmented Reality for Distributed Collaborative Crime Scene Investigation, In: Proceedings of the 19th International Conference on Supporting Group Work, doi:10.1145/2957276.2957302
- Melanie Duckert, Louise Barkhuus, Pernille Bjørn (2023): Collocated Distance: A Fundamental Challenge for the Design of Hybrid Work Technologies, In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, doi:10.1145/3544548.3580899
- Claire Ancient, Richard Teeuw (2020): Augmented Reality Interface Design to Support Visualisation of ‘Risk Landscapes’, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-49760-6_28
- Aloha Hufana Ambe, Ross Brown, Selen Türkay, Joel Harman, Alessandro Soro (2023): Multifocal Realities with Augmenting Reality: An Exploratory Study with Older Creative Writers, In: Proceedings of the 35th Australian Computer-Human Interaction Conference, doi:10.1145/3638380.3638402
- Cailyn Smith, Terran Mott, Tom Williams (2024): Robot, Take the Joystick: Understanding Space Robotics Experts’ Views on Autonomy, In: 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN), doi:10.1109/ro-man60168.2024.10731167
- Ali Abbas, JoonOh Seo, MinKoo Kim (2020): Impact of Mobile Augmented Reality System on Cognitive Behavior and Performance during Rebar Inspection Tasks, In: Journal of Computing in Civil Engineering 6(34), doi:10.1061/(asce)cp.1943-5487.0000931
- Taehyun Rhee, Stephen Thompson, Daniel Medeiros, Rafael dos Anjos, Andrew Chalmers (2020): Augmented Virtual Teleportation for High-Fidelity Telecollaboration, In: IEEE Transactions on Visualization and Computer Graphics 5(26), doi:10.1109/tvcg.2020.2973065
- Thomas J. Davidson, Penelope M. Sanderson (2021): A review of the effects of head-worn displays on teamwork for emergency response, In: Ergonomics 2(65), doi:10.1080/00140139.2021.1968041
- Heide Lukosch, Stephan Lukosch, Simon Hoermann, Robert W. Lindeman (2019): Conceptualizing Fidelity for HCI in Applied Gaming, In: Lecture Notes in Computer Science, doi:10.1007/978-3-030-22602-2_14
- Ferran Argelaguet Sanz, Bruno Arnaldi, Jean‐Marie Burkhardt, Géry Casiez, Stéphane Donikian, Florian Gosselin, Xavier Granier, Patrick Le Callet, Vincent Lepetit, Maud Marchal, Guillaume Moreau, Jérôme Perret, Toinon Vigier (2018): Complexity and Scientific Challenges, In: Virtual Reality and Augmented Reality, doi:10.1002/9781119341031.ch3
- Hantao Zhao, Tyler Thrash, Fabian Schläfli, Mubbasir Kapadia, Leonel Aguilar, Dirk Helbing, Christoph Hölscher (2022): Collective Intelligence during Emergency Egress: The Mechanisms Underlying Altruistic Information Exchange, In: International Journal of Human–Computer Interaction 14(39), doi:10.1080/10447318.2022.2087274
- Hendrik Engelbrecht, Stephan G. Lukosch (2018): Viability of Augmented Content for Field Policing, In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), doi:10.1109/ismar-adjunct.2018.00111
- Fang You, Qianwen Fu, Jingyan Yang, Huiyan Chen, Wei Cui, Jianmin Wang (2023): Team Situation Awareness-Based Augmented Reality Head-Up Display Design for Security Requirements, In: International Journal of Human–Computer Interaction 18(40), doi:10.1080/10447318.2023.2231281
- Anne Collins McLaughlin, Laura A. Matalenas, Maribeth Gandy Coleman (2018): Design of human centered augmented reality for managing chronic health conditions, In: Aging, Technology and Health, doi:10.1016/b978-0-12-811272-4.00011-7
- Matt Whitlock, Keke Wu, Danielle Albers Szafir (2019): Designing for Mobile and Immersive Visual Analytics in the Field, In: IEEE Transactions on Visualization and Computer Graphics, doi:10.1109/tvcg.2019.2934282
- Panagiotis Kourtesis (2024): A Comprehensive Review of Multimodal XR Applications, Risks, and Ethical Challenges in the Metaverse, In: Multimodal Technologies and Interaction 11(8), doi:10.3390/mti8110098
- Philipp Ladwig, Christian Geiger (2018): A Literature Review on Collaboration in Mixed Reality, In: Lecture Notes in Networks and Systems, doi:10.1007/978-3-319-95678-7_65
- Troels Rasmussen, Kaj Grønbæk, Weidong Huang (2024): Supporting tailorability in augmented reality based remote assistance in the manufacturing industry: A user study, In: Computers & Graphics, doi:10.1016/j.cag.2024.104095
- Juan Garay-Cortes, Alvaro Uribe-Quevedo (2016): Location-based augmented reality game to engage students in discovering institutional landmarks, In: 2016 7th International Conference on Information, Intelligence, Systems & Applications (IISA), doi:10.1109/iisa.2016.7785433
- Thea Riebe, Julian Bäumler, Marc-André Kaufhold, Christian Reuter (2023): Values and Value Conflicts in the Context of OSINT Technologies for Cybersecurity Incident Response: A Value Sensitive Design Perspective, In: Computer Supported Cooperative Work (CSCW) 2(33), doi:10.1007/s10606-022-09453-4
- Jwawon Seo, Ignacio Avellino, Damaruka Priya Rajasagi, Anita Komlodi, Helena M. Mentis (2022): HoloMentor, In: Proceedings of the ACM on Human-Computer Interaction GROUP(7), doi:10.1145/3567561
- Peng Wang, Xiaoliang Bai, Mark Billinghurst, Shusheng Zhang, Xiangyu Zhang, Shuxia Wang, Weiping He, Yuxiang Yan, Hongyu Ji (2021): AR/MR Remote Collaboration on Physical Tasks: A Review, In: Robotics and Computer-Integrated Manufacturing, doi:10.1016/j.rcim.2020.102071
- Valentin Bobeica, Dan Popescu, Nicoleta Angelescu, Loretta Ichim (2024): Industrial Teleassistance with the Help of Augmented Reality, In: 2024 23rd RoEduNet Conference: Networking in Education and Research (RoEduNet), doi:10.1109/roedunet64292.2024.10722686
- Fatemeh Banani Ardecani, Amit Kumar, Sepehr Sabeti, Omidreza Shoghli (2025): Neural correlates of augmented reality safety warnings: EEG analysis of situational awareness and cognitive performance in roadway work zones, In: Safety Science, doi:10.1016/j.ssci.2025.106802
- Yan Wang, Heide K. Lukosch, Philipp Schwarz (2019): The Role of Serious Gaming in Assisting Humanitarian Operations, In: International Journal of Information Systems for Crisis Response and Management 1(11), doi:10.4018/ijiscram.2019010102
- Barrett Ens, Joel Lanir, Anthony Tang, Scott Bateman, Gun Lee, Thammathip Piumsomboon, Mark Billinghurst (2019): Revisiting collaboration through mixed reality: The evolution of groupware, In: International Journal of Human-Computer Studies, doi:10.1016/j.ijhcs.2019.05.011