Metrics for Evaluating Cyber Security Data Visualizations in Virtual Reality

Daniel Harris, Marius Miknis, Connor Smith, Ian Wilson

    Research output: Contribution to journalArticlepeer-review

    Abstract

    Cyber security analysts use data visualizations to speed up ingestion of security data. These visualizations typically take the form of 2D graphics displayed on computer monitors. Virtual reality has the potential to improve these visualizations with immersive 3D environments and unique interaction mechanics. However, research into this newly synergised area lacks evaluation, leading to unfounded claims of effectiveness. A potential cause for these missing evaluations was identified as a lack of guidance detailing how evaluations should be conducted in this area. Additionally, the small amount of research that does include evaluation incorrectly relies on subjective participant opinions to objectively measure system effectiveness. An example of this misuse is asking participants which system they thought was quicker, rather than timing them. The objective of this paper was to propose a solution to these issues in the form of a surveyed, categorised, and analysed set of evaluation metrics. A total of 49 metrics were identified from 41 papers. The presented metrics detail which dependent variables should be considered when evaluating works in the combined fields of cyber security, data visualization, and virtual reality. These metrics can be used to produce more accurate evaluations in future works in this area.
    Original languageEnglish
    Pages (from-to)1-36
    Number of pages36
    JournalPRESENCE: Virtual and Augmented Reality
    Volume30
    Issue number1
    DOIs
    Publication statusPublished - 11 Jan 2023

    Fingerprint

    Dive into the research topics of 'Metrics for Evaluating Cyber Security Data Visualizations in Virtual Reality'. Together they form a unique fingerprint.

    Cite this