Evaluation of Information Visualization in Digital Intelligence Product

Ulcej, Dejan; Podlesek, Anja · 2024 · Crossref

DOI: 10.5038/1944-0472.17.4.2264

archive: archived pipeline: cataloged verified

Get this paper ↗ (DOI — opens at the source; we link to it, we don't host it)

Summary

This study investigates the impact of information visualization on the cognitive processing and user experience of intelligence products. Motivated by the increasing volume of data and the need for efficient decision-making in strategic security, the authors sought to determine whether digital intelligence reports utilizing visual representations are processed more efficiently and yield a better user experience than traditional printed, text-heavy reports. The research specifically tested two hypotheses: that digital, visually supported products facilitate more efficient cognitive processing, and that they provide a superior user experience compared to static printed formats. The experimental design involved 72 team leaders from a private company, serving as proxies for political security decision-makers. Participants were randomly assigned to one of two groups: one received a printed intelligence report containing primarily text, while the other accessed an interactive digital version on an iPad Pro that integrated visuals, maps, and navigation features. Both formats presented identical fictitious content regarding a security situation in a fictional country. The study controlled for individual differences by measuring participants’ visuospatial abilities using the Paper-Folding Test and their learning preferences via the Verbalizer-Visualizer Questionnaire. Data collection included timing the report reading and subsequent comprehension tasks, assessing answer accuracy, and evaluating user experience through measures of emotional valence and cognitive load using an adapted NASA-TLX scale. Statistical analysis was performed using Multivariate Analysis of Covariance (MANCOVA) to control for demographic and cognitive style variables. The results demonstrated that the digital intelligence report was processed significantly faster and more efficiently than the printed version. Participants in the digital group read the report more quickly, completed comprehension tasks in less time, and achieved higher accuracy scores, resulting in superior comprehension coefficients. Additionally, the digital group reported more positive emotional responses and lower cognitive load during both reading and decision-making tasks. Despite these performance advantages, the proportion of participants who felt the report lacked sufficient information for making a final decision was identical across both groups (47%). No significant differences were found between the groups regarding control variables such as age, education, or cognitive styles, confirming that the observed effects were attributable to the presentation format. The findings imply that integrating information visualization into digital intelligence products enhances both the efficiency of information processing and the overall user experience for decision-makers. By reducing cognitive load and accelerating comprehension, visual tools can help mitigate the challenges of information overload. The authors conclude that intelligence analysts should prioritize user-centric design, incorporating clear, interactive visuals to support bottom-up and top-down cognitive processes. These recommendations aim to improve the clarity and effectiveness of intelligence reporting, ensuring that decision-makers can derive actionable insights more rapidly and with greater confidence.

Provenance

The full processing record for this entry. Every stage of this paper's journey through the pipeline is logged — what ran, with which tool and model, how many attempts it took, and when it last completed.

Summary generated by qwen3.6-27b-prismaquant on 2026-06-26; verification: verified.

Topics

Ranked by relevance to this paper. Hover a topic for its definition.

• display design