Data visualization systems have become increasingly valuable tools to explore big data sets. While the visual resolution of these systems has increased greatly over time, the use of immersive sound capabilities to augment the presentation of visual data has been widely neglected. This talk focuses on an audio/visual data perceptualization approach that was inspired by cinematic traditions, which builds on a well-balanced mix of diegetic and non-diegetic sounds to create a meaningful atmosphere while guiding the viewer through the film plot. The proposed CineSAID (Cinematic Sonification Artificial Intelligence Display) system focuses on an immersive video screen to create a cinema-like environment with a fixed perspective for the participants. The front-projection video system enables the use of a microperforated screen with 128 loudspeakers placed behind to ensure high audio fidelity. Using bibliographic datasets, the talk highlights the approach to explore the evolution of musical performance venues in the context of cultural and technological developments. Expanding on Digital Object Identifiers (DOIs), the integration of immersive audio-visual data sets into bibliographic references is explored.
Braasch et al. (Wed,) studied this question.