The field of data visualization and multimodal interaction is rapidly evolving, with a focus on creating more intuitive and effective interfaces for users. Recent research has explored the integration of multimodal interaction in visualization authoring tools, highlighting the need for a comprehensive understanding of current practices and future research directions. The concept of cognitive affordances has also been applied to visualization, providing a framework for designing more effective visualizations that communicate information to readers. Additionally, the use of mixed reality and immersive technologies is being investigated for its potential to enhance collaboration, empathy, and social learning. Noteworthy papers in this area include: Characterizing Multimodal Interaction in Visualization Authoring Tools, which provides a systematic perspective on the integration of multimodal interaction in visualization authoring tools. Cognitive Affordances in Visualization, which proposes a framework for designing effective visualizations that communicate information to readers. Merging Bodies, Dividing Conflict, which explores the effects of body-swapping in mixed reality on social interaction and collaboration. Seeing Identity in Data, which investigates the use of anthropographics to uncover racial homophily in emotional responses to data visualizations. Winds Through Time, which describes an interactive exhibit for a public science center on paleoclimate, using a combination of data physicalization and visualization. Textarium, which presents a web-based environment for connecting annotation, abstraction, and argumentation during the interpretation of text. Towards an Embodied Composition Framework, which introduces a framework for organizing immersive computational notebooks. Investigating Seamless Transitions Between Immersive Computational Notebooks and Embodied Data Interactions, which explores the potential of unified environments for improving transition efficiency and intuitiveness during analytical workflows. Nudging the Somas, which examines how live-configurable mixed reality objects can shape open-ended intercorporeal movements. Sensing the Shape of Data, which investigates non-visual exploration of statistical concepts in histograms with blind and low-vision learners.
Advancements in Multimodal Interaction and Data Visualization
Sources
Merging Bodies, Dividing Conflict: Body-Swapping in Mixed Reality Increases Closeness Yet Weakens the Joint Simon Effect
Winds Through Time: Interactive Data Visualization and Physicalization for Paleoclimate Communication
Investigating Seamless Transitions Between Immersive Computational Notebooks and Embodied Data Interactions