In this demo, we showcase a system that applies extended reality (XR) and volumetric video to enhance cultural experiences. The platform enables real-time interaction between users and a presenter within a virtual environment enriched with 3D assets. Users can visualize a volumetric representation of the presenter captured in real-time using a Free Viewpoint Video (FVV) system. Additionally, the presenter can control the elements in the scene using hand gestures, recognized by an artificial intelligence (AI) model. We propose a methodology to assess the subjective quality of this experience through user studies. The complete system will be demonstrated, including the real-time volumetric capture and the immersive application to participate in the cultural experience.
In this demo, we showcase a system that applies extended reality (XR) and volumetric video to enhance cultural experiences. The platform enables real-time interaction between users and a presenter within a virtual environment enriched with 3D assets. Users can visualize a volumetric representation of the presenter captured in real-time using a Free Viewpoint Video (FVV) system. Additionally, the presenter can control the elements in the scene using hand gestures, recognized by an artificial intelligence (AI) model. We propose a methodology to assess the subjective quality of this experience through user studies. The complete system will be demonstrated, including the real-time volumetric capture and the immersive application to participate in the cultural experience. Read More
Related posts:
Is Real-time Deep Learning-based Monocular Depth Estimation accurate for Multi-Camera Setups?
A Virtual Reality Application for Fostering Interest in Art
ASSIST: A Multi-Agentic Framework for Human Computer Interaction in Cultural Heritage settings
AR/VR headset market reaching ‘critical tipping point’
8×8 lines up for Southampton FC to boost customer experience
Electronic Skin for Virtual Sensation Generation in Immersive Virtual and Augmented Reality