Combined Hapto-Visual and Auditory Rendering of Cultural Heritage Objects

by   Praseedha Krishnan Aniyath, et al.

In this work, we develop a multi-modal rendering framework comprising of hapto-visual and auditory data. The prime focus is to haptically render point cloud data representing virtual 3-D models of cultural significance and also to handle their affine transformations. Cultural heritage objects could potentially be very large and one may be required to render the object at various scales of details. Further, surface effects such as texture and friction are incorporated in order to provide a realistic haptic perception to the users. Moreover, the proposed framework includes an appropriate sound synthesis to bring out the acoustic properties of the object. It also includes a graphical user interface with varied options such as choosing the desired orientation of 3-D objects and selecting the desired level of spatial resolution adaptively at runtime. A fast, point proxy-based haptic rendering technique is proposed with proxy update loop running 100 times faster than the required haptic update frequency of 1 kHz. The surface properties are integrated in the system by applying a bilateral filter on the depth data of the virtual 3-D models. Position dependent sound synthesis is incorporated with the incorporation of appropriate audio clips.



There are no comments yet.


page 6

page 9

page 12

page 14


Haptic Rendering of Cultural Heritage Objects at Different Scales

In this work, we address the issue of a virtual representation of object...

Scalable Rendering of Variable Density Point Cloud Data

In this paper, we present a novel proxy-based method of the adaptive hap...

Object-Based Audio Rendering

Apparatus and methods are disclosed for performing object-based audio re...

Spatial resolution of late reverberation in virtual acoustic environments

Late reverberation involves the superposition of many sound reflections ...

Kinetic surface friction rendering for interactive sonification: an initial exploration

Inspired by the role sound and friction play in interactions with everyd...

Rendering of 3D Dynamic Virtual Environments

In this paper we present a framework for the rendering of dynamic 3D vir...

PU-EVA: An Edge Vector based Approximation Solution for Flexible-scale Point Cloud Upsampling

High-quality point clouds have practical significance for point-based re...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.