Photo-Guided Exploration of Volume Data Features

10/18/2017
by   Mohammad Raji, et al.
0

In this work, we pose the question of whether, by considering qualitative information such as a sample target image as input, one can produce a rendered image of scientific data that is similar to the target. The algorithm resulting from our research allows one to ask the question of whether features like those in the target image exists in a given dataset. In that way, our method is one of imagery query or reverse engineering, as opposed to manual parameter tweaking of the full visualization pipeline. For target images, we can use real-world photographs of physical phenomena. Our method leverages deep neural networks and evolutionary optimization. Using a trained similarity function that measures the difference between renderings of a phenomenon and real-world photographs, our method optimizes rendering parameters. We demonstrate the efficacy of our method using a superstorm simulation dataset and images found online. We also discuss a parallel implementation of our method, which was run on NCSA's Blue Waters.

READ FULL TEXT

page 2

page 7

research
06/09/2021

Deep Direct Volume Rendering: Learning Visual Feature Mappings From Exemplary Images

Volume Rendering is an important technique for visualizing three-dimensi...
research
06/16/2020

Deep Multimodal Transfer-Learned Regression in Data-Poor Domains

In many real-world applications of deep learning, estimation of a target...
research
07/09/2019

Efficient Cloth Simulation using Miniature Cloth and Upscaling Deep Neural Networks

Cloth simulation requires a fast and stable method for interactively and...
research
10/23/2022

Photo-realistic Neural Domain Randomization

Synthetic data is a scalable alternative to manual supervision, but it r...
research
05/25/2018

A Study of Question Effectiveness Using Reddit "Ask Me Anything" Threads

Asking effective questions is a powerful social skill. In this paper we ...
research
03/24/2023

Search By Image: Deeply Exploring Beneficial Features for Beauty Product Retrieval

Searching by image is popular yet still challenging due to the extensive...
research
04/13/2023

How Will It Drape Like? Capturing Fabric Mechanics from Depth Images

We propose a method to estimate the mechanical parameters of fabrics usi...

Please sign up or login with your details

Forgot password? Click here to reset