Context-Driven Detection of Invertebrate Species in Deep-Sea Video

06/01/2022
by   R. Austin McEver, et al.
0

Each year, underwater remotely operated vehicles (ROVs) collect thousands of hours of video of unexplored ocean habitats revealing a plethora of information regarding biodiversity on Earth. However, fully utilizing this information remains a challenge as proper annotations and analysis require trained scientists time, which is both limited and costly. To this end, we present a Dataset for Underwater Substrate and Invertebrate Analysis (DUSIA), a benchmark suite and growing large-scale dataset to train, validate, and test methods for temporally localizing four underwater substrates as well as temporally and spatially localizing 59 underwater invertebrate species. DUSIA currently includes over ten hours of footage across 25 videos captured in 1080p at 30 fps by an ROV following pre planned transects across the ocean floor near the Channel Islands of California. Each video includes annotations indicating the start and end times of substrates across the video in addition to counts of species of interest. Some frames are annotated with precise bounding box locations for invertebrate species of interest, as seen in Figure 1. To our knowledge, DUSIA is the first dataset of its kind for deep sea exploration, with video from a moving camera, that includes substrate annotations and invertebrate species that are present at significant depths where sunlight does not penetrate. Additionally, we present the novel context-driven object detector (CDD) where we use explicit substrate classification to influence an object detection network to simultaneously predict a substrate and species class influenced by that substrate. We also present a method for improving training on partially annotated bounding box frames. Finally, we offer a baseline method for automating the counting of invertebrate species of interest.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 9

page 14

page 19

page 21

research
06/29/2020

A Benchmark dataset for both underwater image enhancement and underwater object detection

Underwater image enhancement is such an important vision task due to its...
research
07/28/2023

Automated Visual Monitoring of Nocturnal Insects with Light-based Camera Traps

Automatic camera-assisted monitoring of insects for abundance estimation...
research
05/16/2023

Pink-Eggs Dataset V1: A Step Toward Invasive Species Management Using Deep Learning Embedded Solutions

We introduce a novel dataset consisting of images depicting pink eggs th...
research
08/14/2023

Diving with Penguins: Detecting Penguins and their Prey in Animal-borne Underwater Videos via Deep Learning

African penguins (Spheniscus demersus) are an endangered species. Little...
research
06/30/2020

FathomNet: An underwater image training database for ocean exploration and discovery

Thousands of hours of marine video data are collected annually from remo...
research
07/16/2018

Assessing fish abundance from underwater video using deep neural networks

Uses of underwater videos to assess diversity and abundance of fish are ...
research
11/15/2022

Context-Matched Collage Generation for Underwater Invertebrate Detection

The quality and size of training sets often limit the performance of man...

Please sign up or login with your details

Forgot password? Click here to reset