COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysis

by   Yansong Tang, et al.

There are substantial instructional videos on the Internet, which enables us to acquire knowledge for completing various tasks. However, most existing datasets for instructional video analysis have the limitations in diversity and scale,which makes them far from many real-world applications where more diverse activities occur. Moreover, it still remains a great challenge to organize and harness such data. To address these problems, we introduce a large-scale dataset called "COIN" for COmprehensive INstructional video analysis. Organized with a hierarchical structure, the COIN dataset contains 11,827 videos of 180 tasks in 12 domains (e.g., vehicles, gadgets, etc.) related to our daily life. With a new developed toolbox, all the videos are annotated effectively with a series of step descriptions and the corresponding temporal boundaries. Furthermore, we propose a simple yet effective method to capture the dependencies among different steps, which can be easily plugged into conventional proposal-based action detection methods for localizing important steps in instructional videos. In order to provide a benchmark for instructional video analysis, we evaluate plenty of approaches on the COIN dataset under different evaluation criteria. We expect the introduction of the COIN dataset will promote the future in-depth research on instructional video analysis for the community.


page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 11


Comprehensive Instructional Video Analysis: The COIN Dataset and Performance Evaluation

Thanks to the substantial and explosively inscreased instructional video...

D^2-City: A Large-Scale Dashcam Video Dataset of Diverse Traffic Scenarios

Driving datasets accelerate the development of intelligent driving and r...

Learning Procedure-aware Video Representation from Instructional Videos and Their Narrations

The abundance of instructional videos and their narrations over the Inte...

Actionet: An Interactive End-To-End Platform For Task-Based Data Collection And Augmentation In 3D Environment

The problem of task planning for artificial agents remains largely unsol...

Video Unsupervised Domain Adaptation with Deep Learning: A Comprehensive Survey

Video analysis tasks such as action recognition have received increasing...

The ActivityNet Large-Scale Activity Recognition Challenge 2018 Summary

The 3rd annual installment of the ActivityNet Large- Scale Activity Reco...

Learning To Recognize Procedural Activities with Distant Supervision

In this paper we consider the problem of classifying fine-grained, multi...

Please sign up or login with your details

Forgot password? Click here to reset