SAM-GCNN: A Gated Convolutional Neural Network with Segment-Level Attention Mechanism for Home Activity Monitoring

10/03/2018
by   Yu-Han Shen, et al.
0

In this paper, we propose a method for home activity monitoring. We demonstrate our model on dataset of Detection and Classification of Acoustic Scenes and Events (DCASE) 2018 Challenge Task 5. This task aims to classify multi-channel audios into one of the provided pre-defined classes. All of these classes are daily activities performed in a home environment. To tackle this task, we propose a gated convolutional neural network with segment-level attention mechanism (SAM-GCNN). The proposed framework is a convolutional model with two auxiliary modules: a gated convolutional neural network and a segment-level attention mechanism. Furthermore, we adopted model ensemble to enhance the capability of generalization of our model. We evaluated our work on the development dataset of DCASE 2018 Task 5 and achieved competitive performance, with a macro-averaged F-1 score increasing from 83.76 compared with the convolutional baseline system.

READ FULL TEXT
research
12/11/2018

DCASE 2018 Challenge: Solution for Task 5

To address Task 5 in the Detection and Classification of Acoustic Scenes...
research
11/04/2020

A Multi-Channel Temporal Attention Convolutional Neural Network Model for Environmental Sound Classification

Recently, many attention-based deep neural networks have emerged and ach...
research
01/13/2021

geoGAT: Graph Model Based on Attention Mechanism for Geographic Text Classification

In the area of geographic information processing. There are few research...
research
06/09/2023

Domestic Activities Classification from Audio Recordings Using Multi-scale Dilated Depthwise Separable Convolutional Network

Domestic activities classification (DAC) from audio recordings aims at c...
research
04/20/2018

Generating Descriptions from Structured Data Using a Bifocal Attention Mechanism and Gated Orthogonalization

In this work, we focus on the task of generating natural language descri...
research
04/16/2020

Speech Paralinguistic Approach for Detecting Dementia Using Gated Convolutional Neural Network

We propose a non-invasive and cost-effective method to automatically det...
research
03/24/2022

Score difficulty analysis for piano performance education based on fingering

In this paper, we introduce score difficulty classification as a sub-tas...

Please sign up or login with your details

Forgot password? Click here to reset