DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks

10/30/2014
by   Tao Chen, et al.
0

This paper introduces a visual sentiment concept classification method based on deep convolutional neural networks (CNNs). The visual sentiment concepts are adjective noun pairs (ANPs) automatically discovered from the tags of web photos, and can be utilized as effective statistical cues for detecting emotions depicted in the images. Nearly one million Flickr images tagged with these ANPs are downloaded to train the classifiers of the concepts. We adopt the popular model of deep convolutional neural networks which recently shows great performance improvement on classifying large-scale web-based image dataset such as ImageNet. Our deep CNNs model is trained based on Caffe, a newly developed deep learning framework. To deal with the biased training data which only contains images with strong sentiment and to prevent overfitting, we initialize the model with the model weights trained from ImageNet. Performance evaluation shows the newly trained deep CNNs model SentiBank 2.0 (or called DeepSentiBank) is significantly improved in both annotation accuracy and retrieval performance, compared to its predecessors which mainly use binary SVM classification models.

READ FULL TEXT

page 3

page 5

research
11/21/2014

Visual Sentiment Prediction with Deep Convolutional Neural Networks

Images have become one of the most popular types of media through which ...
research
01/07/2019

Tencent ML-Images: A Large-Scale Multi-Label Image Database for Visual Representation Learning

In existing visual representation learning tasks, deep convolutional neu...
research
12/19/2013

Some Improvements on Deep Convolutional Neural Network Based Image Classification

We investigate multiple techniques to improve upon the current state of ...
research
11/11/2019

Learning From Brains How to Regularize Machines

Despite impressive performance on numerous visual tasks, Convolutional N...
research
04/06/2019

Effective and Efficient Dropout for Deep Convolutional Neural Networks

Machine-learning-based data-driven applications have become ubiquitous, ...
research
04/12/2016

From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction

Visual multimedia have become an inseparable part of our digital social ...
research
10/16/2017

Convolutional neural networks for structured omics: OmicsCNN and the OmicsConv layer

Convolutional Neural Networks (CNNs) are a popular deep learning archite...

Please sign up or login with your details

Forgot password? Click here to reset