DeepAI AI Chat
Log In Sign Up

Semantic Comparison of State-of-the-Art Deep Learning Methods for Image Multi-Label Classification

by   Adam Kubany, et al.
Ben-Gurion University of the Negev

Image understanding relies heavily on accurate multi-label classification. In recent years deep learning (DL) algorithms have become very successful tools for multi-label classification of image objects. With these set of tools, various implementations of DL algorithms for multi-label classification have been published for the public use in the form of application programming interfaces (API). In this study, we evaluate and compare 10 of the most prominent publicly available APIs in a best-of-breed challenge. The evaluation of the various APIs is performed on the Visual Genome labeling benchmark dataset using 12 well-recognized similarity metrics. Additionally, for the first time in this kind of comparison, we use a semantic similarity metric to evaluate the semantic similarity performance. In this evaluation, Microsoft Computer Vision, IBM Visual Recognition, and Imagga APIs show better performance than the other APIs.


Similarity-based Multi-label Learning

Multi-label classification is an important learning problem with many ap...

Cross-Modality Attention with Semantic Graph Embedding for Multi-Label Classification

Multi-label image and video classification are fundamental yet challengi...

Sewer-ML: A Multi-Label Sewer Defect Classification Dataset and Benchmark

Perhaps surprisingly sewerage infrastructure is one of the most costly i...

Multi-label Methods for Prediction with Sequential Data

The number of methods available for classification of multi-label data h...

Multi-label Classification of Common Bengali Handwritten Graphemes: Dataset and Challenge

Latin has historically led the state-of-the-art in handwritten optical c...

FrugalMCT: Efficient Online ML API Selection for Multi-Label Classification Tasks

Multi-label classification tasks such as OCR and multi-object recognitio...