NICE 2023 Zero-shot Image Captioning Challenge

09/05/2023
by   Taehoon Kim, et al.
0

In this report, we introduce NICE project[<https://nice.lgresearch.ai/>] and share the results and outcomes of NICE challenge 2023. This project is designed to challenge the computer vision community to develop robust image captioning models that advance the state-of-the-art both in terms of accuracy and fairness. Through the challenge, the image captioning models were tested using a new evaluation dataset that includes a large variety of visual concepts from many domains. There was no specific training data provided for the challenge, and therefore the challenge entries were required to adapt to new types of image descriptions that had not been seen during training. This report includes information on the newly proposed NICE dataset, evaluation methods, challenge results, and technical details of top-ranking entries. We expect that the outcomes of the challenge will contribute to the improvement of AI models on various vision-language tasks.

READ FULL TEXT

page 2

page 4

page 6

page 8

research
05/13/2018

Image Captioning

This paper discusses and demonstrates the outcomes from our experimentat...
research
11/13/2022

Large-Scale Bidirectional Training for Zero-Shot Image Captioning

When trained on large-scale datasets, image captioning models can unders...
research
07/31/2019

Image Captioning with Unseen Objects

Image caption generation is a long standing and challenging problem at t...
research
11/24/2021

Scaling Up Vision-Language Pre-training for Image Captioning

In recent years, we have witnessed significant performance boost in the ...
research
02/11/2023

See Your Heart: Psychological states Interpretation through Visual Creations

In psychoanalysis, generating interpretations to one's psychological sta...
research
12/06/2022

Adaptive Testing of Computer Vision Models

Vision models often fail systematically on groups of data that share com...
research
09/30/2020

Creative Captioning: An AI Grand Challenge Based on the Dixit Board Game

We propose a new class of "grand challenge" AI problems that we call cre...

Please sign up or login with your details

Forgot password? Click here to reset