DeepAI AI Chat
Log In Sign Up

Let's Talk! Striking Up Conversations via Conversational Visual Question Generation

05/19/2022
by   Shih-Han Chan, et al.
Penn State University
Academia Sinica
0

An engaging and provocative question can open up a great conversation. In this work, we explore a novel scenario: a conversation agent views a set of the user's photos (for example, from social media platforms) and asks an engaging question to initiate a conversation with the user. The existing vision-to-question models mostly generate tedious and obvious questions, which might not be ideals conversation starters. This paper introduces a two-phase framework that first generates a visual story for the photo set and then uses the story to produce an interesting question. The human evaluation shows that our framework generates more response-provoking questions for starting conversations than other vision-to-question baselines.

READ FULL TEXT

page 1

page 3

page 6

01/28/2017

Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation

The popularity of image sharing on social media and the engagement it cr...
06/17/2019

Interconnected Question Generation with Coreference Alignment and Conversation Flow Modeling

We study the problem of generating interconnected questions in question-...
12/03/2019

Knowledge-Enriched Visual Storytelling

Stories are diverse and highly personalized, resulting in a large possib...
07/02/2022

INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactions

In an information-seeking conversation, a user converses with an agent t...
06/09/2017

Assigning personality/identity to a chatting machine for coherent conversation generation

Endowing a chatbot with personality or an identity is quite challenging ...
09/26/2020

Modeling Dyadic Conversations for Personality Inference

Nowadays, automatical personality inference is drawing extensive attenti...
03/19/2020

QnAMaker: Data to Bot in 2 Minutes

Having a bot for seamless conversations is a much-desired feature that p...