DeepAI AI Chat
Log In Sign Up

Let's Talk! Striking Up Conversations via Conversational Visual Question Generation

by   Shih-Han Chan, et al.
Penn State University
Academia Sinica

An engaging and provocative question can open up a great conversation. In this work, we explore a novel scenario: a conversation agent views a set of the user's photos (for example, from social media platforms) and asks an engaging question to initiate a conversation with the user. The existing vision-to-question models mostly generate tedious and obvious questions, which might not be ideals conversation starters. This paper introduces a two-phase framework that first generates a visual story for the photo set and then uses the story to produce an interesting question. The human evaluation shows that our framework generates more response-provoking questions for starting conversations than other vision-to-question baselines.


page 1

page 3

page 6


Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation

The popularity of image sharing on social media and the engagement it cr...

Interconnected Question Generation with Coreference Alignment and Conversation Flow Modeling

We study the problem of generating interconnected questions in question-...

Knowledge-Enriched Visual Storytelling

Stories are diverse and highly personalized, resulting in a large possib...

INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactions

In an information-seeking conversation, a user converses with an agent t...

Assigning personality/identity to a chatting machine for coherent conversation generation

Endowing a chatbot with personality or an identity is quite challenging ...

Modeling Dyadic Conversations for Personality Inference

Nowadays, automatical personality inference is drawing extensive attenti...

QnAMaker: Data to Bot in 2 Minutes

Having a bot for seamless conversations is a much-desired feature that p...