DeepAI AI Chat
Log In Sign Up

POIReviewQA: A Semantically Enriched POI Retrieval and Question Answering Dataset

by   Gengchen Mai, et al.

Many services that perform information retrieval for Points of Interest (POI) utilize a Lucene-based setup with spatial filtering. While this type of system is easy to implement it does not make use of semantics but relies on direct word matches between a query and reviews leading to a loss in both precision and recall. To study the challenging task of semantically enriching POIs from unstructured data in order to support open-domain search and question answering (QA), we introduce a new dataset POIReviewQA. It consists of 20k questions (e.g."is this restaurant dog friendly?") for 1022 Yelp business types. For each question we sampled 10 reviews, and annotated each sentence in the reviews whether it answers the question and what the corresponding answer is. To test a system's ability to understand the text we adopt an information retrieval evaluation by ranking all the review sentences for a question based on the likelihood that they answer this question. We build a Lucene-based baseline model, which achieves 77.0 achieves 79.2 challenging problem for future research by the GIR community. The result technology can help exploit the thematic content of web documents and social media for characterisation of locations.


page 1

page 2

page 3


AmazonQA: A Review-Based Question Answering Task

Every day, thousands of customers post questions on Amazon product pages...

Revisit Semantic Representation and Tree Search for Similar Question Retrieval

In this paper, we study the problem of short sentence ranking for questi...

A survey of SMS based Information Systems

Short Message Service (SMS) based Information Systems (SMSbIS) provide a...

Large Scale Question Paraphrase Retrieval with Smoothed Deep Metric Learning

The goal of a Question Paraphrase Retrieval (QPR) system is to retrieve ...

ReQA: An Evaluation for End-to-End Answer Retrieval Models

Popular QA benchmarks like SQuAD have driven progress on the task of ide...

Learning Rank Functionals: An Empirical Study

Ranking is a key aspect of many applications, such as information retrie...