DeepAI AI Chat
Log In Sign Up

Stay On-Topic: Generating Context-specific Fake Restaurant Reviews

by   Mika Juuti, et al.
Association for Computing Machinery
National Institute of Information and Communications Technology

Automatically generated fake restaurant reviews are a threat to online review systems. Recent research has shown that users have difficulties in detecting machine-generated fake reviews hiding among real restaurant reviews. The method used in this work (char-LSTM ) has one drawback: it has difficulties staying in context, i.e. when it generates a review for specific target entity, the resulting review may contain phrases that are unrelated to the target, thus increasing its detectability. In this work, we present and evaluate a more sophisticated technique based on neural machine translation (NMT) with which we can generate reviews that stay on-topic. We test multiple variants of our technique using native English speakers on Amazon Mechanical Turk. We demonstrate that reviews generated by the best variant have almost optimal undetectability (class-averaged F-score 47 skeptical users and show that our method evades detection more frequently compared to the state-of-the-art (average evasion 3.2/4 vs 1.5/4) with statistical significance, at level α = 1 effective detection tools and reach average F-score of 97 these. Although fake reviews are very effective in fooling people, effective automatic detection is still feasible.


Detecting Singleton Review Spammers Using Semantic Similarity

Online reviews have increasingly become a very important resource for co...

Impact of Sentiment Analysis in Fake Review Detection

Fake review identification is an important topic and has gained the inte...

Subgroup Fairness in Graph-based Spam Detection

Fake reviews are prevalent on review websites such as Amazon and Yelp. G...

Amazon Fake Reviews

Often, there are suspicious Amazon reviews that seem to be excessively p...

Fact or Factitious? Contextualized Opinion Spam Detection

In this paper we perform an analytic comparison of a number of technique...

Opinion Fraud Detection via Neural Autoencoder Decision Forest

Online reviews play an important role in influencing buyers' daily purch...