Log In Sign Up

Translation, Sentiment and Voices: A Computational Model to Translate and Analyse Voices from Real-Time Video Calling

by   Aneek Barman Roy, et al.

With internet quickly becoming an easy access to many, voice calling over internet is slowly gaining momentum. Individuals has been engaging in video communication across the world in different languages. The decade saw the emergence of language translation using neural networks as well. With more data being generated in audio and visual forms, there has become a need and a challenge to analyse such information for many researchers from academia and industry. The availability of video chat corpora is limited as organizations protect user privacy and ensure data security. For this reason, an audio-visual communication system (VidALL) has been developed and audio-speeches were extracted. To understand human nature while answering a video call, an analysis was conducted where polarity and vocal intensity were considered as parameters. Simultaneously, a translation model using a neural approach was developed to translate English sentences to French. Simple RNN-based and Embedded-RNN based models were used for the translation model. BLEU score and target sentence comparators were used to check sentence correctness. Embedded-RNN showed an accuracy of 88.71 percentage and predicted correct sentences. A key finding suggest that polarity is a good estimator to understand human emotion.


page 1

page 2

page 3

page 4


Hindi to English Transfer Based Machine Translation System

In large societies like India there is a huge demand to convert one huma...

The Improvement of Negative Sentences Translation in English-to-Korean Machine Translation

This paper describes the algorithm for translating English negative sent...

Real-Time Statistical Speech Translation

This research investigates the Statistical Machine Translation approache...

Emergent Translation in Multi-Agent Communication

While most machine translation systems to date are trained on large para...

Phrase-Based & Neural Unsupervised Machine Translation

Machine translation systems achieve near human-level performance on some...

Simultaneous Machine Translation with Visual Context

Simultaneous machine translation (SiMT) aims to translate a continuous i...

AudioViewer: Learning to Visualize Sound

Sensory substitution can help persons with perceptual deficits. In this ...