Inherent Biases of Recurrent Neural Networks for Phonological Assimilation and Dissimilation

02/23/2017
by   Amanda Doucette, et al.
0

A recurrent neural network model of phonological pattern learning is proposed. The model is a relatively simple neural network with one recurrent layer, and displays biases in learning that mimic observed biases in human learning. Single-feature patterns are learned faster than two-feature patterns, and vowel or consonant-only patterns are learned faster than patterns involving vowels and consonants, mimicking the results of laboratory learning experiments. In non-recurrent models, capturing these biases requires the use of alpha features or some other representation of repeated features, but with a recurrent neural network, these elaborations are not necessary.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2018

Modelling Identity Rules with Neural Networks

In this paper, we show that standard feed-forward and recurrent neural n...
research
07/14/2020

Shuffling Recurrent Neural Networks

We propose a novel recurrent neural network model, where the hidden stat...
research
08/24/2017

CloudScan - A configuration-free invoice analysis system using recurrent neural networks

We present CloudScan; an invoice analysis system that requires zero conf...
research
07/16/2021

Controlling Recurrent Neural Networks by Diagonal Conceptors

The human brain is capable of learning, memorizing, and regenerating a p...
research
10/17/2019

Recurrent Attentive Neural Process for Sequential Data

Neural processes (NPs) learn stochastic processes and predict the distri...
research
06/12/2017

Encoding of phonology in a recurrent neural model of grounded speech

We study the representation and encoding of phonemes in a recurrent neur...
research
03/27/2019

A Multi Hidden Recurrent Neural Network with a Modified Grey Wolf Optimizer

Identifying university students' weaknesses results in better learning a...

Please sign up or login with your details

Forgot password? Click here to reset