A Primer on Neural Network Models for Natural Language Processing

10/02/2015
by   Yoav Goldberg, et al.
0

Over the past few years, neural networks have re-emerged as powerful machine-learning models, yielding state-of-the-art results in fields such as image recognition and speech processing. More recently, neural network models started to be applied also to textual natural language signals, again with very promising results. This tutorial surveys neural network models from the perspective of natural language processing research, in an attempt to bring natural-language researchers up to speed with the neural techniques. The tutorial covers input encoding for natural language tasks, feed-forward networks, convolutional networks, recurrent networks and recursive networks, as well as the computation graph abstraction for automatic gradient computation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/01/2017

Natural Language Processing with Small Feed-Forward Networks

We show that small and shallow feed-forward neural networks can achieve ...
research
08/19/2020

Compiling ONNX Neural Network Models Using MLIR

Deep neural network models are becoming increasingly popular and have be...
research
02/24/2021

Probing Classifiers: Promises, Shortcomings, and Alternatives

Probing classifiers have emerged as one of the prominent methodologies f...
research
11/26/2020

AutoNLU: An On-demand Cloud-based Natural Language Understanding System for Enterprises

With the renaissance of deep learning, neural networks have achieved pro...
research
12/21/2018

Analysis Methods in Neural Language Processing: A Survey

The field of natural language processing has seen impressive progress in...
research
06/04/2019

Sequential Neural Networks as Automata

This work attempts to explain the types of computation that neural netwo...
research
04/24/2020

Computation on Sparse Neural Networks: an Inspiration for Future Hardware

Neural network models are widely used in solving many challenging proble...

Please sign up or login with your details

Forgot password? Click here to reset