A New Angle on L2 Regularization

06/28/2018

∙

Imagine two high-dimensional clusters and a hyperplane separating them. Consider in particular the angle between: the direction joining the two clusters' centroids and the normal to the hyperplane. In linear classification, this angle depends on the level of L2 regularization used. Can you explain why?

READ FULL TEXT

A New Angle on L2 Regularization

Ordinary Facet Angles of a Stroked Path Tessellated by Uniform Tangent Angle Steps Are Bounded by Twice the Step Angle

Directional distributions and the half-angle principle

Multi-category Angle-based Classifier Refit

Investigating the normal and tangential peeling behaviour of gecko spatulae using a coupled adhesion-friction model

Slopes of 3-dimensional Subshifts of Finite Type

A Bayesian regularization-backpropagation neural network model for peeling computations

Redundancy parameterization and inverse kinematics of 7-DOF revolute manipulators

A New Angle on L2 Regularization

Related Research

Ordinary Facet Angles of a Stroked Path Tessellated by Uniform Tangent Angle Steps Are Bounded by Twice the Step Angle

Directional distributions and the half-angle principle

Multi-category Angle-based Classifier Refit

Investigating the normal and tangential peeling behaviour of gecko spatulae using a coupled adhesion-friction model

Slopes of 3-dimensional Subshifts of Finite Type

A Bayesian regularization-backpropagation neural network model for peeling computations

Redundancy parameterization and inverse kinematics of 7-DOF revolute manipulators