Parameter estimation in softmax decision-making models with linear objective functions

02/16/2015
by   Paul Reverdy, et al.
0

With an eye towards human-centered automation, we contribute to the development of a systematic means to infer features of human decision-making from behavioral data. Motivated by the common use of softmax selection in models of human decision-making, we study the maximum likelihood parameter estimation problem for softmax decision-making models with linear objective functions. We present conditions under which the likelihood function is convex. These allow us to provide sufficient conditions for convergence of the resulting maximum likelihood estimator and to construct its asymptotic distribution. In the case of models with nonlinear objective functions, we show how the estimator can be applied by linearizing about a nominal parameter value. We apply the estimator to fit the stochastic UCL (Upper Credible Limit) model of human decision-making to human subject data. We show statistically significant differences in behavior across related, but distinct, tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/11/2018

Maximum likelihood estimation in hidden Markov models with inhomogeneous noise

We consider parameter estimation in hidden finite state space Markov mod...
research
05/06/2020

Maximum Likelihood Methods for Inverse Learning of Optimal Controllers

This paper presents a framework for inverse learning of objective functi...
research
06/03/2018

Data-Free/Data-Sparse Softmax Parameter Estimation with Structured Class Geometries

This note considers softmax parameter estimation when little/no labeled ...
research
10/27/2020

The Efficiency Gap

Parameter estimation via M- and Z-estimation is broadly considered to be...
research
05/19/2017

Softmax Q-Distribution Estimation for Structured Prediction: A Theoretical Interpretation for RAML

Reward augmented maximum likelihood (RAML), a simple and effective learn...
research
03/24/2018

The Importance of Constraint Smoothness for Parameter Estimation in Computational Cognitive Modeling

Psychiatric neuroscience is increasingly aware of the need to define psy...
research
07/27/2022

A Geometric Approach to Passive Localisation

In this paper, we present a geometric framework for the passive localisa...

Please sign up or login with your details

Forgot password? Click here to reset