Using Experts' Opinions in Machine Learning Tasks

08/10/2020
by   Amir Fazelinia, et al.
0

In machine learning tasks, especially in the tasks of prediction, scientists tend to rely solely on available historical data and disregard unproven insights, such as experts' opinions, polls, and betting odds. In this paper, we propose a general three-step framework for utilizing experts' insights in machine learning tasks and build four concrete models for a sports game prediction case study. For the case study, we have chosen the task of predicting NCAA Men's Basketball games, which has been the focus of a group of Kaggle competitions in recent years. Results highly suggest that the good performance and high scores of the past models are a result of chance, and not because of a good-performing and stable model. Furthermore, our proposed models can achieve more steady results with lower log loss average (best at 0.489) compared to the top solutions of the 2019 competition (>0.503), and reach the top 1

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2020

Descriptive and Predictive Analysis of Euroleague Basketball Games and the Wisdom of Basketball Crowds

In this study we focus on the prediction of basketball games in the Euro...
research
07/10/2023

Model-Driven Engineering Method to Support the Formalization of Machine Learning using SysML

Methods: This work introduces a method supporting the collaborative defi...
research
01/29/2021

Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models

Data scientists face a steep learning curve in understanding a new domai...
research
10/01/2018

Utilizing a Transparency-driven Environment toward Trusted Automatic Genre Classification: A Case Study in Journalism History

With the growing abundance of unlabeled data in real-world tasks, resear...
research
01/07/2019

A New Perspective on Machine Learning: How to do Perfect Supervised Learning

In this work, we introduce the concept of bandlimiting into the theory o...
research
05/13/2013

Unsupervised ensemble of experts (EoE) framework for automatic binarization of document images

In recent years, a large number of binarization methods have been develo...
research
09/08/2023

Unleashing the Power of Graph Learning through LLM-based Autonomous Agents

Graph structured data are widely existed and applied in the real-world a...

Please sign up or login with your details

Forgot password? Click here to reset