Vision-based Behavioral Recognition of Novelty Preference in Pigs

by   Aniket Shirke, et al.

Behavioral scoring of research data is crucial for extracting domain-specific metrics but is bottlenecked on the ability to analyze enormous volumes of information using human labor. Deep learning is widely viewed as a key advancement to relieve this bottleneck. We identify one such domain, where deep learning can be leveraged to alleviate the process of manual scoring. Novelty preference paradigms have been widely used to study recognition memory in pigs, but analysis of these videos requires human intervention. We introduce a subset of such videos in the form of the 'Pig Novelty Preference Behavior' (PNPB) dataset that is fully annotated with pig actions and keypoints. In order to demonstrate the application of state-of-the-art action recognition models on this dataset, we compare LRCN, C3D, and TSM on the basis of various analytical metrics and discuss common pitfalls of the models. Our methods achieve an accuracy of 93 behavior. We open-source our code and annotated dataset at



page 2

page 3

page 4


Quo Vadis, Skeleton Action Recognition ?

In this paper, we study current and upcoming frontiers across the landsc...

Towards Improving Spatiotemporal Action Recognition in Videos

Spatiotemporal action recognition deals with locating and classifying ac...

An Evaluation of Action Recognition Models on EPIC-Kitchens

We benchmark contemporary action recognition models (TSN, TRN, and TSM) ...

Deep Learning for Vision-based Prediction: A Survey

Vision-based prediction algorithms have a wide range of applications inc...

Sharing Pain: Using Domain Transfer Between Pain Types for Recognition of Sparse Pain Expressions in Horses

Orthopedic disorders are a common cause for euthanasia among horses, whi...

Action Recognition Using Volumetric Motion Representations

Traditional action recognition models are constructed around the paradig...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.