Endogenous and Exogenous Multi-Modal Layers in Context Aware Recommendation Systems for Health

by   Nitish Nag, et al.

People care more about the solutions to their problems rather than data alone. Inherently, this means using data to generate a list of recommendations for a given situation. The rapid growth of multi-modal wearables and sensors have not made this jump effectively in the domain of health. Modern user content consumption and decision making in both cyber (e.g. entertainment, news) and physical (eg. food, shopping) spaces rely heavily on targeted personalized recommender systems. The utility function is the primary ranking method to predict what a given person would explicitly prefer. In this work we describe two unique layers of user and context modeling that can be coupled to traditional recommender system approaches. The exogenous layer incorporates factors outside of the person's body (eg. location, weather, social context), while the endogenous layer integrates data to estimate the physiologic or innate needs of the user. This is accomplished through multi-modal sensor data integration applied to domain-specific utility functions, filters and re-ranking weights. We showcase this concept through a nutrition guidance system focused on controlling sodium intake at a personalized level, dramatically improving upon the fixed recommendations.


Intrinsic and Extrinsic Motivation Modeling Essential for Multi-Modal Health Recommender Systems

Managing health lays the core foundation to enabling quality life experi...

PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterest

Latent user representations are widely adopted in the tech industry for ...

Multi-Modal Recommendation System with Auxiliary Information

Context-aware recommendation systems improve upon classical recommender ...

Multi-modal Embedding Fusion-based Recommender

Recommendation systems have lately been popularized globally, with prima...

The Dem@Care Experiments and Datasets: a Technical Report

The objective of Dem@Care is the development of a complete system provid...

Please sign up or login with your details

Forgot password? Click here to reset