ColdNAS: Search to Modulate for User Cold-Start Recommendation

06/06/2023
by   Shiguang Wu, et al.
0

Making personalized recommendation for cold-start users, who only have a few interaction histories, is a challenging problem in recommendation systems. Recent works leverage hypernetworks to directly map user interaction histories to user-specific parameters, which are then used to modulate predictor by feature-wise linear modulation function. These works obtain the state-of-the-art performance. However, the physical meaning of scaling and shifting in recommendation data is unclear. Instead of using a fixed modulation function and deciding modulation position by expertise, we propose a modulation framework called ColdNAS for user cold-start problem, where we look for proper modulation structure, including function and position, via neural architecture search. We design a search space which covers broad models and theoretically prove that this search space can be transformed to a much smaller space, enabling an efficient and robust one-shot search algorithm. Extensive experimental results on benchmark datasets show that ColdNAS consistently performs the best. We observe that different modulation functions lead to the best performance on different datasets, which validates the necessity of designing a searching-based method.

READ FULL TEXT
research
11/22/2020

Evolving Search Space for Neural Architecture Search

The automation of neural architecture design has been a coveted alternat...
research
05/22/2023

NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis based on Frequency Modulation

Developing digital sound synthesizers is crucial to the music industry a...
research
07/02/2022

Multi-scale Attentive Image De-raining Networks via Neural Architecture Search

Multi-scale architectures and attention modules have shown effectiveness...
research
09/30/2019

RNAS: Architecture Ranking for Powerful Networks

Neural Architecture Search (NAS) is attractive for automatically produci...
research
06/10/2020

AMER: Automatic Behavior Modeling and Interaction Exploration in Recommender System

User behavior and feature interactions are crucial in deep learning-base...
research
02/28/2023

Towards Personalized Preprocessing Pipeline Search

Feature preprocessing, which transforms raw input features into numerica...
research
10/12/2020

Contextual Modulation for Relation-Level Metaphor Identification

Identifying metaphors in text is very challenging and requires comprehen...

Please sign up or login with your details

Forgot password? Click here to reset