Contrastive Learning for Sequential Recommendation
Xu Xie, Fei Sun, Zhaoyang Liu et al. · Proceedings - International Conference on Data Engineering · 2022
Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical inter-actions. Despite their success, we argue that these approaches usually rely on the sequential prediction task to optimize the huge amounts of parameters. They usually suffer from the data sparsity problem, which makes it difficult for them to learn high-quality user representations. To tackle that, inspired by recent advances of contrastive learning techniques in the computer vision, we propose a novel multi-task framework called Contrastive Learning for Sequential Recommendation (CL4SRec). CL4SRec not only takes advantage of the traditional next item prediction task but also utilizes the contrastive learning framework to derive self-supervision signals from the original user behavior sequences. Therefore, it can extract more meaningful user patterns and further encode the user representations effectively. In addition, we propose three data augmentation approaches to construct self-supervision signals. Extensive experiments on four public datasets demonstrate that CL4SRec achieves state-of-the-art performance over existing baselines by inferring better user representations.
Cited by 663 works. doi:10.1109/icde53745.2022.00099 Open-access PDF
Authors
References
- Long Short-Term Memory
- Adam: A Method for Stochastic Optimization
- AutoResearch Lite: a reproducible paper-inspired experiment runner (Adam mechanism reproduction and convergence-speed comparison)
- Exploiting Generative AI to Scale up Intelligent Tutoring Systems
- AI-Assisted Pipeline for Dynamic Generation of Trustworthy Health Supplement Content at Scale
- Attention Is All You Need
- Distributed Representations of Words and Phrases and their Compositionality
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
- Detecting Functionality-Specific Vulnerabilities via Retrieving Individual Functionality-Equivalent APIs in Open-Source Repositories
- Momentum Contrast for Unsupervised Visual Representation Learning