Powered by OpenAIRE graph
Found an issue? Give us feedback
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/ Electronics and Cont...arrow_drop_down
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
Electronics and Control Systems
Article . 2025 . Peer-reviewed
Data sources: Crossref
image/svg+xml art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos Open Access logo, converted into svg, designed by PLoS. This version with transparent background. http://commons.wikimedia.org/wiki/File:Open_Access_logo_PLoS_white.svg art designer at PLoS, modified by Wikipedia users Nina, Beao, JakobVoss, and AnonMoos http://www.plos.org/
versions View all 2 versions
addClaim

This Research product is the result of merged Research products in OpenAIRE.

You have already added 0 works in your ORCID record related to the merged Research product.

Comprehensive Benchmark of Collaborative Filtering Methods on Implicit Feedback Datasets

Authors: Ivan Pyshnograiev; Anar Shyralliev;

Comprehensive Benchmark of Collaborative Filtering Methods on Implicit Feedback Datasets

Abstract

Collaborative filtering is a foundational technique in modern recommender systems, especially when dealing with implicit feedback signals such as clicks, purchases, or listening behavior. Despite the abundance of сollaborative filtering models, including classical, probabilistic, and neural approaches, there is a lack of standardized, large-scale evaluations across diverse datasets. This study presents a comprehensive empirical benchmark of 13 сollaborative filtering algorithms encompassing matrix factorization, pairwise ranking, variational and non-variational autoencoders, graph-based neural models, and probabilistic methods. Using four representative implicit feedback datasets from different domains, we evaluate models under a unified experimental protocol using ranking-based metrics (MAP@10, NDCG@10, Precision@10, Recall@10, MRR), while also reporting training efficiency. Our results reveal that neural architectures such as NeuMF, VAECF, and LightGCN offer strong performance in dense and moderately sparse scenarios, but may face scalability constraints on larger datasets. Simpler models like EASEᴿ and BPR often achieve a favorable balance between performance and efficiency. This benchmark offers actionable insights into the trade-offs of modern сollaborative filtering methods and guides future research in implicit recommender systems.

Keywords

колаборативна фільтрація, ранжування, сollaborative filtering, рекомендаційні системи, бенчмаркінг, implicit feedback, benchmarking, recommender systems, ranking metrics, неявний зворотний зв'язок

  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average
gold