PERFORMANCE ANALYSIS OF A HYBRID RECOMMENDER SYSTEM

Uzair Sultan; Hajra Khan; Yasir Saleem Afridi; Mian Ibad Ali Shah; Muniba Ashfaq; Affera Sultan

Authors

Uzair Sultan UET Peshawar
Hajra Khan
Yasir Saleem
Mian Ibad
Muniba Ashfaq
Affera Sultan

Keywords:

Machine Learning, Data Mining, Recommender System, Collaborative Filtering, Hybridization Techniques, Evaluation Metrics, Mean Absolute Error (MAE), Cross-Validation, Training Data

Abstract

In the prevailing information age, human confrontation with extensive information makes it difficult to segregate the relevant content on the basis of choices and priorities. This gives rise to the need for effective recommendation systems that can be incorporated into distinct and diversified domains such as e-commerce, social media, and news media websites and applications. By giving suggestions, these recommender systems efficiently reduce huge information spaces and direct the users toward the items that best match their requirements and preferences. Hence, they play an important role in filtering out the relevant user-specific information. Based on the working principle, recommender systems can be classified into Content-Based Systems, Collaborative Filtering Systems, or P opularity-Based Systems. However, to cope with the problems of cold-start and plasticity that are associated with standalone recommender systems, hybrid recommendation systems are being introduced. This research is therefore focused on the development of a Weighted Hybrid Model that combines the scores of the three standalone recommender models in a linear fashion. The performance of the proposed hybrid model is tested against all three standalone models on an online News dataset. Using a Top-N accuracy metric, it is found that the accuracy of the weighted hybrid model is higher than the standalone Content-Based, Collaborative, and Popularity-Based models against the same dataset. An efficiency of 90% for the Hybrid model was achieved compared to the best-performing standalone model having an efficiency of 53%.

References

A. K. Chaturvedi, F. Peleja, and A. Freire, “Recommender System for News Articles using Supervised Learning,” Jul. 2017, Accessed: May 18, 2024. [Online]. Available: https://arxiv.org/abs/1707.00506v1

N. Jonnalagedda, S. Gauch, K. Labille, and S. Alfarhood, “Incorporating popularity in a personalized news recommender system,” PeerJ Comput. Sci., vol. 2016, no. 6, p. e63, Jun. 2016, doi: 10.7717/PEERJ-CS.63/SUPP-2.

“A HYBRID NEWS RECOMMENDER SYSTEM.” Accessed: May 18, 2024. [Online]. Available: https://www.researchgate.net/publication/325550103_A_HYBRID_NEWS_RECOMMENDER_SYSTEM

R. Steinberger, B. Pouliquen, and E. van der Goot, “An introduction to the Europe Media Monitor family of applications,” Sep. 2013, Accessed: May 18, 2024. [Online]. Available: http://arxiv.org/abs/1309.5290

Y. Zhou, D. Wilkinson, R. Schreiber, and R. Pan, “Large-Scale Parallel Collaborative Filtering for the Netflix Prize,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 5034 LNCS, pp. 337–348, 2008, doi: 10.1007/978-3-540-68880-8_32.

R. M. Bell and Y. Koren, “Scalable collaborative filtering with jointly derived neighborhood interpolation weights,” Proc. - IEEE Int. Conf. Data Mining, ICDM, pp. 43–52, 2007, doi: 10.1109/ICDM.2007.90.

C. Feng, M. Khan, A. U. Rahman, and A. Ahmad, “News Recommendation Systems-Accomplishments, Challenges Future Directions,” IEEE Access, vol. 8, pp. 16702–16725, 2020, doi: 10.1109/ACCESS.2020.2967792.

I. Cantador, P. Castells, and L. Gardens, “Semantic contextualisation in a news recommender system,” 2009.

W. Zhou, J. Wen, Q. Qu, J. Zeng, and T. Cheng, “Shilling attack detection for recommender systems based on credibility of group users and rating time series,” PLoS One, vol. 13, no. 5, p. e0196533, May 2018, doi: 10.1371/JOURNAL.PONE.0196533.

L. Li, D. Wang, T. Li, D. Knox, and B. Padmanabhan, “SCENE: A scalable two-stage personalized news recommendation system,” SIGIR’11 - Proc. 34th Int. ACM SIGIR Conf. Res. Dev. Inf. Retr., pp. 125–134, 2011, doi: 10.1145/2009916.2009937.

P. Viana and M. Soares, “A Hybrid Approach for Personalized News Recommendation in a Mobility Scenario Using Long-Short User Interest,” https://doi.org/10.1142/S0218213017600120, vol. 26, no. 2, Apr. 2017, doi: 10.1142/S0218213017600120.

G. Adomavicius and A. Tuzhilin, “Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions,” IEEE Trans. Knowl. Data Eng., vol. 17, no. 6, pp. 734–749, Jun. 2005, doi: 10.1109/TKDE.2005.99.

D. Khattar, V. Kumar, M. Gupta, and V. Varma, “Neural Content-Collaborative Filtering for News Recommendation”, Accessed: May 18, 2024. [Online]. Available: http://ceur-ws.org

S. Jiang and W. Hong, “A vertical news recommendation system: CCNS - An example from Chinese campus news reading system,” Proc. 9th Int. Conf. Comput. Sci. Educ. ICCCSE 2014, pp. 1105–1114, Oct. 2014, doi: 10.1109/ICCSE.2014.6926634.

E. Gabrilovich, S. Dumais, and E. Horvitz, “Newsjunkie,” pp. 482–490, May 2004, doi: 10.1145/988672.988738.

J. Liu, P. Dolan, and E. R. Pedersen, “Personalized news recommendation based on click behavior,” Int. Conf. Intell. User Interfaces, Proc. IUI, pp. 31–40, 2010, doi: 10.1145/1719970.1719976.

“Articles sharing and reading from CI&T DeskDrop.” Accessed: May 18, 2024. [Online]. Available: https://www.kaggle.com/datasets/gspmoreira/articles-sharing-reading-from-cit-deskdrop/data

M. D. Ekstrand, “LensKit for Python: Next-Generation Software for Recommender Systems Experiments,” Int. Conf. Inf. Knowl. Manag. Proc., pp. 2999–3006, Oct. 2020, doi: 10.1145/3340531.3412778.

X. Su and T. M. Khoshgoftaar, “A Survey of Collaborative Filtering Techniques,” Adv. Artif. Intell., vol. 2009, pp. 1–19, Oct. 2009, doi: 10.1155/2009/421425.

A. Garcia Esparza, G. Esparza, M. P. O, B. Smyth, and S. Garcia Esparza, “A multi-criteria evaluation of a user generated content based recommender system,” Freyne, J. al. (eds.). Proc. 3rd ACM RecSys’10 Work. Recomm. Syst. Soc. Web, pp. 23–27, Oct. 2011, Accessed: May 18, 2024. [Online]. Available: http://hdl.handle.net/10197/3509

M. Deshpande and G. Karypis, “Item-based top-N recommendation algorithms,” ACM Trans. Inf. Syst., vol. 22, no. 1, pp. 143–177, Jan. 2004, doi: 10.1145/963770.963776.