On Unexpectedness in Recommender Systems
- 18 December 2014
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 5 (4), 1-32
- https://doi.org/10.1145/2559952
Abstract
Although the broad social and business success of recommender systems has been achieved across several domains, there is still a long way to go in terms of user satisfaction. One of the key dimensions for significant improvement is the concept of unexpectedness . In this article, we propose a method to improve user satisfaction by generating unexpected recommendations based on the utility theory of economics. In particular, we propose a new concept of unexpectedness as recommending to users those items that depart from what they would expect from the system - the consideration set of each user. We define and formalize the concept of unexpectedness and discuss how it differs from the related notions of novelty, serendipity, and diversity. In addition, we suggest several mechanisms for specifying the users’ expectations and propose specific performance metrics to measure the unexpectedness of recommendation lists. We also take into consideration the quality of recommendations using certain utility functions and present an algorithm for providing users with unexpected recommendations of high quality that are hard to discover but fairly match their interests. Finally, we conduct several experiments on “real-world” datasets and compare our recommendation results with other methods. The proposed approach outperforms these baseline methods in terms of unexpectedness and other important metrics, such as coverage, aggregate diversity and dispersion, while avoiding any accuracy loss.Keywords
This publication has 53 references indexed in Scilit:
- Recommender systems: from algorithms to user experienceUser Modelling and User-Adapted Interaction, 2012
- Using external aggregate ratings for improving individual recommendationsACM Transactions on the Web, 2011
- Solving the apparent diversity-accuracy dilemma of recommender systemsProceedings of the National Academy of Sciences of the United States of America, 2010
- Factor in the neighborsACM Transactions on Knowledge Discovery From Data, 2010
- Evaluating collaborative filtering recommender systemsACM Transactions on Information Systems, 2004
- Discovering unexpected patterns in temporal data using temporal logicPublished by Springer Science and Business Media LLC ,1998
- What makes patterns interesting in knowledge discovery systemsIEEE Transactions on Knowledge and Data Engineering, 1996
- The Uses of Tobit AnalysisThe Review of Economics and Statistics, 1980
- Note on the Uniqueness of the Maximum Likelihood Estimator for the Tobit ModelEconometrica, 1978
- Methods of Measuring the Concentration of WealthPublications of the American Statistical Association, 1905