Skip to main navigation Skip to search Skip to main content

Neural Sentiment Analysis of User Reviews to Predict User Ratings

  • Hacettepe University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Citations (Scopus)

Abstract

The significance of user satisfaction is increasing in the competitive open source software (OSS) market. Application stores let users send their feedbacks for applications, which are in the form of user reviews or ratings. Developers are informed about bugs or any additional requirements with the help of this feedback and use it to increase the quality of the software. Moreover, potential users rely on this information as a success indicator to decide downloading the applications. Since it is usually costly to read all the reviews and evaluate their content, the ratings are taken as the base for the assessment. This makes the consistency of the contents with the ratings of the reviews important for healthy evaluation of the applications. In this study, we use recurrent neural networks to analyze the reviews automatically, and thereby predict the user ratings based on the reviews. We apply transfer learning from a huge volume, gold dataset of Amazon Customer Reviews. We evaluate the performance of our model on three mobile OSS applications in the Google Play Store and compare the predicted ratings and the original ratings of the users. Eventually, the predicted ratings have an accuracy of 87.61% compared to the original ratings of the users, which seems promising to obtain the ratings from the reviews especially if the former is absent or its consistency with the reviews is weak.

Original languageEnglish
Title of host publicationUBMK 2019 - Proceedings, 4th International Conference on Computer Science and Engineering
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages629-634
Number of pages6
ISBN (Electronic)9781728139647
DOIs
Publication statusPublished - Sept 2019
Event4th International Conference on Computer Science and Engineering, UBMK 2019 - Samsun, Turkey
Duration: 11 Sept 201915 Sept 2019

Publication series

NameUBMK 2019 - Proceedings, 4th International Conference on Computer Science and Engineering

Conference

Conference4th International Conference on Computer Science and Engineering, UBMK 2019
Country/TerritoryTurkey
CitySamsun
Period11/09/1915/09/19

Keywords

  • Deep Learning
  • OSS
  • Open Source
  • Sentiment Analysis
  • Software Quality
  • Transfer Learning
  • User Satisfaction

Fingerprint

Dive into the research topics of 'Neural Sentiment Analysis of User Reviews to Predict User Ratings'. Together they form a unique fingerprint.

Cite this