App store review sentiment analysis: a practical method

Español · Deutsch · Polski · Français

Star ratings tell you how users feel. Review text tells you why. Sentiment analysis is useful only if it gets down to the "why".

Free app review check · Review export · Reply generator · Sample report · Report €19 · Competitor Pack €29 · Monitor €29/month

Stars are not sentiment

A 4-star review can contain a serious bug report, and a 1-star review can be about a delivery driver rather than your app. Read the text, and label sentiment per topic within a review, not one label per review.

A method that holds up

  1. Collect: App Store Connect API for your App Store reviews (App Store Connect API: Customer Reviews); Play Console CSV or Cloud Storage reports for Google Play (Play Console Help: View and analyze your app's ratings and reviews). The Google API returns only reviews with text, from the last week (Google Play Developer API: Reply to Reviews).
  2. Split into aspects: "Love the lessons, but the new paywall is too much" is positive about content and negative about pricing.
  3. Label each aspect: theme, sentiment and severity (blocks use, annoys, or suggests).
  4. Check by hand: read a random sample each week and correct the labels. Sarcasm, short reviews and mixed languages are where automatic labels fail most.
  5. Track by version: a jump in negative mentions of one theme right after a release points at that release.

What the stores already give you

Report it as fixes, not scores

"Sentiment fell 8 points" doesn't tell anyone what to do. "Negative mentions of sync doubled since 5.4, mostly on iPad" does.

Sources

Related guides

Questions

Can I do sentiment analysis on star ratings alone?

Not reliably. Ratings without text don't say what the problem is, and the Google Play API only returns reviews that include a comment.

Does Google Play Console have built-in review analysis?

Yes. Reviews analysis includes review summaries in English, topic benchmarks and an Updated ratings view.

How do I handle reviews in many languages?

The Google Play API can translate review text with the translationLanguage parameter. For App Store reviews, translate before labelling and keep the original text.