How we read reviews
Where the reviews come from, how they are sorted, and what the figures do and do not mean.
Every number on Pulse of Reviews is a count of real reviews. This page explains how those counts are made.
1. Where the reviews come from
The reviews are the public reviews on a business's Google Business Profile. For each one we record its star rating, its date and whether it includes a written comment. We also record the overall rating and total review count that Google states for the business, and the date we read them.
We do not collect reviews from any other source at present.
2. How a review is sorted
Reviews that contain only stars are counted by their stars and nothing else.
Reviews with a written comment are read by an AI language model, which answers three questions about each one:
- Is the comment positive, negative or neutral in tone?
- Which themes does it discuss? The model chooses from a fixed list. Some themes apply to every business, such as pricing, communication and how staff treated the customer. Others apply only to one trade: a chiropractor's list includes pain relief, a towing company's includes response time.
- For each theme, was it raised positively or negatively?
The model labels one review at a time. It cannot add a theme that is not on the list.
3. Who does the counting
The model only labels. Every count, percentage and total on the site is calculated by ordinary software from those labels. The model is never asked for a number, and any total it offers is discarded. The written summary at the top of a business page is assembled by the same software from the counts.
4. What we publish
Counts, themes and tone. We do not publish the wording of any review or the name of any reviewer, and each business page links to the Google listing where the reviews can be read in full.
5. How to read the figures
- "Staff courtesy: 153 of 245 written reviews." 153 of the 245 reviews that included a comment discussed that theme. One review can discuss several themes, so these counts add up to more than the number of reviews.
- Sample size and dates. Every figure states how many reviews it is based on and the period they cover. A share based on 18 reviews is weaker evidence than one based on 400, and the page shows which you are looking at.
- Google's count and ours may differ. Google's stated total can be slightly lower or higher than the number of reviews we hold, because reviews are added and removed over time. We show both figures as they are.
- No theme listed. If no theme was raised often enough to report, the page says so. That is a finding about the reviews, not a gap in the page.
6. Limits you should know about
- Reviews are opinions of the people who chose to write them. They are not a survey of all customers, and they are not verified by us.
- A language model can misread a comment, especially sarcasm or a comment about a different business posted by mistake. Across many reviews the counts are reliable; for any single review, read it on Google.
- A business with fewer than five reviews has a page that shows what we hold, but five reviews are too few to draw conclusions from, and we keep those pages out of search results.
7. Keeping it current
When new, edited or removed reviews reach us, the affected business is counted again and its page shows the new period covered. The date of the latest review we hold appears on every business page.
8. Corrections
If a page describes the wrong business, an old address, or a closed business, tell us: see Correct a listing.