Does a 5-Star Rating Really Mean Better Care? What the Data Shows

The Centers for Medicare & Medicaid Services (CMS) rates over 15,000 nursing homes on a 1-to-5-star scale. It’s the most visible quality indicator in senior care — the first thing many families see when they search for a facility.

Five stars sounds excellent. One star sounds terrible. The system seems simple and authoritative. But after cross-referencing CMS star ratings with our own analysis of 319,000+ inspection reports across all 50 states, the picture is considerably more complicated.

What the Stars Actually Measure

The CMS overall star rating is a composite of three separate ratings:

1. Health Inspections (most heavily weighted)

This rating is based on the three most recent annual inspections plus any complaint investigations over the past three years. Inspections are weighted by recency — the most recent counts more.

The health inspection rating is relative, not absolute. It compares each facility against other facilities in the same state. A 5-star facility in one state might have the same number of findings as a 3-star facility in a state with stricter enforcement. This is a significant limitation that most families don’t realize.

2. Staffing

The staffing rating is based on two measures:

Total nurse staffing hours per resident per day (RN + LPN + nurse aide hours)
RN staffing hours per resident per day

The data comes from a system called the Payroll-Based Journal (PBJ), which facilities submit electronically. This was a major improvement over the old system, where facilities self-reported staffing on a single day chosen by the facility. PBJ uses payroll records, making it harder (but not impossible) to game.

However, the staffing rating has a known weakness: it measures quantity (hours), not quality (training, experience, continuity, morale). A facility could achieve a high staffing rating by hiring many new, undertrained, and poorly paid aides who turn over every few months. The hours look good on paper. The care doesn’t feel good in person.

3. Quality Measures (QMs)

Quality measures are derived from clinical data that facilities report through the Minimum Data Set (MDS) — standardized assessments of each resident. They include metrics like:

Percentage of residents with pressure ulcers
Percentage of residents who received antipsychotic medications
Percentage of residents who experienced falls with major injury
Percentage of residents with urinary tract infections

The problem with quality measures is that they are self-reported by the facility. While CMS audits the data, the system fundamentally relies on facilities to accurately document and report their own outcomes. Multiple studies have found discrepancies between self-reported QMs and what inspectors observe on-site.

Where the Stars Fall Short

The gaming problem

Facilities are sophisticated operators. They understand exactly how the star rating is calculated, and they optimize for it. This isn’t necessarily nefarious — it’s rational behavior. But it means:

Inspection preparation is an industry. Consultants help facilities prepare for inspections. Staff get extra training in the weeks before expected inspection windows. The facility on inspection day may look different from the facility on a random Tuesday.
Quality measure reporting is strategic. How a resident’s condition is coded on the MDS affects quality measures. A facility that codes carefully can improve its QM rating without changing care.
Staffing can be temporarily inflated. While PBJ made this harder, facilities can still shift staff scheduling to inflate numbers during reporting periods.

The comparison problem

Because the health inspection rating is relative to other facilities in the same state, the stars don’t translate across state lines. States with aggressive inspection programs may have lower average star ratings — not because their facilities are worse, but because their inspectors find more. Conversely, states with underfunded inspection programs may have inflated ratings simply because fewer problems are documented.

This matters enormously if you’re comparing facilities in different states — which happens frequently when families are relocating a parent closer to an adult child.

The recency problem

The overall rating lags reality. It takes months for new inspection results to flow through the system. A facility that had a terrible inspection last month might still show 4 or 5 stars based on its previous track record. Conversely, a facility that just completed a major turnaround might still carry a low rating from its prior performance.

The coverage gap

CMS star ratings only apply to Medicare/Medicaid-certified nursing homes. They do not cover:

Assisted living facilities
Residential care homes
Memory care communities (unless they’re within a rated nursing home)
Board and care homes

Since the majority of families searching for senior care are looking at assisted living — not skilled nursing — the star rating system doesn’t apply to the type of facility they’re considering. This is perhaps the most significant limitation and the least understood.

What the Research Says

Academic research on the relationship between star ratings and care quality paints a mixed picture:

A 2019 study in Health Affairs found that higher-rated nursing homes had lower rates of hospitalization and emergency department visits — suggesting the ratings do capture something meaningful about care quality.
However, a 2021 study in the Journal of the American Geriatrics Society found that the correlation between star ratings and family satisfaction was weak. Families at 5-star facilities were only marginally more satisfied than families at 3-star facilities.
A GAO report found that approximately 1 in 5 nursing homes had been cited for a serious deficiency that wasn’t reflected in its star rating at the time, due to processing delays.
During COVID-19, star ratings proved particularly poor predictors of pandemic outcomes. Many 5-star facilities had devastating outbreaks, while some lower-rated facilities managed the crisis better.

The emerging consensus: star ratings are directionally useful but not individually predictive. A 1-star facility is more likely to have serious problems than a 5-star facility. But any given 5-star facility could be coasting on outdated data, gaming the system, or simply benefiting from a lenient state inspection program.

What to Look at Instead (or in Addition)

Inspection narratives, not just scores

The actual text of inspection findings contains far more information than the star rating derived from them. A “medication error” finding could describe a caregiver who gave a vitamin 30 minutes late or a caregiver who administered the wrong controlled substance to the wrong resident. The star rating treats these similarly. The narrative does not.

Trends over time

A 3-star facility that has been steadily improving over three years is a very different proposition from a 3-star facility that used to be 5 stars and has been declining. Static ratings obscure trajectories. Our analysis categorizes facilities as improving, declining, having persistent concerns, or maintaining a clean record — information that a single rating can’t convey.

Staffing stability, not just staffing levels

Hours per resident per day matters, but turnover matters more. A facility with moderate staffing levels and 15% annual turnover will generally provide better care than a facility with high staffing levels and 60% turnover. Continuity of care — the same people knowing your parent’s routines, preferences, and medical needs — is one of the strongest predictors of quality that no rating system captures.

Complaint history

Filed complaints aren’t included in the star rating calculation in a way that’s visible to consumers. But complaint-driven inspections often reveal problems that routine inspections miss, because they’re responding to specific issues observed by people who are there every day.

Your own observation

No data system — ours included — substitutes for walking through the front door. Visit unannounced. Stay for a meal. Watch how staff interact with residents when they don’t think anyone’s evaluating them. Talk to residents and families already there.

A Framework for Using Ratings Wisely

Use stars to screen, not to select. If you’re starting a search with no information, filtering to 3+ stars is a reasonable first pass. But don’t stop there.
Read the inspection reports behind the rating. Look at the actual findings, their severity, and whether they recur. One bad inspection in an otherwise clean history is different from a chronic pattern.
Weight recent data most heavily. A facility can change dramatically — in either direction — over two years. The most recent inspection matters most.
Compare within the same state. Because ratings are state-relative, cross-state comparisons are unreliable. Compare facilities in the same market to each other.
Look for what ratings don’t measure. Staff warmth. Resident engagement. Family communication. Activity quality. The intangible feeling of a place that genuinely cares versus one that merely complies.

The Honest Answer

Does a 5-star rating mean better care? On average, across thousands of facilities, probably — slightly. For any individual facility, it might mean excellent care, or it might mean excellent paperwork. The stars are a starting point, not a destination.

The families who make the best decisions are the ones who use data to narrow the field and then trust their own eyes, ears, and instincts to make the final call.

Go deeper than star ratings. CareLookout analyzes actual inspection reports with AI — categorizing findings by severity, tracking trends over time, and showing you the full story behind any facility in all 50 states.