Skip to main content
Sister Publication Links
  • ESG: THE IMPLEMENTATION IMPERATIVE
Subscribe
  • Sign Up Free
  • Login
  • Subscribe
  • News
    • Current News
    • Providers
    • Insurance
    • Digital Health
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • Transformation
    • People
    • Regional News
    • Digital Edition (Web Version)
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Midwest
    • Northeast
    • South
    • West
  • Unwell in America
  • Opinion
    • Bold Moves
    • Breaking Bias
    • Commentaries
    • Letters
    • Vital Signs Blog
    • From the Editor
  • Events & Awards
    • Awards
    • Conferences
    • Galas
    • Virtual Briefings
    • Webinars
    • Nominate/Eligibility
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Excellence in Governance
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top 25 Innovators
    • Diversity in Healthcare
      • - Luminaries
      • - Top 25 Diversity Leaders
      • - Leaders to Watch
    • Women in Healthcare
      • - Luminaries
      • - Top 25 Women Leaders
      • - Women to Watch
    • Digital Health Transformation Summit
    • ESG: The Implementation Imperative Summit
    • Leadership Symposium
    • Social Determinants of Health Symposium
    • Women Leaders in Healthcare Conference
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Diversity Leaders Gala
    • Top 25 Women Leaders Gala
    • - Hospital of the Future
    • - Value Based Care
    • - Hospital at Home
    • - Workplace of the Future
    • - Digital Health
    • - Future of Staffing
    • - Hospital of the Future (Fall)
  • Multimedia
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Video Series - The Check Up
    • Sponsored Video Series - One on One
  • Data Center
    • Data Center Home
    • Hospital Financials
    • Staffing & Compensation
    • Quality & Safety
    • Mergers & Acquisitions
    • Data Archive
    • Resource Guide: By the Numbers
    • Surveys
    • Data Points
  • MORE+
    • Contact Us
    • Advertise
    • Media Kit
    • Newsletters
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Providers
March 02, 2015 12:00 AM

'Extreme' disagreement seen across hospital ratings sites

Sabriya Rice
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    Consumers should consider more than one rating site before making a decision about a hospital. That's because facilities deemed high performers by one group might also be among the worst performers on another, according to a study looking at four hospital ratings programs.

    “We were expecting a lack of agreement on some level, but we were surprised by how little agreement there was overall,” said Matt Austin, an assistant professor at the Armstrong Institute for Patient Safety and Quality at Johns Hopkins. He's lead author of the new study in Health Affairs which revealed disparate outcomes for more than 800 hospitals across the four ratings sites evaluated.

    The report is refueling discussion about the potential confusion for consumers and hospitals as more news, government and consumer organizations issue ratings that paint varying pictures of hospital performance.

    Each rating site may look at specific factors and apply differing methodologies. Representatives for the ratings groups say, in the age of transparency, the more information available for consumers, the better.

    “If each hospital is good and bad at different things, then each patient will want to use the ratings that most directly address his or her individual needs,” says Ben Harder, managing editor and director of healthcare analysis for U.S. News & World Report. “If just one rating system existed, they would have less information to use in choosing a provider.”

    The ratings programs evaluated in the study include U.S. News & World Report's Best Hospitals; HealthGrades' America's 100 Best Hospitals; Leapfrog's Hospital Safety Score; and Consumer Reports' Health Safety Score.

    The authors found that 83 hospitals were rated by all four ratings systems. None of them were rated as a “high performer” by all four, however. Only three hospitals were rated as high performers by three out of four of the ratings systems. Also, only 10% of hospitals rated as a high performer by one rating system also were high performers on at least one of the other lists.

    They also identified 27 cases of “extreme cross-rating disagreement,” where a facility got the best performance on one site, but the worst on another. For example, fourteen hospitals were given an A on Leapfrog's Hospital Safety Score, but did not rank well on U.S. News' Best Hospitals. Seven did poorly on Consumer Reports, which evaluates hospitals on a scale of zero to 100, but got an A-rating from Leapfrog.

    “The complexity and opacity of the different rating systems are likely to cause confusion instead of driving patients and purchasers to higher-quality, safer care,” concluded the authors, who looked at ratings published between July 2012 to July 2013.

    Co-authors include Dr. Ashish Jha of Harvard, Dr. Patrick Romano of the University of California, Davis, Sara Singer of Harvard, Timothy Vogus of Vanderbilt, Dr. Bob Wachter of the University of California, San Francisco, and Dr. Peter Pronovost of Johns Hopkins.

    When ratings organizations use terms such as "the best" and "the top," “it's not always clear what they are trying to communicate,” and this can lead to confusion, Austin said in an interview. “A consumer could consult four different lists and come up with four different results. It can also become a challenge for where a hospital should focus improvement efforts,” Austin said.

    Not surprisingly, the ratings groups themselves gave mixed reviews of the study. Like the researchers, most anticipated differences across ratings sites, given their different areas of focus, but they disagreed about whether the mixed reviews are confusing and about whether a standard for the ratings is needed.

    Doris Peter, director of Consumer Reports' Health Ratings Center, is supportive of more discussion and dialogue among the raters to better shape the science. But “we're all dealing with the same limitations,” she said.

    Future studies should focus on how well each rating system is achieving its stated goal, according to Harder of U.S. News, or on how the groups align on the exact same measures, according to Evan Marks, chief strategy officer for HealthGrades.

    “We need to make sure we are comparing process measures to process measures, outcome measures to outcome measures, patient satisfaction to patient satisfaction and safety to safety,” said Marks. “Then they can begin to ask questions about why they do not align.”

    Several study authors participate on LeapFrog's safety core panel. Leah Binder, the group's president and CEO, says though the study provides a valuable overview of what is currently rated, the nation is far from having enough information for consumers to make hospital comparisons.

    The abundance of raters might be frustrating for hospital leaders trying to prioritize improvement, but she said: “Welcome to the world of industry. When you have a complex product, you have to meet different consumer demands.”

    Follow Sabriya Rice on Twitter: @sabriyarice

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    373837936 (1).jpg
    New guidelines aim to limit trans healthcare at Catholic hospitals
    InDepth: Private Equity
    Legal questions surround private equity-backed Noble Health
    Most Popular
    1
    More healthcare organizations at risk of credit default, Moody's says
    2
    Centene fills out senior executive team with new president, COO
    3
    SCAN, CareOregon plan to merge into the HealthRight Group
    4
    Blue Cross Blue Shield of Michigan unveils big push that lets physicians take on risk, reap rewards
    5
    Bright Health weighs reverse stock split as delisting looms
    Sponsored Content
    Modern Healthcare A.M. Newsletter: Sign up to receive a comprehensive weekday morning newsletter designed for busy healthcare executives who need the latest and most important healthcare news and analysis.
    Get Newsletters

    Sign up for enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today
    MH Magazine Cover

    MH magazine offers content that sheds light on healthcare leaders’ complex choices and touch points—from strategy, governance, leadership development and finance to operations, clinical care, and marketing.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS

    Our Mission

    Modern Healthcare empowers industry leaders to succeed by providing unbiased reporting of the news, insights, analysis and data.

    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Advertise with Us
    • Ad Choices Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2023. Crain Communications, Inc. All Rights Reserved.
    • News
      • Current News
      • Providers
      • Insurance
      • Digital Health
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • Transformation
        • Patients
        • Operations
        • Care Delivery
        • Payment
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition (Web Version)
    • Unwell in America
    • Opinion
      • Bold Moves
      • Breaking Bias
      • Commentaries
      • Letters
      • Vital Signs Blog
      • From the Editor
    • Events & Awards
      • Awards
        • Nominate/Eligibility
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Excellence in Governance
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top 25 Innovators
        • Diversity in Healthcare
          • - Luminaries
          • - Top 25 Diversity Leaders
          • - Leaders to Watch
        • Women in Healthcare
          • - Luminaries
          • - Top 25 Women Leaders
          • - Women to Watch
      • Conferences
        • Digital Health Transformation Summit
        • ESG: The Implementation Imperative Summit
        • Leadership Symposium
        • Social Determinants of Health Symposium
        • Women Leaders in Healthcare Conference
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Diversity Leaders Gala
        • Top 25 Women Leaders Gala
      • Virtual Briefings
        • - Hospital of the Future
        • - Value Based Care
        • - Hospital at Home
        • - Workplace of the Future
        • - Digital Health
        • - Future of Staffing
        • - Hospital of the Future (Fall)
      • Webinars
    • Multimedia
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Video Series - The Check Up
      • Sponsored Video Series - One on One
    • Data Center
      • Data Center Home
      • Hospital Financials
      • Staffing & Compensation
      • Quality & Safety
      • Mergers & Acquisitions
      • Data Archive
      • Resource Guide: By the Numbers
      • Surveys
      • Data Points
    • MORE+
      • Contact Us
      • Advertise
      • Media Kit
      • Newsletters
      • Jobs
      • People on the Move
      • Reprints & Licensing