Skip to main content
Subscribe
  • Sign Up Free
  • Login
  • Subscribe
  • News
    • Current News
    • Providers
    • Insurance
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • Digital Health
    • Transformation
    • ESG
    • People
    • Regional News
    • Digital Edition (Web Version)
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Midwest
    • Northeast
    • South
    • West
  • Blogs
    • AI
    • Deals
    • Layoff Tracker
    • HIMSS 2023
  • Opinion
    • Breaking Bias
    • Commentaries
    • Letters
    • From the Editor
  • Events & Awards
    • Awards
    • Conferences
    • Galas
    • Virtual Briefings
    • Webinars
    • Nominate/Eligibility
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Excellence in Governance
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top Innovators
    • Diversity in Healthcare
      • - Luminaries
      • - Top 25 Diversity Leaders
      • - Leaders to Watch
    • Women in Healthcare
      • - Luminaries
      • - Top 25 Women Leaders
      • - Women to Watch
    • Digital Health Transformation Summit
    • ESG: The Implementation Imperative Summit
    • Leadership Symposium
    • Social Determinants of Health Symposium
    • Women Leaders in Healthcare Conference
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Diversity Leaders Gala
    • Top 25 Women Leaders Gala
    • - Hospital of the Future
    • - Value Based Care
    • - Hospital at Home
    • - Workplace of the Future
    • - AI and Digital Health
    • - Future of Staffing
    • - Hospital of the Future (Fall)
  • Multimedia
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Sponsored Video Series - One on One
    • Sponsored Video Series - Checking In with Dan Peres
  • Data & Insights
    • Data & Insights Home
    • Hospital Financials
    • Staffing & Compensation
    • Quality & Safety
    • Mergers & Acquisitions
    • Data Archive
    • Resource Guide: By the Numbers
    • Surveys
    • Data Points
  • Newsletters
  • MORE+
    • Contact Us
    • Advertise
    • Media Kit
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
October 28, 2015 12:00 AM

Few EHRs score well on new AMA usability ratings

Joseph Conn
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    Only three electronic health-record systems got perfect scores for usability—two made by Allscripts and one by McKesson Corp.—out of 20 products rated by the American Medical Association and a group of researchers.

    The AMA teamed up with MedStar Health's National Center for Human Factors in Healthcare to rate 20 commonly used EHRs by their adherence to user-centered design best practices.

    The average score on the 15-point scale was 11.5 and the median was 12.5. The worst-performing product, from eClinical Works, got a 5.

    Vendors were supposed to incorporate user-centered design principles in developing systems that would be eligible for the federal EHR incentive payment system.

    This year researchers at Washington-based MedStar reported that many EHR vendors failed to meet the program's user-centered design requirements while others ignored optional user-centered design best practices.

    “Physician experiences documented by the AMA demonstrate that most EHR systems fail to support effective and efficient clinical work, and continued issues with usability are a key factor driving low satisfaction with many EHR products,” AMA President Dr. Steven Stack said in a news release about the ratings, which are available online free of charge. “Our goal is to shine light on the low bar of the certification process and how EHRs are designed and user-tested in order to drive improvements that respond to the urgent physician need for better designed EHR systems.”

    To qualify their EHR systems for use by providers in the federal incentive payment program, vendors were asked to report to the Office of the National Coordinator for Health Information Technology at HHS how they met their user-centered design requirements. Those requirements included multiple users actually testing the systems for usability and scoring the results.

    These reports are made available to the public via an ONC website, but they are not uniform in design and the placement of key information. Further, their data was not scored against recognized best practices in user-centered design principles, nor was it compiled in one easily accessible format for comparison with usability reports for other vendors' systems.

    In their initial study, the MedStar researchers looked at the ONC filings on 50 EHRs. They found that nine in the sample (18%) had no public report on usability. Of the 41 vendors with reports on file, about a third failed to state the type of user-centered design process they used, a requirement for certification.

    The ONC also has endorsed a National Institute of Standards and Technology recommendation that vendors use at least 15 participants when performing user-centered design testing. But the ONC didn't make that threshold mandatory, and 63% of the vendors in the MedStar sample had fewer than 15 participants in end-user testing.

    The new rating scheme ranks each vendor's EHR on a 15-point scale by comparing what the EHR vendors reported to the ONC against best-practices criteria developed by participants from the AMA and the MedStar center.

    “Every single vendor should be at 15 points,” said Raj Ratwani, scientific director of the MedStar's Human Factors Center and a principal developer of the ratings system.

    For the initial 20 vendors, Ratwani said, he and fellow researcher Dr. A Zach Hettinger, the center's medical director, “went through every single use case these vendors used and how they approached user-centered design.” Dr. Michael Hodgkins, vice president and chief medical information officer for the AMA, and Matt Reid, the association's senior health IT consultant, also worked on the ratings framework.

    The ONC did not respond to requests for comment on the new rating system. More than 400 EHR systems have been tested and certified for use in the federal incentive payment program, so Ratwani acknowledged the ratings are a work in progress.

    “If we can spark a little bit of competition with this framework, then we're achieving our goal of improving these products,” he said.

    The Electronic Health Records Association, a trade group representing 31 EHR vendors, panned the ratings as mostly useless to buyers.

    “We note the acknowledgement in the AMA's press release that the framework is not intended to evaluate the perceived usability of an EHR, only the documentation submitted for certification,” the association said in an e-mail. “Given that the documentation presented for certification is a small subset of the usability evaluations and user-centered design techniques that a vendor may practice, this framework may not represent a comprehensive view of the user-centered design work done in the context of any given product.”

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    doctor_patient_tablet_getty_i_i.jpg
    How AI may influence pain medication prescriptions
    Amir Dan Rubin
    Amazon's One Medical CEO to step down later this year
    Most Popular
    1
    Centene to lay off 2,000 workers
    2
    How health systems are battling price-gouging allegations
    3
    Senate advances bill to temporarily aid hospitals, health centers
    4
    Elevance, Blue Cross Louisiana halt $2.5B proposed deal
    5
    Tower Health to sell urgent care centers, close others
    Sponsored Content
    Digital Health Intelligence Newsletter: Sign up to receive a twice-weekly (T, F) morning newsletter featuring the latest reporting on technologies, trends, players and money fueling the rapid changes in how healthcare is developed, paid for and delivered.
    Get Newsletters

    Sign up for enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today
    MH Magazine Cover

    MH magazine offers content that sheds light on healthcare leaders’ complex choices and touch points—from strategy, governance, leadership development and finance to operations, clinical care, and marketing.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS

    Our Mission

    Modern Healthcare empowers industry leaders to succeed by providing unbiased reporting of the news, insights, analysis and data.

    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Help Center
    • Advertise with Us
    • Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2023. Crain Communications, Inc. All Rights Reserved.
    • News
      • Current News
      • Providers
      • Insurance
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • Digital Health
      • Transformation
        • Patients
        • Operations
        • Care Delivery
        • Payment
      • ESG
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition (Web Version)
    • Blogs
      • AI
      • Deals
      • Layoff Tracker
      • HIMSS 2023
    • Opinion
      • Breaking Bias
      • Commentaries
      • Letters
      • From the Editor
    • Events & Awards
      • Awards
        • Nominate/Eligibility
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Excellence in Governance
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top Innovators
        • Diversity in Healthcare
          • - Luminaries
          • - Top 25 Diversity Leaders
          • - Leaders to Watch
        • Women in Healthcare
          • - Luminaries
          • - Top 25 Women Leaders
          • - Women to Watch
      • Conferences
        • Digital Health Transformation Summit
        • ESG: The Implementation Imperative Summit
        • Leadership Symposium
        • Social Determinants of Health Symposium
        • Women Leaders in Healthcare Conference
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Diversity Leaders Gala
        • Top 25 Women Leaders Gala
      • Virtual Briefings
        • - Hospital of the Future
        • - Value Based Care
        • - Hospital at Home
        • - Workplace of the Future
        • - AI and Digital Health
        • - Future of Staffing
        • - Hospital of the Future (Fall)
      • Webinars
    • Multimedia
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Sponsored Video Series - One on One
      • Sponsored Video Series - Checking In with Dan Peres
    • Data & Insights
      • Data & Insights Home
      • Hospital Financials
      • Staffing & Compensation
      • Quality & Safety
      • Mergers & Acquisitions
      • Data Archive
      • Resource Guide: By the Numbers
      • Surveys
      • Data Points
    • Newsletters
    • MORE+
      • Contact Us
      • Advertise
      • Media Kit
      • Jobs
      • People on the Move
      • Reprints & Licensing