Few EHRs score well on new AMA usability ratings
Skip to main content
MDHC_Logotype_white
Subscribe
  • My Account
  • Login
  • Subscribe
  • News
    • This Week's News
    • COVID-19
    • Providers
    • Insurance
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • People
    • Regional News
    • Digital Edition
    • Ohio to save $240M in Medicaid drug costs by running its own PBM
      MACPAC approves recommendations on specialty drugs, behavioral health
      Top R.I. state official will take over, review hospital agency
      No region in the world spared as virus cases, deaths surge
    • No region in the world spared as virus cases, deaths surge
      We're losing engaged providers, and healthcare will pay the price
      J&J vaccine problems hamper U.S. military vaccines overseas
      U.S. suicides dropped last year, defying pandemic expectations
    • Calls mount for Biden to track U.S. healthcare worker deaths from COVID
      Front-line workers want more assistance after a year of COVID-19
      Healthcare providers enter Philadelphia's legal fight to enact gun laws
      Taking population health expertise to the market
    • Cigna and Oscar expand their small business partnership
      5 things to know about Agilon Health's proposed IPO
      More than a half million Americans gain coverage under Biden
      Insurance auto-retention policies could halve number of people kicked off coverage
    • MACPAC approves recommendations on specialty drugs, behavioral health
      No region in the world spared as virus cases, deaths surge
      CMS wants to bump pay for hospices, SNFs next year
      MACPAC wants to cut Medicaid spending on high-cost specialty drugs
    • Outgoing UHS chief made almost 50% less in 2020 than 2019
      A hundred dollar bill cut into strips with a colorful background.
      Population health still at odds with fee-for-service
      Private equity could increase long-term Medicare spending, MedPAC says
      Jeb Bush, Marilyn Tavenner getting in on healthcare SPAC frenzy
    • Healthcare data breaches
      By the Numbers: National health information service providers
      Health systems are navigating the digital divide and vaccine access
      woman doctor shaking hands with nurse and smiling
      Sponsored Content Provided By Philips
      A stronger healthcare system requires bold new ways of working together
    • Fight against STDs lost amid coronavirus testing blitz
      Beyond the Byline: Kids' unchecked mental health needs pose long-term consequences
      Hospitals vary widely in reducing C-section rates, but some progress in other maternal health metrics
      Home improvement to be provided by ProMedica's new healthy homes initiative
    • Novant Health adds chief payor performance officer
      Kaiser Permanente names Comer chief IT officer
      Mass General Hospital's Slavin to retire as CEO
      UnitedHealthcare names Thompson as new CEO
    • Midwest
    • Northeast
    • South
    • West
  • Insights
    • ACA 10 Years After
    • Best Practices
    • Special Reports
    • Innovations
    • The Affordable Care Act after 10 years
    • A close-up of a woman receiving a COVID-19 vaccine.
      Providers in underserved communities work toward equitable vaccine distribution
      Josh Bradshaw
      How one rural Illinois county vaccinated 84% of its senior citizens by early March
      Dr. John Fischer
      Patient-reported outcomes tool for hernia surgery helps physicians improve care
      New care model helps primary-care practices treat obesity
    • A family photo of the the Hangens.
      Stressing the already burdened pediatric behavioral health system
      Jennifer Pannone and her daughter Victoria.
      Mental health access for children needs attention
      What's next for on-demand telehealth companies?
      A CalOptima PACE vaccination clinic.
      Will COVID-19 be the catalyst for creating a more sustainable healthcare system?
    • Ryan McGinnis
      Finding efficiencies in the OR using tech
      Dr. Daniel Hall
      UPMC pilots machine learning, telehealth to inform patient transfers
      A woman being recorded using her inhaler on a smartphone.
      Digital check-ins, connected inhalers help control asthma
      A phone screen showing the question, "Mary we hope this information was helpful and we'd like to keep guiding you. Are you interested in knowing when it's your turn to receive the vaccine?"
      Chatbots, texting campaigns help manage influx of COVID vax questions
  • Transformation
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Nearly 1 in 5 Americans skipped care due to cost last year
      COVID-19 long-haulers need holistic treatment, providers say
      Amazon expanding employee clinics into two more states
      What's next for on-demand telehealth companies?
    • Malpractice premiums peak in 2020, AMA survey shows
      A rendering of a cancer research institute at the University of Southern California that will include 5G.
      Healthcare providers determine how to best use ultrafast 5G
      Two-thirds of largest hospitals aren't complying with price transparency rule
      'Silver lining': Hospitals keep practices born in COVID rush
    • Addressing long-standing barriers needed for mental and physical health integration
      A close-up of a woman receiving a COVID-19 vaccine.
      Providers in underserved communities work toward equitable vaccine distribution
      The waiting room of a Kaiser Permanente clinic at a Target location.
      Health systems revamp their approach to retail clinics
      Josh Bradshaw
      How one rural Illinois county vaccinated 84% of its senior citizens by early March
    • CMS wants to bump pay for hospices, SNFs next year
      CMMI pauses new Direct Contracting model applications
      CMS wants to boost payments over 2% for inpatient rehab, psych facilities
      40 Oregon providers, insurers sign value-based care pact
  • Data/Lists
    • Rankings/Lists
    • Interactive Databases
    • Data Points
    • Health Systems Financials
      Executive Compensation
      Physician Compensation
  • Op-Ed
    • Bold Moves
    • Breaking Bias
    • Commentaries
    • Letters
    • Vital Signs Blog
    • From the Editor
    • Dr. Alan Kaplan
      The risks, rewards of taking organizations 'where they haven’t gone before'
      Wellstar CEO calls adapting for the pandemic her bold move
      Howard P. Kern
      Recognizing the value of telehealth in its infancy
      Dr. Stephen Markovich
      A bold move helped take him from family doctor to OhioHealth CEO
    • Drs. Hal Paz and Joshua J. Joseph
      Mobilized to fight the COVID crisis: a blueprint for community and academic partnerships
      Dr. Stephen Markovich
      Making sure we're aligned along the path to achieving inclusion
      Barry Ostrowsky
      Ending racism is a journey taken together; the starting point must be now
      Laura Lee Hall and Gary Puckrein
      Increased flu vaccination has never been more important for communities of color
    • We're losing engaged providers, and healthcare will pay the price
      Bonnie Castillo and John Welton
      Dueling opinions: The role of mandated nurse staffing ratios
      Dr. Chris DeRienzo
      How COVID-19 broke health systems and made them stronger
      Still crossing the quality chasm: a look at the IOM's seminal report 20 years later
    • Letters: Eliminating bias in healthcare needs to be ‘deliberate and organic’
      Letters: Maybe dropping out of ACOs is a good thing for patients
      Letters: White House and Congress share blame for lack of national COVID strategy
      Letters: VA making strides to improve state veterans home inspections
    • Sponsored Content Provided By Optum
      How blockchain could ease frustration with the payment process
      Sponsored Content Provided By Optum
      Three steps to better data-sharing for payer and provider CIOs
      Sponsored Content Provided By Optum
      Reduce total cost of care: 6 reasons why providers and payers should tackle the challenge together
      Sponsored Content Provided By Optum
      Why CIOs went from back-office operators to mission-critical innovators
  • Awards
    • Award Programs
    • Nominate
    • Previous Award Programs
    • Other Award Programs
    • Voting Open - 50 Most Influential Clinical Executives
      Nominations Open - Top 25 Innovators
      Nominations Open May 24 - Top 25 Emerging Leaders
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top 25 Innovators
    • Minorities in Healthcare
      • - Luminaries
      • - Top 25 Minority Leaders
      • - Minorities to Watch
    • Women in Healthcare
      • - Luminaries
      • - Top 25 Women Leaders
      • - Women to Watch
    • Excellence in Nursing Awards
    • Design Awards
    • Top 25 COOs in Healthcare
    • 100 Top Hospitals
    • ACHE Awards
  • Events
    • Conferences
    • Galas
    • Webinars
    • COVID-19 Event Tracker
    • emburse certify modern healthcare custom media webinar logo lockup
      Sponsored Content Provided By Emburse
      Webinar: Making it easy to manage costs
      virtualmed staff modern healthcare custom media logo lockup
      Sponsored Content Provided By VirtualMed Staff
      Webinar: Best practices for creating a successful telepsychiatry program
      telehealth visit man touching neck while speaking to doctor on computer
      Sponsored Content Provided By Accumen
      Webinar: How telehealth has evolved into a standard of care
      modern healthcare custom media and trimedx custom webinar logo lockup
      Sponsored Content Provided By TRIMEDX
      Webinar: Bridging the gap between clinicians and administration to improve capital equipment planning
    • Women Leaders in Healthcare Conference
    • Social Determinants of Health Symposium
    • Healthcare Transformation Summit
    • Leadership Symposium
    • Virtual Briefings
      • - Hospital of the Future
      • - Mental Health
      • - Patient Safety & Quality
      • - Strategic Marketing
      • - Virtual Health
      • - Workplace of the Future
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Minority Leaders Gala
    • Top 25 Women Leaders Gala
  • Listen
    • Podcast - Next Up
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Video Series - The Check Up
    • Sponsored Video Series - One on One
    • Dr. Chris DeRienzo
      Next Up Podcast: Building team spirit in the wake of COVID-19
      Mikelle Moore
      Next Up Podcast: Mikelle Moore on recognizing all hospital workers during the pandemic
      Empty boardroom
      Next Up Podcast: What's going to happen tomorrow? Succession planning during emergencies
      Next Up Podcast: Educating patients on the COVID-19 vaccine with Tanya Andreadis
    • Beyond the Byline: Kids' unchecked mental health needs pose long-term consequences
      Beyond the Byline: How COVID-19 has impacted hospital finances
      An older man sitting on a hospital bed with his back toward the camera.
      Beyond the Byline: Upcoding could explain why hospitals are increasingly billing for the most complex treatment
      Beyond the Byline: Insurers are betting on virtual-first plans as COVID-19 shifts care pathways
    • James garvert neustar healthcare insider podcast image
      Building on basics
      Healthcare Insider Podcast Episode Art - Premier
      Why Roger Weems and other consultants are leaving the big firms to join Premier
      James garvert neustar healthcare insider podcast image
      Outreach during COVID-19
      ann barnes healthcare insider podcast image
      Leading with intention to promote diversity and inclusion
    • The Check Up: Matt Eyles
      The Check Up: Matt Eyles of AHIP
      The Check Up: Dr. Tom Shanley
      The Check Up: Dr. Tom Shanley of Lurie Children’s Hospital of Chicago
      The Check Up: Dr. Harold Paz
      The Check Up: Dr. Harold Paz of Wexner Medical Center at Ohio State University
      The Check Up: Pat Schou
      The Check Up: Pat Schou of the Illinois Critical Access Hospital Network
    • ivana naeymi-rad one on one intelligent medical objects
      Video: Ivana Naeymi Rad of Intelligent Medical Objects
  • MORE +
    • Advertise
    • Media Kit
    • Newsletters
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
October 28, 2015 01:00 AM

Few EHRs score well on new AMA usability ratings

Joseph Conn
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print

    Only three electronic health-record systems got perfect scores for usability—two made by Allscripts and one by McKesson Corp.—out of 20 products rated by the American Medical Association and a group of researchers.

    The AMA teamed up with MedStar Health's National Center for Human Factors in Healthcare to rate 20 commonly used EHRs by their adherence to user-centered design best practices.

    The average score on the 15-point scale was 11.5 and the median was 12.5. The worst-performing product, from eClinical Works, got a 5.

    Vendors were supposed to incorporate user-centered design principles in developing systems that would be eligible for the federal EHR incentive payment system.

    This year researchers at Washington-based MedStar reported that many EHR vendors failed to meet the program's user-centered design requirements while others ignored optional user-centered design best practices.

    “Physician experiences documented by the AMA demonstrate that most EHR systems fail to support effective and efficient clinical work, and continued issues with usability are a key factor driving low satisfaction with many EHR products,” AMA President Dr. Steven Stack said in a news release about the ratings, which are available online free of charge. “Our goal is to shine light on the low bar of the certification process and how EHRs are designed and user-tested in order to drive improvements that respond to the urgent physician need for better designed EHR systems.”

    To qualify their EHR systems for use by providers in the federal incentive payment program, vendors were asked to report to the Office of the National Coordinator for Health Information Technology at HHS how they met their user-centered design requirements. Those requirements included multiple users actually testing the systems for usability and scoring the results.

    These reports are made available to the public via an ONC website, but they are not uniform in design and the placement of key information. Further, their data was not scored against recognized best practices in user-centered design principles, nor was it compiled in one easily accessible format for comparison with usability reports for other vendors' systems.

    In their initial study, the MedStar researchers looked at the ONC filings on 50 EHRs. They found that nine in the sample (18%) had no public report on usability. Of the 41 vendors with reports on file, about a third failed to state the type of user-centered design process they used, a requirement for certification.

    The ONC also has endorsed a National Institute of Standards and Technology recommendation that vendors use at least 15 participants when performing user-centered design testing. But the ONC didn't make that threshold mandatory, and 63% of the vendors in the MedStar sample had fewer than 15 participants in end-user testing.

    The new rating scheme ranks each vendor's EHR on a 15-point scale by comparing what the EHR vendors reported to the ONC against best-practices criteria developed by participants from the AMA and the MedStar center.

    “Every single vendor should be at 15 points,” said Raj Ratwani, scientific director of the MedStar's Human Factors Center and a principal developer of the ratings system.

    For the initial 20 vendors, Ratwani said, he and fellow researcher Dr. A Zach Hettinger, the center's medical director, “went through every single use case these vendors used and how they approached user-centered design.” Dr. Michael Hodgkins, vice president and chief medical information officer for the AMA, and Matt Reid, the association's senior health IT consultant, also worked on the ratings framework.

    The ONC did not respond to requests for comment on the new rating system. More than 400 EHR systems have been tested and certified for use in the federal incentive payment program, so Ratwani acknowledged the ratings are a work in progress.

    “If we can spark a little bit of competition with this framework, then we're achieving our goal of improving these products,” he said.

    The Electronic Health Records Association, a trade group representing 31 EHR vendors, panned the ratings as mostly useless to buyers.

    “We note the acknowledgement in the AMA's press release that the framework is not intended to evaluate the perceived usability of an EHR, only the documentation submitted for certification,” the association said in an e-mail. “Given that the documentation presented for certification is a small subset of the usability evaluations and user-centered design techniques that a vendor may practice, this framework may not represent a comprehensive view of the user-centered design work done in the context of any given product.”

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    Healthcare data breaches
    Healthcare data breaches
    By the Numbers: National health information service providers
    By the Numbers: National health information service providers
    Sponsored Content
    Get Newsletters

    Sign up for enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today
    MH Magazine Cover

    MH magazine offers content that sheds light on healthcare leaders’ complex choices and touch points—from strategy, governance, leadership development and finance to operations, clinical care, and marketing.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS
    • Instagram

    Our Mission

    Modern Healthcare empowers industry leaders to succeed by providing unbiased reporting of the news, insights, analysis and data.

    MDHC_Logotype_white
    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Advertise with Us
    • Ad Choices Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • News
      • This Week's News
      • COVID-19
      • Providers
      • Insurance
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition
    • Insights
      • ACA 10 Years After
      • Best Practices
      • Special Reports
      • Innovations
    • Transformation
      • Patients
      • Operations
      • Care Delivery
      • Payment
    • Data/Lists
      • Rankings/Lists
      • Interactive Databases
      • Data Points
    • Op-Ed
      • Bold Moves
      • Breaking Bias
      • Commentaries
      • Letters
      • Vital Signs Blog
      • From the Editor
    • Awards
      • Award Programs
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top 25 Innovators
        • Minorities in Healthcare
          • - Luminaries
          • - Top 25 Minority Leaders
          • - Minorities to Watch
        • Women in Healthcare
          • - Luminaries
          • - Top 25 Women Leaders
          • - Women to Watch
      • Nominate
      • Previous Award Programs
        • Excellence in Nursing Awards
        • Design Awards
        • Top 25 COOs in Healthcare
      • Other Award Programs
        • 100 Top Hospitals
        • ACHE Awards
    • Events
      • Conferences
        • Women Leaders in Healthcare Conference
        • Social Determinants of Health Symposium
        • Healthcare Transformation Summit
        • Leadership Symposium
        • Virtual Briefings
          • - Hospital of the Future
          • - Mental Health
          • - Patient Safety & Quality
          • - Strategic Marketing
          • - Virtual Health
          • - Workplace of the Future
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Minority Leaders Gala
        • Top 25 Women Leaders Gala
      • Webinars
      • COVID-19 Event Tracker
    • Listen
      • Podcast - Next Up
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Video Series - The Check Up
      • Sponsored Video Series - One on One
    • MORE +
      • Advertise
      • Media Kit
      • Newsletters
      • Jobs
      • People on the Move
      • Reprints & Licensing