Skip to main content
Subscribe
  • Sign Up Free
  • Login
  • Subscribe
  • News
    • Current News
    • Providers
    • Insurance
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • Digital Health
    • Transformation
    • ESG
    • People
    • Regional News
    • Digital Edition (Web Version)
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Midwest
    • Northeast
    • South
    • West
  • Blogs
    • AI
    • Deals
    • Layoff Tracker
    • HIMSS 2023
  • Opinion
    • Breaking Bias
    • Commentaries
    • Letters
    • From the Editor
  • Events & Awards
    • Awards
    • Conferences
    • Galas
    • Virtual Briefings
    • Webinars
    • Nominate/Eligibility
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Excellence in Governance
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top Innovators
    • Diversity in Healthcare
      • - Luminaries
      • - Top 25 Diversity Leaders
      • - Leaders to Watch
    • Women in Healthcare
      • - Luminaries
      • - Top 25 Women Leaders
      • - Women to Watch
    • Digital Health Transformation Summit
    • ESG: The Implementation Imperative Summit
    • Leadership Symposium
    • Social Determinants of Health Symposium
    • Women Leaders in Healthcare Conference
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Diversity Leaders Gala
    • Top 25 Women Leaders Gala
    • - Hospital of the Future
    • - Value Based Care
    • - Hospital at Home
    • - Workplace of the Future
    • - AI and Digital Health
    • - Future of Staffing
    • - Hospital of the Future (Fall)
  • Multimedia
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Sponsored Video Series - One on One
    • Sponsored Video Series - Checking In with Dan Peres
  • Data & Insights
    • Data & Insights Home
    • Hospital Financials
    • Staffing & Compensation
    • Quality & Safety
    • Mergers & Acquisitions
    • Data Archive
    • Resource Guide: By the Numbers
    • Surveys
    • Data Points
  • Newsletters
  • MORE+
    • Contact Us
    • Advertise
    • Media Kit
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
September 09, 2015 12:00 AM

EHR vendors fall short on usability testing

Joseph Conn
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print

    Despite federal rules meant to ease the use of electronic health-record systems, many developers of popular EHRs are falling down on reporting and meeting federal design requirements, according to research published in JAMA..

    A team of researchers from the National Center for Human Factors in Healthcare at MedStar Health in Washington, D.C., found that not every vendor filed required

    ">reports

    on their usability testing. The report adds to the mounting concern that EHRs are failing to raise the quality and safety of healthcare and lower its costs.

    The MedStar researchers reviewed reports on usability test results from 50 of the most commonly used EHRs, which are required as part of the $31.3 billion federal EHR incentive payment program. The MedStar team found that vendors of nine of the 50 EHRs in their sample (18%) had no public report on usability on file with the Office of the National Coordinator, which oversees the testing and certification regime.

    Of the 41 vendors whose usability reports were on file, roughly a third failed to state the type of user-centered design process as required for certification, according to the researchers.

    Although not an ONC rule, the agency has endorsed a National Institute of Standards recommendation that at least 15 participants engage in user-centered design testing. But in the MedStar sample, 63% of the vendors with reports engaged fewer than 15 participants in end-user testing.

    In addition, 17% of vendors with a report on file identified no physicians participating in usability tests of their computerized physician order entry (CPOE) systems. Two vendors in the sample used some of their own employees to do the testing.

    The MedStar researchers said more than 90% of the provider attestations of meaningful use under the EHR incentive payment program from April 2013 through November 2014 were from users of the 50 EHRs in their sample.

    The MedStar group focused on user testing of developers' CPOE functionality because that component of an EHR is most likely to be used by physicians or nurses and it is one that “presents significant safety hazards when not designed well,” the study authors said.

    “The lack of adherence to usability testing may be a major factor contributing to the poor usability experienced by clinicians,” the study authors concluded.

    The ONC became aware some vendors had failed to file usability reports earlier this year, according to Alicia Morton, who leads the IT certification program at the ONC. Morton issued a two-page guidance (PDF) in May that gave the organizations 90 days to get their test reports up to date.

    The memo warned that future EHRs without the required design reports will be rejected for certification.

    Last fall, the American Medical Association targeted what physicians perceive as generally poor usability of EHR systems as part of a broader campaign to improve physician satisfaction with the profession. A pair of recent surveys indicated that physicians continued to express dissatisfaction with EHRs on ease of use and interoperability.

    To address provider complaints and patient safety concerns about EHRs, the ONC in 2014 said user-centered design processes must be applied to each of a dozen key EHR capabilities, including CPOE, electronic prescribing, medication lists and drug-to-drug and drug-to-allergy interactions.

    Ratwani

    But Raj Ratwani, corresponding author of the study and the scientific director at the National Center for Human Factors in Healthcare, criticized vendor processes that relegated user-centered design to the end of development, testing what are essentially finished products. The government should have been clearer in its guidance on what it wants vendors and independent testing and certification organizations to do, he said.

    The study suggests industry efforts to incorporate user-friendly design into its development process have fallen short. The Electronic Health Records Association, a trade group of nearly 40 top vendors, over the past two years has been working with its members on improving usability, according to EHRA Chairman Leigh Burchell, vice president of policy and government affairs at Chicago-based EHR developer Allscripts. “We continue to hold education sessions for EHRA membership on UCD methods and techniques.”

    Ross Koppel, an adjunct professor of sociology at the University of Pennsylvania who studies hospital workplace culture, said the MedStar research supports his view that the federal EHR incentive payment program is encouraging vendors to rush EHR software into use without proper testing.

    “Vendors treated usability in the most haphazard way,” Koppel said. “The fact that usability is so primitive is a detriment to patient safety and clinician satisfaction.”

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    doctor_patient_tablet_getty_i_i.jpg
    How AI may influence pain medication prescriptions
    Amir Dan Rubin
    Amazon's One Medical CEO to step down later this year
    Most Popular
    1
    CMS tries luring providers to revamped Medicare ACOs
    2
    Oregon joins other states in setting ratios for nurse staffing
    3
    Blue Shield CA taps Amazon, Mark Cuban, CVS for new PBM model
    4
    A health innovation hub grows in Lake Nona Medical City
    5
    Hospital-at-home providers push for Medicaid coverage
    Sponsored Content
    Digital Health Intelligence Newsletter: Sign up to receive a twice-weekly (T, F) morning newsletter featuring the latest reporting on technologies, trends, players and money fueling the rapid changes in how healthcare is developed, paid for and delivered.
    Get Newsletters

    Sign up for enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today
    MH Magazine Cover

    MH magazine offers content that sheds light on healthcare leaders’ complex choices and touch points—from strategy, governance, leadership development and finance to operations, clinical care, and marketing.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS

    Our Mission

    Modern Healthcare empowers industry leaders to succeed by providing unbiased reporting of the news, insights, analysis and data.

    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Help Center
    • Advertise with Us
    • Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2023. Crain Communications, Inc. All Rights Reserved.
    • News
      • Current News
      • Providers
      • Insurance
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • Digital Health
      • Transformation
        • Patients
        • Operations
        • Care Delivery
        • Payment
      • ESG
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition (Web Version)
    • Blogs
      • AI
      • Deals
      • Layoff Tracker
      • HIMSS 2023
    • Opinion
      • Breaking Bias
      • Commentaries
      • Letters
      • From the Editor
    • Events & Awards
      • Awards
        • Nominate/Eligibility
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Excellence in Governance
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top Innovators
        • Diversity in Healthcare
          • - Luminaries
          • - Top 25 Diversity Leaders
          • - Leaders to Watch
        • Women in Healthcare
          • - Luminaries
          • - Top 25 Women Leaders
          • - Women to Watch
      • Conferences
        • Digital Health Transformation Summit
        • ESG: The Implementation Imperative Summit
        • Leadership Symposium
        • Social Determinants of Health Symposium
        • Women Leaders in Healthcare Conference
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Diversity Leaders Gala
        • Top 25 Women Leaders Gala
      • Virtual Briefings
        • - Hospital of the Future
        • - Value Based Care
        • - Hospital at Home
        • - Workplace of the Future
        • - AI and Digital Health
        • - Future of Staffing
        • - Hospital of the Future (Fall)
      • Webinars
    • Multimedia
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Sponsored Video Series - One on One
      • Sponsored Video Series - Checking In with Dan Peres
    • Data & Insights
      • Data & Insights Home
      • Hospital Financials
      • Staffing & Compensation
      • Quality & Safety
      • Mergers & Acquisitions
      • Data Archive
      • Resource Guide: By the Numbers
      • Surveys
      • Data Points
    • Newsletters
    • MORE+
      • Contact Us
      • Advertise
      • Media Kit
      • Jobs
      • People on the Move
      • Reprints & Licensing