Skip to main content
Sister Publication Links
  • ESG: THE IMPLEMENTATION IMPERATIVE
Subscribe
  • Sign Up Free
  • Login
  • Subscribe
  • News
    • Current News
    • Providers
    • Insurance
    • Digital Health
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • Transformation
    • People
    • Regional News
    • Digital Edition (Web Version)
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Midwest
    • Northeast
    • South
    • West
  • Unwell in America
  • Opinion
    • Bold Moves
    • Breaking Bias
    • Commentaries
    • Letters
    • Vital Signs Blog
    • From the Editor
  • Events & Awards
    • Awards
    • Conferences
    • Galas
    • Virtual Briefings
    • Webinars
    • Nominate/Eligibility
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Excellence in Governance
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top 25 Innovators
    • Diversity in Healthcare
      • - Luminaries
      • - Top 25 Diversity Leaders
      • - Leaders to Watch
    • Women in Healthcare
      • - Luminaries
      • - Top 25 Women Leaders
      • - Women to Watch
    • Digital Health Transformation Summit
    • ESG: The Implementation Imperative Summit
    • Leadership Symposium
    • Social Determinants of Health Symposium
    • Women Leaders in Healthcare Conference
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Diversity Leaders Gala
    • Top 25 Women Leaders Gala
    • - Hospital of the Future
    • - Value Based Care
    • - Hospital at Home
    • - Workplace of the Future
    • - Digital Health
    • - Future of Staffing
    • - Hospital of the Future (Fall)
  • Multimedia
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Video Series - The Check Up
    • Sponsored Video Series - One on One
  • Data Center
    • Data Center Home
    • Hospital Financials
    • Staffing & Compensation
    • Quality & Safety
    • Mergers & Acquisitions
    • Data Archive
    • Resource Guide: By the Numbers
    • Surveys
    • Data Points
  • MORE+
    • Contact Us
    • Advertise
    • Media Kit
    • Newsletters
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
June 14, 2020 09:21 PM

Accuracy of COVID-19 tests still largely unknown

Associated Press
  • Tweet
  • Share
  • Share
  • Email
  • More
    Reprints Print
    Modern Healthcare Illustration / Getty Images

    How accurate are the coronavirus tests used in the U.S.?

    Months into the outbreak, no one really knows how well many of the screening tests work, and experts at top medical centers say it is time to do the studies to find out.

    When the new virus began spreading, the Food and Drug Administration used its emergency powers to OK scores of quickly devised tests, based mainly on a small number of lab studies showing they could successfully detect the virus.

    That's very different from the large patient studies that can take weeks or months, which experts say are needed to provide a true sense of testing accuracy.

    The FDA's speedy response came after it was initially criticized for delaying the launch of new tests during a crisis and after the Centers for Disease Control and Prevention stumbled in getting its own test out to states.

    But with the U.S. outbreak nearly certain to stretch on for months or even years, some experts want the FDA to demand better evidence of the tests' accuracy so doctors know how many infections might be missed.

    There have been more than 2 million confirmed coronavirus cases in the U.S. and more than 115,000 deaths, according to data compiled by Johns Hopkins University. Cases in nearly half of U.S. states are rising.

    In recent weeks, preliminary findings have flagged potential problems with some COVID-19 tests, including one used daily at the White House. Faulty tests could leave many thousands of Americans with the incorrect assumption that they are virus-free, contributing to new flare-ups of the disease as communities reopen.

    "In the beginning, the FDA was under a lot of pressure to get these tests onto the marketplace," said Dr. Steven Woloshin of Dartmouth College, who wrote about the issue in the New England Journal of Medicine last week. "But now that there are plenty of tests out there, it's time for them to raise the bar."

    The FDA said in a statement that it has already asked multiple test makers to do follow-up accuracy studies, although it didn't say for how many of the more than 110 authorized screening tests. The agency also said it is tracking reports of problems. Accuracy has also been an issue with blood tests that look for signs of past infections.

    No screening test is 100% accurate. So details on accuracy are routinely provided for tests of all types, including seasonal flu, hepatitis, HIV and cancers. For example, rapid flu tests are known to miss 20% or more of all cases, a factor doctors weigh when treating patients who have symptoms but test negative.

    For now, most COVID-19 tests in the U.S. don't give data on real-world performance, including how often the tests falsely clear patients of infection or falsely detect the virus. That information is lacking for all but a few of the roughly 80 commercial screening tests available, according to an Associated Press review.

    The government's emergency authorization process "requires a lower level of evidence," the agency said. Makers need only show that a test "may be effective" instead of the usual requirement to demonstrate "safety and effectiveness." They would have to meet that higher threshold once the U.S. government declares the emergency over.

    Many of the commercial test makers submitted results from 60 samples, the minimum number required and mostly used lab-produced specimens of the virus. The FDA now recommends the use of nasal swabs or other real samples from people screened for coronavirus.

    Experts say larger patient studies patients are needed to assess a test's true performance.

    Lab testing bears little resemblance to actual — sometimes imperfect — conditions at hospitals, clinics and testing sites noted Dr. Robert Kaplan of Stanford University.

    "You're testing people in parking lots, the patients themselves are extremely anxious and often unable to follow instructions," said Kaplan, a former associate director of the National Institutes of Health.

    Kaplan and others say those differences could explain why some tests are not performing as expected.

    Last month, the FDA warned doctors of a potential accuracy problem with Abbott Laboratories' rapid ID Now test, which delivers results in roughly 15 minutes. The test has been lauded by President Donald Trump and used to screen the president, his staff and visitors to the White House.

    The FDA alert followed a preliminary report by New York University that found Abbott's test missed between a third to one-half of infections caught by a rival test in patients screened for the virus.

    Abbott rejected the findings, saying the researchers did not follow the instructions for using its test. The company pointed to alternate patient studies, including its own, that have found the test successfully detects between 91% and 95% or more of virus cases when compared to other tests.

    But similar problems with ID NOW's accuracy have been flagged in preliminary reports by researchers at Stanford University, Loyola University and the Cleveland Clinic.

    For now, the FDA is requiring Abbott to conduct follow-up studies in several different patient groups.

    The FDA's emergency standards "are still high but there is a significant difference in the body of work that what would go into a submission under the normal process," said Abbott vice president John Hackett. "Our normal process takes years to bring these out."

    Requiring bigger studies of all coronavirus tests could provide valuable information, but it could also strain the FDA's already stretched staff and resources, said Dr. Daniel Schultz, former director of the FDA's medical device center.

    Dr. Colin West of the Mayo Clinic worries doctors and patients have put too much confidence in the current crop of tests, when an unknown number of patients with COVID-19 are likely receiving false negative results.

    Even a modest error rate can have grave consequences during an outbreak like COVID-19. West gives the example of a test that is 95% accurate at detecting the virus and is used on 1 million people. That would still result in 50,000 people being incorrectly told that they don't have the virus.

    "The negative test does not mean that I'm off the hook," West said. "We just need to maintain that level of vigilance until we have a better sense of how good these tests really can be."

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    IBM Quantum System One at Cleveland Clinic_4_0.jpg
    Cleveland Clinic, IBM unveil quantum computer
    Dr. Alice Zheng
    Women's digital health sector poised for growth, venture capitalist predicts
    Most Popular
    1
    More healthcare organizations at risk of credit default, Moody's says
    2
    Centene fills out senior executive team with new president, COO
    3
    SCAN, CareOregon plan to merge into the HealthRight Group
    4
    Blue Cross Blue Shield of Michigan unveils big push that lets physicians take on risk, reap rewards
    5
    Bright Health weighs reverse stock split as delisting looms
    Sponsored Content
    Health IT Strategist (HITS) Newsletter: Sign up for the latest IT and medical technology news delivered 3 days a week (M, W, F).
     
    Get Newsletters

    Sign up for enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today
    MH Magazine Cover

    MH magazine offers content that sheds light on healthcare leaders’ complex choices and touch points—from strategy, governance, leadership development and finance to operations, clinical care, and marketing.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS

    Our Mission

    Modern Healthcare empowers industry leaders to succeed by providing unbiased reporting of the news, insights, analysis and data.

    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Advertise with Us
    • Ad Choices Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2023. Crain Communications, Inc. All Rights Reserved.
    • News
      • Current News
      • Providers
      • Insurance
      • Digital Health
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • Transformation
        • Patients
        • Operations
        • Care Delivery
        • Payment
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition (Web Version)
    • Unwell in America
    • Opinion
      • Bold Moves
      • Breaking Bias
      • Commentaries
      • Letters
      • Vital Signs Blog
      • From the Editor
    • Events & Awards
      • Awards
        • Nominate/Eligibility
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Excellence in Governance
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top 25 Innovators
        • Diversity in Healthcare
          • - Luminaries
          • - Top 25 Diversity Leaders
          • - Leaders to Watch
        • Women in Healthcare
          • - Luminaries
          • - Top 25 Women Leaders
          • - Women to Watch
      • Conferences
        • Digital Health Transformation Summit
        • ESG: The Implementation Imperative Summit
        • Leadership Symposium
        • Social Determinants of Health Symposium
        • Women Leaders in Healthcare Conference
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Diversity Leaders Gala
        • Top 25 Women Leaders Gala
      • Virtual Briefings
        • - Hospital of the Future
        • - Value Based Care
        • - Hospital at Home
        • - Workplace of the Future
        • - Digital Health
        • - Future of Staffing
        • - Hospital of the Future (Fall)
      • Webinars
    • Multimedia
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Video Series - The Check Up
      • Sponsored Video Series - One on One
    • Data Center
      • Data Center Home
      • Hospital Financials
      • Staffing & Compensation
      • Quality & Safety
      • Mergers & Acquisitions
      • Data Archive
      • Resource Guide: By the Numbers
      • Surveys
      • Data Points
    • MORE+
      • Contact Us
      • Advertise
      • Media Kit
      • Newsletters
      • Jobs
      • People on the Move
      • Reprints & Licensing