Accuracy of COVID-19 tests still largely unknown
Skip to main content
MDHC_Logotype_white
Subscribe
  • My Account
  • Login
  • Subscribe
  • News
    • This Week's News
    • COVID-19
    • Providers
    • Insurance
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • People
    • Regional News
    • Digital Edition
    • Lilly: Drug can prevent COVID-19 illness in nursing homes
      Mobile labs take vaccine studies to diverse neighborhoods
      Biden to sign virus measures, requires mask use to travel
      vaccine shot injection_i_i.jpg
      11,900 COVID-19 vaccine doses ruined en route to Michigan
    • Lilly: Drug can prevent COVID-19 illness in nursing homes
      Mobile labs take vaccine studies to diverse neighborhoods
      Biden to sign virus measures, requires mask use to travel
      vaccine shot injection_i_i.jpg
      11,900 COVID-19 vaccine doses ruined en route to Michigan
    • Louisiana gets reports vaccine providers are discriminating
      'We know this is real': New clinics aid virus 'long-haulers'
      The Check Up: Trenda Ray
      The Check Up: Trenda Ray of the University of Arkansas for Medical Sciences
      Trenda Ray
      Q&A: Arkansas nursing leader looking for creative staffing solutions as COVID cases surge
    • UnitedHealthcare operating earnings fall by $2 billion in Q4
      CMS approves rule forcing insurers to ease prior authorization
      COVID-19 still a big uncertainty for insurers in 2021
      Health insurers' outlook boosted after Dems' Georgia win
    • Biden signs executive orders to reverse, pause Trump-era rules
      CMS finalizes blood-based colon cancer screening coverage
      As virus surges, states reporting shortages of vaccine
      New CDC director takes over beleaguered agency amid crisis
    • Providers await new HHS coronavirus grant reporting deadline
      Operation Warp Speed Dr. Moncef Slaoui, Pfizer Group President Angela Hwang, Moderna CEO Stephane Bancel, CVS Health Executive Vice President Karen Lynch and McKesson CEO Brian Tyler participate in a panel discussion on the COVID-19 vaccine.
      Hospitals, drug companies strive to stand out virtually at JPM
      Intermountain, Trinity, Memorial Hermann behind $300M private equity fund
      Operation Warp Speed to bump up McKesson's stock price
    • A man in a room with servers.
      Momentum grows to outsource hospital tech functions in 2021
      5 things to know about Google's $2.1B Fitbit acquisition
      Providence bets on machine-learning, consolidating data centers
      Mental health treatment was most common telehealth service during COVID
    • Mobile labs take vaccine studies to diverse neighborhoods
      As virus surges, states reporting shortages of vaccine
      Sticking to Mediterranean diet is good for the brain
      Chance of COVID-19 triage care looms over Arizona hospitals
    • Elizabeth Richter will serve as acting CMS administrator
      Providence names new chief financial officer
      Wisconsin's top health official departing for federal job
      Cone Health CEO, CFO to depart amid pending Sentara merger
    • Midwest
    • Northeast
    • South
    • West
  • Insights
    • ACA 10 Years After
    • Best Practices
    • InDepth Special Reports
    • Innovations
    • The Affordable Care Act after 10 years
    • New care model helps primary-care practices treat obesity
      doctor with patient
      COVID-19 treatment protocol developed in the field helps patients recover
      Rachel Wyatt
      Project to curb pressure injuries in hospitals shows promise
      Yale New Haven's COVID-19 nurse-staffing model has long-term benefits
    • Dr. James Hildreth
      How medical education can help fight racism
      Modern Healthcare InDepth: Breaking the bias that impedes better healthcare
      Videos: Healthcare industry executives describe their encounters with racism
      Michellene Davis
      Healthcare leadership lacks the racial diversity needed to reduce health disparities
      Hospital divided into multiple pieces
      Health systems may be warming to offshoring, a mainstay practice for insurers
    • A woman with a wearable sensor talking to her provider.
      Wearable sensors help diagnose heart rhythm problems in West Virginia
      self service station
      COVID-19 pushes patient expectations toward self-service
      Targeting high-risk cancer patients with genetics
      A nurse holds up a phone with a message to a family member saying surgery has started.
      Texting, tablets help hospitals keep family updated on patient care
  • Transformation
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Highmark Health inks six-year cloud, tech deal with Google
      Study: 1 in 5 patients report discrimination when getting healthcare
      HHS proposes changing HIPAA privacy rules
      Android health records app launches at 230 health systems
    • California hospitals prepare ethical protocol to prioritize lifesaving care
      Amazon, JPMorgan Chase, Berkshire Hathaway disband Haven
      Digital pathways poised to reshape healthcare continuum in 2021
      Healthcare was the hardest hit by supply shortages across all U.S. industries
    • A woman with a wearable sensor talking to her provider.
      Wearable sensors help diagnose heart rhythm problems in West Virginia
      New care model helps primary-care practices treat obesity
      How hospitals are building on COVID-19 telehealth momentum
      Researchers: Hospital price variation exacerbates health inequities
    • MedPAC votes to boost hospital payments, freeze or cut other providers
      Most Next Gen ACOs achieved bonuses in 2019
      Congress recalibrates Medicare Physician Fee Schedule after lobbying
      CMS approves rule to encourage value-based drug pricing
  • Data/Lists
    • Rankings/Lists
    • Interactive Databases
    • Data Points
    • Health Systems Financials
      Executive Compensation
      Physician Compensation
  • Op-Ed
    • Bold Moves
    • Breaking Bias
    • Commentaries
    • Letters
    • Vital Signs Blog
    • From the Editor
    • Wellstar CEO calls adapting for the pandemic her bold move
      Howard P. Kern
      Recognizing the value of telehealth in its infancy
      Dr. Stephen Markovich
      A bold move helped take him from family doctor to OhioHealth CEO
      Dr. Bruce Siegel
      Why taking a hospital not-for-profit was Dr. Bruce Siegel’s boldest move
    • Barry Ostrowsky
      Ending racism is a journey taken together; the starting point must be now
      Laura Lee Hall and Gary Puckrein
      Increased flu vaccination has never been more important for communities of color
      John Daniels Jr.
      Health equity: Making the journey from buzzword to reality
      Mark C. Clement and David Cook
      We all need to 'do something' to fight inequities and get healthcare right, for every patient, every time
    • Dr. Bruce Siegel
      By protecting the healthcare safety net, Biden can put us on the path to a stronger country
      Healing healthcare: some ideas for triage by the new Congress, administration
      Dr. Sachin H. Jain
      Medicare for All? The better route to universal coverage would be Medicare Advantage for All
      Connectivity: a social determinant of health that can exacerbate all the others
    • Letters: Eliminating bias in healthcare needs to be ‘deliberate and organic’
      Letters: Maybe dropping out of ACOs is a good thing for patients
      Letters: White House and Congress share blame for lack of national COVID strategy
      Letters: VA making strides to improve state veterans home inspections
    • Sponsored Content Provided By Optum
      How blockchain could ease frustration with the payment process
      Sponsored Content Provided By Optum
      Three steps to better data-sharing for payer and provider CIOs
      Sponsored Content Provided By Optum
      Reduce total cost of care: 6 reasons why providers and payers should tackle the challenge together
      Sponsored Content Provided By Optum
      Why CIOs went from back-office operators to mission-critical innovators
  • Awards
    • Award Programs
    • Nominate
    • Previous Award Programs
    • Other Award Programs
    • Best Places to Work in Healthcare Logo for Navigation
      Nominations Open - Best Places to Work in Healthcare
      Nominations Open - Health Care Hall of Fame
      Nominations Open - 50 Most Influential Clinical Executives
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top 25 Innovators
    • Top 25 Minority Leaders
    • Top 25 Women Leaders
    • Excellence in Nursing Awards
    • Design Awards
    • Top 25 COOs in Healthcare
    • 100 Top Hospitals
    • ACHE Awards
  • Events
    • Conferences
    • Galas
    • Webinars
    • COVID-19 Event Tracker
    • Leadership Symposium
    • Healthcare Transformation Summit
    • Women Leaders in Healthcare Conference
    • Workplace of the Future Conference
    • Strategic Marketing Conference
    • Social Determinants of Health Symposium
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Minority Leaders Gala (2022)
    • Top 25 Women Leaders Gala
  • Listen
    • Podcast - Next Up
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Video Series - The Check Up
    • Sponsored Video Series - One on One
    • Carter Dredge
      Next Up Podcast: Ready, set, innovate! Innovation and disruption in healthcare
      Next Up Podcast: COVID-19, social determinants highlight health inequities — what next?
      Next Up Podcast: Saving Rural Health
      Ceci Connolly
      Next Up Podcast: How to navigate the murky post-election waters
    • An older man wearing a mask receiving a vaccine.
      Beyond the Byline: Verifying information on the chaotic COVID-19 vaccine rollout
      doctor burnout
      Beyond the Byline: How healthcare supply chain struggles contribute to employee burnout
      Beyond the Byline: Covering race and diversity in the healthcare industry
      Beyond the Byline: How telehealth utilization has impacted investor-owned company earnings
    • Leading intention promote diversity and inclusion
      Introducing Healthcare Insider Podcast
    • The Check Up: Chip Kahn
      The Check Up: Chip Kahn of the Federation of American Hospitals
      The Check Up: Trenda Ray
      The Check Up: Trenda Ray of the University of Arkansas for Medical Sciences
      The Check Up: Dr. Kenneth Davis
      The Check Up: Dr. Kenneth Davis of Mount Sinai Health System
      The Check Up: Dr. Thomas McGinn
      The Check Up: Dr. Thomas McGinn of CommonSpirit Health
    • Video: Ivana Naeymi Rad of Intelligent Medical Objects
  • MORE +
    • Advertise
    • Media Kit
    • Newsletters
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
June 14, 2020 09:21 PM

Accuracy of COVID-19 tests still largely unknown

Associated Press
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print
    Modern Healthcare Illustration / Getty Images

    How accurate are the coronavirus tests used in the U.S.?

    Months into the outbreak, no one really knows how well many of the screening tests work, and experts at top medical centers say it is time to do the studies to find out.

    When the new virus began spreading, the Food and Drug Administration used its emergency powers to OK scores of quickly devised tests, based mainly on a small number of lab studies showing they could successfully detect the virus.

    That's very different from the large patient studies that can take weeks or months, which experts say are needed to provide a true sense of testing accuracy.

    The FDA's speedy response came after it was initially criticized for delaying the launch of new tests during a crisis and after the Centers for Disease Control and Prevention stumbled in getting its own test out to states.

    But with the U.S. outbreak nearly certain to stretch on for months or even years, some experts want the FDA to demand better evidence of the tests' accuracy so doctors know how many infections might be missed.

    There have been more than 2 million confirmed coronavirus cases in the U.S. and more than 115,000 deaths, according to data compiled by Johns Hopkins University. Cases in nearly half of U.S. states are rising.

    In recent weeks, preliminary findings have flagged potential problems with some COVID-19 tests, including one used daily at the White House. Faulty tests could leave many thousands of Americans with the incorrect assumption that they are virus-free, contributing to new flare-ups of the disease as communities reopen.

    "In the beginning, the FDA was under a lot of pressure to get these tests onto the marketplace," said Dr. Steven Woloshin of Dartmouth College, who wrote about the issue in the New England Journal of Medicine last week. "But now that there are plenty of tests out there, it's time for them to raise the bar."

    The FDA said in a statement that it has already asked multiple test makers to do follow-up accuracy studies, although it didn't say for how many of the more than 110 authorized screening tests. The agency also said it is tracking reports of problems. Accuracy has also been an issue with blood tests that look for signs of past infections.

    No screening test is 100% accurate. So details on accuracy are routinely provided for tests of all types, including seasonal flu, hepatitis, HIV and cancers. For example, rapid flu tests are known to miss 20% or more of all cases, a factor doctors weigh when treating patients who have symptoms but test negative.

    For now, most COVID-19 tests in the U.S. don't give data on real-world performance, including how often the tests falsely clear patients of infection or falsely detect the virus. That information is lacking for all but a few of the roughly 80 commercial screening tests available, according to an Associated Press review.

    The government's emergency authorization process "requires a lower level of evidence," the agency said. Makers need only show that a test "may be effective" instead of the usual requirement to demonstrate "safety and effectiveness." They would have to meet that higher threshold once the U.S. government declares the emergency over.

    Many of the commercial test makers submitted results from 60 samples, the minimum number required and mostly used lab-produced specimens of the virus. The FDA now recommends the use of nasal swabs or other real samples from people screened for coronavirus.

    Experts say larger patient studies patients are needed to assess a test's true performance.

    Lab testing bears little resemblance to actual — sometimes imperfect — conditions at hospitals, clinics and testing sites noted Dr. Robert Kaplan of Stanford University.

    "You're testing people in parking lots, the patients themselves are extremely anxious and often unable to follow instructions," said Kaplan, a former associate director of the National Institutes of Health.

    Kaplan and others say those differences could explain why some tests are not performing as expected.

    Last month, the FDA warned doctors of a potential accuracy problem with Abbott Laboratories' rapid ID Now test, which delivers results in roughly 15 minutes. The test has been lauded by President Donald Trump and used to screen the president, his staff and visitors to the White House.

    The FDA alert followed a preliminary report by New York University that found Abbott's test missed between a third to one-half of infections caught by a rival test in patients screened for the virus.

    Abbott rejected the findings, saying the researchers did not follow the instructions for using its test. The company pointed to alternate patient studies, including its own, that have found the test successfully detects between 91% and 95% or more of virus cases when compared to other tests.

    But similar problems with ID NOW's accuracy have been flagged in preliminary reports by researchers at Stanford University, Loyola University and the Cleveland Clinic.

    For now, the FDA is requiring Abbott to conduct follow-up studies in several different patient groups.

    The FDA's emergency standards "are still high but there is a significant difference in the body of work that what would go into a submission under the normal process," said Abbott vice president John Hackett. "Our normal process takes years to bring these out."

    Requiring bigger studies of all coronavirus tests could provide valuable information, but it could also strain the FDA's already stretched staff and resources, said Dr. Daniel Schultz, former director of the FDA's medical device center.

    Dr. Colin West of the Mayo Clinic worries doctors and patients have put too much confidence in the current crop of tests, when an unknown number of patients with COVID-19 are likely receiving false negative results.

    Even a modest error rate can have grave consequences during an outbreak like COVID-19. West gives the example of a test that is 95% accurate at detecting the virus and is used on 1 million people. That would still result in 50,000 people being incorrectly told that they don't have the virus.

    "The negative test does not mean that I'm off the hook," West said. "We just need to maintain that level of vigilance until we have a better sense of how good these tests really can be."

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    Momentum grows to outsource hospital tech functions in 2021
    Momentum grows to outsource hospital tech functions in 2021
    5 things to know about Google's $2.1B Fitbit acquisition
    5 things to know about Google's $2.1B Fitbit acquisition
    Sponsored Content
    Get Free Newsletters

    Sign up for free enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today

    The weekly magazine, websites, research and databases provide a powerful and all-encompassing industry presence. We help you make informed business decisions and lead your organizations to success.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS
    • Instagram

    Stay Connected

    Join the conversation with Modern Healthcare through our social media pages

    MDHC_Logotype_white
    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Advertise with Us
    • Ad Choices Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • News
      • This Week's News
      • COVID-19
      • Providers
      • Insurance
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition
    • Insights
      • ACA 10 Years After
      • Best Practices
      • InDepth Special Reports
      • Innovations
    • Transformation
      • Patients
      • Operations
      • Care Delivery
      • Payment
    • Data/Lists
      • Rankings/Lists
      • Interactive Databases
      • Data Points
    • Op-Ed
      • Bold Moves
      • Breaking Bias
      • Commentaries
      • Letters
      • Vital Signs Blog
      • From the Editor
    • Awards
      • Award Programs
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top 25 Innovators
        • Top 25 Minority Leaders
        • Top 25 Women Leaders
      • Nominate
      • Previous Award Programs
        • Excellence in Nursing Awards
        • Design Awards
        • Top 25 COOs in Healthcare
      • Other Award Programs
        • 100 Top Hospitals
        • ACHE Awards
    • Events
      • Conferences
        • Leadership Symposium
        • Healthcare Transformation Summit
        • Women Leaders in Healthcare Conference
        • Workplace of the Future Conference
        • Strategic Marketing Conference
        • Social Determinants of Health Symposium
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Minority Leaders Gala (2022)
        • Top 25 Women Leaders Gala
      • Webinars
      • COVID-19 Event Tracker
    • Listen
      • Podcast - Next Up
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Video Series - The Check Up
      • Sponsored Video Series - One on One
    • MORE +
      • Advertise
      • Media Kit
      • Newsletters
      • Jobs
      • People on the Move
      • Reprints & Licensing