Hospital software decisions driven by CIO peer networks
Skip to main content
MDHC_Logotype_white
Subscribe
  • My Account
  • Login
  • Subscribe
  • News
    • This Week's News
    • COVID-19
    • Providers
    • Insurance
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • People
    • Regional News
    • Digital Edition
    • Biden to reopen 'Obamacare' markets for COVID-19 relief
      Hospitals push CMS to pause 'most favored nation' drug-pricing rule
      Prime Healthcare settles with union workers, agrees to $458,000 in backpay
      Biden administration warns fully meeting vaccine demand could take 'months'
    • Biden to reopen 'Obamacare' markets for COVID-19 relief
      Biden administration warns fully meeting vaccine demand could take 'months'
      Hospital system rebuked after offering vaccine to donors
      Thousands of Portland's healthcare workers not vaccinated
    • Thousands of Portland's healthcare workers not vaccinated
      Ascension’s St. Mary’s Hospital Surgery Center at Towne Centre and Allegheny Health Network’s Bethel Park surgery center
      Hospitals see opportunity, risk in ambulatory surgery centers
      Health suffers as rural hospitals close
      Medicare ACO participants fell in 2021
    • Billing, antitrust exemption changes upend negotiations between insurers and providers
      MAIN-Health Bill_iStock_i.jpg
      Insurance-tech firm MultiPlan makes $155M buy after blank-check deal
      Last-minute COVID costs cut into UnitedHealthcare's $396 million operating income
      CMS approves rule forcing insurers to ease prior authorization
    • Biden to reopen 'Obamacare' markets for COVID-19 relief
      Hospitals push CMS to pause 'most favored nation' drug-pricing rule
      Regulation Tracker: Biden reviews Trump's final rules
      Hospital system rebuked after offering vaccine to donors
    • Anthem's Q4 profits drop 41% with added COVID costs, patient care
      jesse ford salud revenue partners headshot
      Sponsored Content Provided By Salud Revenue Partners
      How to succeed on self-pay: think ‘balance integrity’
      KPMG says deal activity will stay high in '21: 10 takeaways
      By the Numbers: 20 largest healthcare investment banks in 2020
    • Studies extend hopes for antibody drugs against COVID-19
      Google to convert office space for COVID-19 vax clinics
      Dr. Karen DeSalvo
      Next Up Podcast: What to expect with telehealth and healthcare technology in the next four years
      Next Up Podcast: What to expect with telehealth and healthcare technology in the next 4 years - Transcript
    • Amid COVID health worker shortage, foreign-trained professionals sit on sidelines
      China pushes conspiracy theories on COVID origin, vaccines
      An older man wearing a mask receiving a vaccine.
      Want more diversity in clinical trials? Start with the researchers
      Avocado
      Avocado a day keeps the doctor away
    • Humana names first chief equity officer
      WEb_i.jpg
      Q&A: Dr. Cliff Megerian, University Hospitals' soon-to-be CEO
      ZentyWeb_i.jpg
      Tom Zenty is leaving a legacy of transformational growth at University Hospitals
      Cerner names Erceg as new CFO
    • Midwest
    • Northeast
    • South
    • West
  • Insights
    • ACA 10 Years After
    • Best Practices
    • InDepth Special Reports
    • Innovations
    • The Affordable Care Act after 10 years
    • New care model helps primary-care practices treat obesity
      doctor with patient
      COVID-19 treatment protocol developed in the field helps patients recover
      Rachel Wyatt
      Project to curb pressure injuries in hospitals shows promise
      Yale New Haven's COVID-19 nurse-staffing model has long-term benefits
    • Modern Healthcare InDepth: Breaking the bias that impedes better healthcare
      Videos: Healthcare industry executives describe their encounters with racism
      Michellene Davis
      Healthcare leadership lacks the racial diversity needed to reduce health disparities
      Dr. James Hildreth
      How medical education can help fight racism
      Quotes from rebadged employees
      Outsourcing IT, revenue cycle takes toll on internal culture
    • A phone screen showing the question, "Mary we hope this information was helpful and we'd like to keep guiding you. Are you interested in knowing when it's your turn to receive the vaccine?"
      Chatbots, texting campaigns help manage influx of COVID vax questions
      A woman with a wearable sensor talking to her provider.
      Wearable sensors help diagnose heart rhythm problems in West Virginia
      self service station
      COVID-19 pushes patient expectations toward self-service
      Targeting high-risk cancer patients with genetics
  • Transformation
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Highmark Health inks six-year cloud, tech deal with Google
      Study: 1 in 5 patients report discrimination when getting healthcare
      HHS proposes changing HIPAA privacy rules
      Android health records app launches at 230 health systems
    • California hospitals prepare ethical protocol to prioritize lifesaving care
      Amazon, JPMorgan Chase, Berkshire Hathaway disband Haven
      Digital pathways poised to reshape healthcare continuum in 2021
      Healthcare was the hardest hit by supply shortages across all U.S. industries
    • A phone screen showing the question, "Mary we hope this information was helpful and we'd like to keep guiding you. Are you interested in knowing when it's your turn to receive the vaccine?"
      Chatbots, texting campaigns help manage influx of COVID vax questions
      A woman with a wearable sensor talking to her provider.
      Wearable sensors help diagnose heart rhythm problems in West Virginia
      New care model helps primary-care practices treat obesity
      How hospitals are building on COVID-19 telehealth momentum
    • Regional insurers bet big on virtual-first plans
      MedPAC votes to boost hospital payments, freeze or cut other providers
      Most Next Gen ACOs achieved bonuses in 2019
      Congress recalibrates Medicare Physician Fee Schedule after lobbying
  • Data/Lists
    • Rankings/Lists
    • Interactive Databases
    • Data Points
    • Health Systems Financials
      Executive Compensation
      Physician Compensation
  • Op-Ed
    • Bold Moves
    • Breaking Bias
    • Commentaries
    • Letters
    • Vital Signs Blog
    • From the Editor
    • Wellstar CEO calls adapting for the pandemic her bold move
      Howard P. Kern
      Recognizing the value of telehealth in its infancy
      Dr. Stephen Markovich
      A bold move helped take him from family doctor to OhioHealth CEO
      Dr. Bruce Siegel
      Why taking a hospital not-for-profit was Dr. Bruce Siegel’s boldest move
    • Barry Ostrowsky
      Ending racism is a journey taken together; the starting point must be now
      Laura Lee Hall and Gary Puckrein
      Increased flu vaccination has never been more important for communities of color
      John Daniels Jr.
      Health equity: Making the journey from buzzword to reality
      Mark C. Clement and David Cook
      We all need to 'do something' to fight inequities and get healthcare right, for every patient, every time
    • The missing piece in our fight against COVID-19: primary care
      Ambulatory surgery centers offer extraordinary value in a high-cost healthcare system
       Alan B. Miller
      Looking ahead with optimism as we continue to transform healthcare
      Dr. Bruce Siegel
      By protecting the healthcare safety net, Biden can put us on the path to a stronger country
    • Letters: Eliminating bias in healthcare needs to be ‘deliberate and organic’
      Letters: Maybe dropping out of ACOs is a good thing for patients
      Letters: White House and Congress share blame for lack of national COVID strategy
      Letters: VA making strides to improve state veterans home inspections
    • Sponsored Content Provided By Optum
      How blockchain could ease frustration with the payment process
      Sponsored Content Provided By Optum
      Three steps to better data-sharing for payer and provider CIOs
      Sponsored Content Provided By Optum
      Reduce total cost of care: 6 reasons why providers and payers should tackle the challenge together
      Sponsored Content Provided By Optum
      Why CIOs went from back-office operators to mission-critical innovators
  • Awards
    • Award Programs
    • Nominate
    • Previous Award Programs
    • Other Award Programs
    • Best Places to Work in Healthcare Logo for Navigation
      Nominations Open - Best Places to Work in Healthcare
      Nominations Closed - Health Care Hall of Fame
      Nominations Open - 50 Most Influential Clinical Executives
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top 25 Innovators
    • Top 25 Minority Leaders
    • Top 25 Women Leaders
    • Excellence in Nursing Awards
    • Design Awards
    • Top 25 COOs in Healthcare
    • 100 Top Hospitals
    • ACHE Awards
  • Events
    • Conferences
    • Galas
    • Webinars
    • COVID-19 Event Tracker
    • ntt data logo lockup webinar
      Sponsored Content Provided By NTT DATA
      Webinar: Mistakes I’ve Made — Confessions of a Healthcare Cybersecurity Expert
      bright.md logo lockup webinar
      Sponsored Content Provided By Bright.md
      Webinar: Enabling a hybrid care model — Streamlining the patient path to both telehealth and in-person care
    • Leadership Symposium
    • Healthcare Transformation Summit
    • Women Leaders in Healthcare Conference
    • Workplace of the Future Conference
    • Strategic Marketing Conference
    • Social Determinants of Health Symposium
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Minority Leaders Gala (2022)
    • Top 25 Women Leaders Gala
  • Listen
    • Podcast - Next Up
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Video Series - The Check Up
    • Sponsored Video Series - One on One
    • Dr. Karen DeSalvo
      Next Up Podcast: What to expect with telehealth and healthcare technology in the next four years
      Carter Dredge
      Next Up Podcast: Ready, set, innovate! Innovation and disruption in healthcare
      Next Up Podcast: COVID-19, social determinants highlight health inequities — what next?
      Ceci Connolly
      Next Up Podcast: How to navigate the murky post-election waters
    • Beyond the Byline: Regulators aim to boost value push with fraud and abuse law updates
      An older man wearing a mask receiving a vaccine.
      Beyond the Byline: Verifying information on the chaotic COVID-19 vaccine rollout
      doctor burnout
      Beyond the Byline: How healthcare supply chain struggles contribute to employee burnout
      Beyond the Byline: Covering race and diversity in the healthcare industry
    • Leading intention promote diversity and inclusion
      Introducing Healthcare Insider Podcast
    • The Check Up: Dr. Joseph Kerschner
      The Check Up: Dr. Joseph Kerschner of the Medical College of Wisconsin
      The Check Up: Chip Kahn
      The Check Up: Chip Kahn of the Federation of American Hospitals
      The Check Up: Trenda Ray
      The Check Up: Trenda Ray of the University of Arkansas for Medical Sciences
      The Check Up: Dr. Kenneth Davis
      The Check Up: Dr. Kenneth Davis of Mount Sinai Health System
    • Video: Ivana Naeymi Rad of Intelligent Medical Objects
  • MORE +
    • Advertise
    • Media Kit
    • Newsletters
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
April 20, 2019 01:00 AM

Peer networks drive software decisions by hospital CIOs

Jessica Kim Cohen
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print
    Doctor using EHR
    Getty Images

    University Health System—a 617-bed health system based in San Antonio—recently kicked off a systemwide electronic health record installation, scrapping its current Allscripts EHR in favor of one from Epic Systems Corp. It’s a high-priced project: between expenses such as purchasing the EHR, training personnel and retiring outdated systems, University Health is putting $170 million toward the transition. 

    The breadth of Epic’s client base played a central role in its decision, particularly as the academic health system’s primary partner, the University of Texas Health Science Center at San Antonio, has used Epic for several years. The majority of other public health systems in Texas are also live on an Epic EHR, which University Health hopes will improve local interoperability. 

    “Data-sharing was a driver,” said Bill Phillips, senior vice president and chief information officer at University Health.   

    Despite vendors spending untold marketing dollars pitching their products’ standing on rankings produced by Black Book Research, KLAS Research and others, CIOs seem to be more driven by what’s happening in the market and good-old-fashioned peer networking.

    “I’ve been in the industry for a long time, and I know a lot of the people,” said Chuck Christian, chief technology officer at Indiana-based Franciscan Health, describing one of the key steps he takes when considering a new software purchase. “So I’ll pick up the phone and call people who use the same software.”

    Software purchases aren’t a decision to take lightly, as implementing a new system—such as an EHR—can involve millions of dollars. More than 90% of acute-care hospitals report being live on one or more EHRs, but hospitals often want to consolidate multiple products onto one system. That’s becoming a common case with rising rates of mergers and acquisitions.

    Given the multimillion—if not multibillion—dollar stakes, it makes sense IT leaders would turn to the experiences of their peers. Nearly two-thirds of hospital executives indicate that either they or their peers have felt their job security was in jeopardy during an EHR transition, according to a seven-year survey of hospital leaders conducted by Black Book. At the manager level or above, 5% of respondents claimed they or a peer had been fired or asked to resign because of EHR replacement costs or productivity issues.

    “With as much money as (new software) costs, those can be career-limiting decisions if you make the wrong one,” said Christian, who joined Franciscan Health April 8. He spoke with Modern Healthcare while at his previous role, vice president of technology at the Indiana Health Information Exchange.

    Lisa Grisim, associate CIO at Palo Alto, Calif.-based Stanford Children’s Health, also highlighted the perspective she gains from the CIO community—with an electronic twist. IT leaders at Stanford Children’s have moved many of these conversations online, by participating in group email lists with their colleagues.

    One of the electronic mailing lists Grisim is most active in is dedicated to CIOs at pediatric hospitals, which is coordinated through the Children’s Hospital Association.

    “We’re very connected within the healthcare IT industry, particularly among specialty and high-acuity children’s hospitals,” Grisim said. “We’ll regularly send out questions about what people are doing in ERP (enterprise resource planning), PACS (picture archiving and communication system), or whatever it might be.”

    Epic advantage

    This focus on peer-to-peer connections may, conceivably, give a leg-up to industry leader Epic.

    Epic and Cerner are virtually neck and neck in deployment of EHRs, according to the Office of the National Coordinator for Health Information Technology. Epic’s website boasts that all 20 of U.S. News & World Report’s top-ranked hospitals in 2018-19 used its EHR, as well.

    Add that to clinical staff’s familiarity. When Rochester, Minn.-based Mayo Clinic decided to implement a new EHR roughly five years ago, it searched for a system that could manage the academic medical center’s clinical, billing and revenue-cycle systems across all of its sites. Bringing in vendors to perform usability and functionality tests with hospital staff also played a major role in its final decision to choose Epic.

    “Because Epic is so heavily represented in large academic medical centers, many of our newer staff, residents, fellows, have practiced in an Epic medical center,” said Dr. Steve Peters, co-chair of the Plummer Project, Mayo’s nickname for the EHR installation. Mayo brought its final sites live on Epic in 2018, more than a year after launching the systemwide project in July 2017.

    But those rankings from research groups and input from consultants are not totally discounted. Grisim said Stanford Children’s uses the annual “Best in KLAS” rankings as part of its decisionmaking process, either before developing a request for proposals or after receiving responses, as a quick quality check.

    The trouble with rankings

    KLAS Research’s rankings have been dogged over the years by questions about its methodology and a perception of pay to play. The 2019 “Best in KLAS” rankings were based on interviews that the market research firm’s analysts conducted with C-level executives, managers and physician leaders at 4,500 hospitals and 2,500 clinics, but many of the reports the firm releases are based on much smaller samples. In a report on patient engagement published in February, Epic was listed as the top patient portal solution based on interviews with representatives from just 37 customer organizations.

    Epic scored 92 on the firm’s 100-point provider satisfaction scale. Athenahealth was the second-highest vendor listed in the report, with a score of 84.8, based on interviews with representatives from 30 customer organizations.

    KLAS will flag when it has limited survey responses on a solution that’s included in a report, leaving a note that reads “insufficient data.” For most of the provider software tools that KLAS evaluates, insufficient data means that the firm surveyed 15 or fewer customer organizations. Taylor Davis, executive vice president of strategy and development at KLAS, said these thresholds are based on confidence intervals. 

    “At 15 interviews, the confidence interval for somebody’s KLAS score tends to be plus or minus about 8 points,” Davis said. “If KLAS reports that your product is a 76 on the 100-point scale, you might be as low as the high 60s—it’s unlikely—or you might be as high as the low 80s, but you’re probably somewhere in the 70s. In about 15 interviews is statistically the first point, if we’ve done our job and randomly sampled, that we can start to say ‘Here’s where you are, generally.’ ”

    The firm’s target for sample sizes is higher, in the high 20s or 30s. At 30 interviews, the confidence interval goes down to plus or minus 3 to 4 points, he added. “We include (sample sizes) in every report,” Davis said. “We’re really open about what we do on our reports, and we know providers look at those (sample sizes) and take the feedback based on what they see.”

    KLAS has also been forced to tackle criticism that its rankings use a pay-to-play formula. KLAS addresses the concern on its website’s “frequently asked questions” section. The organization charges vendors fees to purchase its reports and to subscribe to KLAS membership—as a member, a vendor has access to the firm’s data and the opportunity to meet with analysts for feedback into its solutions. KLAS says that these payments do not affect a vendor’s performance score. 

    Cost of participation

    Allscripts CEO Paul Black said the company paid KLAS $455,000 in 2018. That includes subscription fees, which KLAS determines based on a vendor’s annual healthcare revenue, as well as costs associated with attendance at KLAS’ summits. 

    “I believe that KLAS should disclose how they get paid, just like industry analysts disclose if they have a position in a company,” Black said.

    When asked to comment on how Epic—this year’s “Best in KLAS” overall software suite—works with KLAS, including whether it had made payments to the firm in 2018, an Epic spokesperson said: “As with all vendors, we are charged an annual subscription fee to get access to the data on their website, and the price is based on our revenue.” 

    A Cerner spokesperson declined a request for comment, saying it’s the company’s corporate policy to not disclose contract amounts with partners due to a reasonable assumption of confidentiality between the parties.

    Many hospital leaders, such as Grisim, said they review KLAS’ reports for access to the firm’s research—the free-form responses providers give to the firm’s survey questions, which KLAS includes at the end of its reports—in addition to the rankings. That’s par for the course, according to Davis.

    “Providers report to us overwhelmingly that the most helpful research that we provide to them is the data and customer comments,” he said. It’s “the perspectives from their peers.”

    For these hospital IT leaders, the reports offer a pulse-check on their colleagues, adding perspectives that they might not have been able to reach directly. “It’s things you want to hear about from others who have used the technology you’re not currently using,” said Dr. John Halamka, CIO at Beth Israel Deaconess Medical Center in Boston.

    “I read these things to understand what others have experienced, but I’m a bit careful not to jump to concrete conclusions if sample sizes are small,” he said.

    There are many resources a CIO might consider—peer perspectives, market research, third-party consultants. But there’s no single, magic bullet that hospital CIOs can rely on. It’s about weighing all of this input across the board.

    “It’s looking at the KLAS research, picking up the phone and calling others you know in the industry, looking at (industry) blogs,” said Christian, who runs his own health IT opinion blog called the Irreverent CIO. “You have to take all of those as grains of salt as you piece the story together.”

    RELATED CONTENT

    Checklist: 6 steps to a new EHR purchase

    Largest number of certified EHR products in use, 2019

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    Studies extend hopes for antibody drugs against COVID-19
    Studies extend hopes for antibody drugs against COVID-19
    Google to convert office space for COVID-19 vax clinics
    Google to convert office space for COVID-19 vax clinics
    Sponsored Content
    Get Free Newsletters

    Sign up for free enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today

    The weekly magazine, websites, research and databases provide a powerful and all-encompassing industry presence. We help you make informed business decisions and lead your organizations to success.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS
    • Instagram

    Stay Connected

    Join the conversation with Modern Healthcare through our social media pages

    MDHC_Logotype_white
    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Advertise with Us
    • Ad Choices Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • News
      • This Week's News
      • COVID-19
      • Providers
      • Insurance
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition
    • Insights
      • ACA 10 Years After
      • Best Practices
      • InDepth Special Reports
      • Innovations
    • Transformation
      • Patients
      • Operations
      • Care Delivery
      • Payment
    • Data/Lists
      • Rankings/Lists
      • Interactive Databases
      • Data Points
    • Op-Ed
      • Bold Moves
      • Breaking Bias
      • Commentaries
      • Letters
      • Vital Signs Blog
      • From the Editor
    • Awards
      • Award Programs
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top 25 Innovators
        • Top 25 Minority Leaders
        • Top 25 Women Leaders
      • Nominate
      • Previous Award Programs
        • Excellence in Nursing Awards
        • Design Awards
        • Top 25 COOs in Healthcare
      • Other Award Programs
        • 100 Top Hospitals
        • ACHE Awards
    • Events
      • Conferences
        • Leadership Symposium
        • Healthcare Transformation Summit
        • Women Leaders in Healthcare Conference
        • Workplace of the Future Conference
        • Strategic Marketing Conference
        • Social Determinants of Health Symposium
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Minority Leaders Gala (2022)
        • Top 25 Women Leaders Gala
      • Webinars
      • COVID-19 Event Tracker
    • Listen
      • Podcast - Next Up
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Video Series - The Check Up
      • Sponsored Video Series - One on One
    • MORE +
      • Advertise
      • Media Kit
      • Newsletters
      • Jobs
      • People on the Move
      • Reprints & Licensing