Hospital software decisions driven by CIO peer networks
Skip to main content
MDHC_Logotype_white
Subscribe
  • My Account
  • Login
  • Subscribe
  • News
    • This Week's News
    • COVID-19
    • Providers
    • Insurance
    • Government
    • Finance
    • Technology
    • Safety & Quality
    • People
    • Regional News
    • Digital Edition
    • Ohio to save $240M in Medicaid drug costs by running its own PBM
      MACPAC approves recommendations on specialty drugs, behavioral health
      Top R.I. state official will take over, review hospital agency
      No region in the world spared as virus cases, deaths surge
    • No region in the world spared as virus cases, deaths surge
      We're losing engaged providers, and healthcare will pay the price
      J&J vaccine problems hamper U.S. military vaccines overseas
      U.S. suicides dropped last year, defying pandemic expectations
    • Calls mount for Biden to track U.S. healthcare worker deaths from COVID
      Front-line workers want more assistance after a year of COVID-19
      Healthcare providers enter Philadelphia's legal fight to enact gun laws
      Taking population health expertise to the market
    • Cigna and Oscar expand their small business partnership
      5 things to know about Agilon Health's proposed IPO
      More than a half million Americans gain coverage under Biden
      Insurance auto-retention policies could halve number of people kicked off coverage
    • MACPAC approves recommendations on specialty drugs, behavioral health
      No region in the world spared as virus cases, deaths surge
      CMS wants to bump pay for hospices, SNFs next year
      MACPAC wants to cut Medicaid spending on high-cost specialty drugs
    • Outgoing UHS chief made almost 50% less in 2020 than 2019
      A hundred dollar bill cut into strips with a colorful background.
      Population health still at odds with fee-for-service
      Private equity could increase long-term Medicare spending, MedPAC says
      Jeb Bush, Marilyn Tavenner getting in on healthcare SPAC frenzy
    • Healthcare data breaches
      By the Numbers: National health information service providers
      Health systems are navigating the digital divide and vaccine access
      woman doctor shaking hands with nurse and smiling
      Sponsored Content Provided By Philips
      A stronger healthcare system requires bold new ways of working together
    • Fight against STDs lost amid coronavirus testing blitz
      Beyond the Byline: Kids' unchecked mental health needs pose long-term consequences
      Hospitals vary widely in reducing C-section rates, but some progress in other maternal health metrics
      Home improvement to be provided by ProMedica's new healthy homes initiative
    • Novant Health adds chief payor performance officer
      Kaiser Permanente names Comer chief IT officer
      Mass General Hospital's Slavin to retire as CEO
      UnitedHealthcare names Thompson as new CEO
    • Midwest
    • Northeast
    • South
    • West
  • Insights
    • ACA 10 Years After
    • Best Practices
    • Special Reports
    • Innovations
    • The Affordable Care Act after 10 years
    • A close-up of a woman receiving a COVID-19 vaccine.
      Providers in underserved communities work toward equitable vaccine distribution
      Josh Bradshaw
      How one rural Illinois county vaccinated 84% of its senior citizens by early March
      Dr. John Fischer
      Patient-reported outcomes tool for hernia surgery helps physicians improve care
      New care model helps primary-care practices treat obesity
    • A family photo of the the Hangens.
      Stressing the already burdened pediatric behavioral health system
      Jennifer Pannone and her daughter Victoria.
      Mental health access for children needs attention
      What's next for on-demand telehealth companies?
      A CalOptima PACE vaccination clinic.
      Will COVID-19 be the catalyst for creating a more sustainable healthcare system?
    • Ryan McGinnis
      Finding efficiencies in the OR using tech
      Dr. Daniel Hall
      UPMC pilots machine learning, telehealth to inform patient transfers
      A woman being recorded using her inhaler on a smartphone.
      Digital check-ins, connected inhalers help control asthma
      A phone screen showing the question, "Mary we hope this information was helpful and we'd like to keep guiding you. Are you interested in knowing when it's your turn to receive the vaccine?"
      Chatbots, texting campaigns help manage influx of COVID vax questions
  • Transformation
    • Patients
    • Operations
    • Care Delivery
    • Payment
    • Nearly 1 in 5 Americans skipped care due to cost last year
      COVID-19 long-haulers need holistic treatment, providers say
      Amazon expanding employee clinics into two more states
      What's next for on-demand telehealth companies?
    • Malpractice premiums peak in 2020, AMA survey shows
      A rendering of a cancer research institute at the University of Southern California that will include 5G.
      Healthcare providers determine how to best use ultrafast 5G
      Two-thirds of largest hospitals aren't complying with price transparency rule
      'Silver lining': Hospitals keep practices born in COVID rush
    • Addressing long-standing barriers needed for mental and physical health integration
      A close-up of a woman receiving a COVID-19 vaccine.
      Providers in underserved communities work toward equitable vaccine distribution
      The waiting room of a Kaiser Permanente clinic at a Target location.
      Health systems revamp their approach to retail clinics
      Josh Bradshaw
      How one rural Illinois county vaccinated 84% of its senior citizens by early March
    • CMS wants to bump pay for hospices, SNFs next year
      CMMI pauses new Direct Contracting model applications
      CMS wants to boost payments over 2% for inpatient rehab, psych facilities
      40 Oregon providers, insurers sign value-based care pact
  • Data/Lists
    • Rankings/Lists
    • Interactive Databases
    • Data Points
    • Health Systems Financials
      Executive Compensation
      Physician Compensation
  • Op-Ed
    • Bold Moves
    • Breaking Bias
    • Commentaries
    • Letters
    • Vital Signs Blog
    • From the Editor
    • Dr. Alan Kaplan
      The risks, rewards of taking organizations 'where they haven’t gone before'
      Wellstar CEO calls adapting for the pandemic her bold move
      Howard P. Kern
      Recognizing the value of telehealth in its infancy
      Dr. Stephen Markovich
      A bold move helped take him from family doctor to OhioHealth CEO
    • Drs. Hal Paz and Joshua J. Joseph
      Mobilized to fight the COVID crisis: a blueprint for community and academic partnerships
      Dr. Stephen Markovich
      Making sure we're aligned along the path to achieving inclusion
      Barry Ostrowsky
      Ending racism is a journey taken together; the starting point must be now
      Laura Lee Hall and Gary Puckrein
      Increased flu vaccination has never been more important for communities of color
    • We're losing engaged providers, and healthcare will pay the price
      Dr. Chris DeRienzo
      How COVID-19 broke health systems and made them stronger
      Bonnie Castillo and John Welton
      Dueling opinions: The role of mandated nurse staffing ratios
      Still crossing the quality chasm: a look at the IOM's seminal report 20 years later
    • Letters: Eliminating bias in healthcare needs to be ‘deliberate and organic’
      Letters: Maybe dropping out of ACOs is a good thing for patients
      Letters: White House and Congress share blame for lack of national COVID strategy
      Letters: VA making strides to improve state veterans home inspections
    • Sponsored Content Provided By Optum
      How blockchain could ease frustration with the payment process
      Sponsored Content Provided By Optum
      Three steps to better data-sharing for payer and provider CIOs
      Sponsored Content Provided By Optum
      Reduce total cost of care: 6 reasons why providers and payers should tackle the challenge together
      Sponsored Content Provided By Optum
      Why CIOs went from back-office operators to mission-critical innovators
  • Awards
    • Award Programs
    • Nominate
    • Previous Award Programs
    • Other Award Programs
    • Voting Open - 50 Most Influential Clinical Executives
      Nominations Open - Top 25 Innovators
      Nominations Open May 24 - Top 25 Emerging Leaders
    • 100 Most Influential People
    • 50 Most Influential Clinical Executives
    • Best Places to Work in Healthcare
    • Health Care Hall of Fame
    • Healthcare Marketing Impact Awards
    • Top 25 Emerging Leaders
    • Top 25 Innovators
    • Minorities in Healthcare
      • - Luminaries
      • - Top 25 Minority Leaders
      • - Minorities to Watch
    • Women in Healthcare
      • - Luminaries
      • - Top 25 Women Leaders
      • - Women to Watch
    • Excellence in Nursing Awards
    • Design Awards
    • Top 25 COOs in Healthcare
    • 100 Top Hospitals
    • ACHE Awards
  • Events
    • Conferences
    • Galas
    • Webinars
    • COVID-19 Event Tracker
    • emburse certify modern healthcare custom media webinar logo lockup
      Sponsored Content Provided By Emburse
      Webinar: Making it easy to manage costs
      virtualmed staff modern healthcare custom media logo lockup
      Sponsored Content Provided By VirtualMed Staff
      Webinar: Best practices for creating a successful telepsychiatry program
      telehealth visit man touching neck while speaking to doctor on computer
      Sponsored Content Provided By Accumen
      Webinar: How telehealth has evolved into a standard of care
      modern healthcare custom media and trimedx custom webinar logo lockup
      Sponsored Content Provided By TRIMEDX
      Webinar: Bridging the gap between clinicians and administration to improve capital equipment planning
    • Women Leaders in Healthcare Conference
    • Social Determinants of Health Symposium
    • Healthcare Transformation Summit
    • Leadership Symposium
    • Virtual Briefings
      • - Hospital of the Future
      • - Mental Health
      • - Patient Safety & Quality
      • - Strategic Marketing
      • - Virtual Health
      • - Workplace of the Future
    • Best Places to Work Awards Gala
    • Health Care Hall of Fame Gala
    • Top 25 Minority Leaders Gala
    • Top 25 Women Leaders Gala
  • Listen
    • Podcast - Next Up
    • Podcast - Beyond the Byline
    • Sponsored Podcast - Healthcare Insider
    • Video Series - The Check Up
    • Sponsored Video Series - One on One
    • Dr. Chris DeRienzo
      Next Up Podcast: Building team spirit in the wake of COVID-19
      Mikelle Moore
      Next Up Podcast: Mikelle Moore on recognizing all hospital workers during the pandemic
      Empty boardroom
      Next Up Podcast: What's going to happen tomorrow? Succession planning during emergencies
      Next Up Podcast: Educating patients on the COVID-19 vaccine with Tanya Andreadis
    • Beyond the Byline: Kids' unchecked mental health needs pose long-term consequences
      Beyond the Byline: How COVID-19 has impacted hospital finances
      An older man sitting on a hospital bed with his back toward the camera.
      Beyond the Byline: Upcoding could explain why hospitals are increasingly billing for the most complex treatment
      Beyond the Byline: Insurers are betting on virtual-first plans as COVID-19 shifts care pathways
    • James garvert neustar healthcare insider podcast image
      Building on basics
      Healthcare Insider Podcast Episode Art - Premier
      Why Roger Weems and other consultants are leaving the big firms to join Premier
      James garvert neustar healthcare insider podcast image
      Outreach during COVID-19
      ann barnes healthcare insider podcast image
      Leading with intention to promote diversity and inclusion
    • The Check Up: Matt Eyles
      The Check Up: Matt Eyles of AHIP
      The Check Up: Dr. Tom Shanley
      The Check Up: Dr. Tom Shanley of Lurie Children’s Hospital of Chicago
      The Check Up: Dr. Harold Paz
      The Check Up: Dr. Harold Paz of Wexner Medical Center at Ohio State University
      The Check Up: Pat Schou
      The Check Up: Pat Schou of the Illinois Critical Access Hospital Network
    • ivana naeymi-rad one on one intelligent medical objects
      Video: Ivana Naeymi Rad of Intelligent Medical Objects
  • MORE +
    • Advertise
    • Media Kit
    • Newsletters
    • Jobs
    • People on the Move
    • Reprints & Licensing
MENU
Breadcrumb
  1. Home
  2. Technology
April 20, 2019 01:00 AM

Peer networks drive software decisions by hospital CIOs

Jessica Kim Cohen
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print
    Doctor using EHR
    Getty Images

    University Health System—a 617-bed health system based in San Antonio—recently kicked off a systemwide electronic health record installation, scrapping its current Allscripts EHR in favor of one from Epic Systems Corp. It’s a high-priced project: between expenses such as purchasing the EHR, training personnel and retiring outdated systems, University Health is putting $170 million toward the transition. 

    The breadth of Epic’s client base played a central role in its decision, particularly as the academic health system’s primary partner, the University of Texas Health Science Center at San Antonio, has used Epic for several years. The majority of other public health systems in Texas are also live on an Epic EHR, which University Health hopes will improve local interoperability. 

    “Data-sharing was a driver,” said Bill Phillips, senior vice president and chief information officer at University Health.   

    Despite vendors spending untold marketing dollars pitching their products’ standing on rankings produced by Black Book Research, KLAS Research and others, CIOs seem to be more driven by what’s happening in the market and good-old-fashioned peer networking.

    “I’ve been in the industry for a long time, and I know a lot of the people,” said Chuck Christian, chief technology officer at Indiana-based Franciscan Health, describing one of the key steps he takes when considering a new software purchase. “So I’ll pick up the phone and call people who use the same software.”

    Software purchases aren’t a decision to take lightly, as implementing a new system—such as an EHR—can involve millions of dollars. More than 90% of acute-care hospitals report being live on one or more EHRs, but hospitals often want to consolidate multiple products onto one system. That’s becoming a common case with rising rates of mergers and acquisitions.

    Given the multimillion—if not multibillion—dollar stakes, it makes sense IT leaders would turn to the experiences of their peers. Nearly two-thirds of hospital executives indicate that either they or their peers have felt their job security was in jeopardy during an EHR transition, according to a seven-year survey of hospital leaders conducted by Black Book. At the manager level or above, 5% of respondents claimed they or a peer had been fired or asked to resign because of EHR replacement costs or productivity issues.

    “With as much money as (new software) costs, those can be career-limiting decisions if you make the wrong one,” said Christian, who joined Franciscan Health April 8. He spoke with Modern Healthcare while at his previous role, vice president of technology at the Indiana Health Information Exchange.

    Lisa Grisim, associate CIO at Palo Alto, Calif.-based Stanford Children’s Health, also highlighted the perspective she gains from the CIO community—with an electronic twist. IT leaders at Stanford Children’s have moved many of these conversations online, by participating in group email lists with their colleagues.

    One of the electronic mailing lists Grisim is most active in is dedicated to CIOs at pediatric hospitals, which is coordinated through the Children’s Hospital Association.

    “We’re very connected within the healthcare IT industry, particularly among specialty and high-acuity children’s hospitals,” Grisim said. “We’ll regularly send out questions about what people are doing in ERP (enterprise resource planning), PACS (picture archiving and communication system), or whatever it might be.”

    Epic advantage

    This focus on peer-to-peer connections may, conceivably, give a leg-up to industry leader Epic.

    Epic and Cerner are virtually neck and neck in deployment of EHRs, according to the Office of the National Coordinator for Health Information Technology. Epic’s website boasts that all 20 of U.S. News & World Report’s top-ranked hospitals in 2018-19 used its EHR, as well.

    Add that to clinical staff’s familiarity. When Rochester, Minn.-based Mayo Clinic decided to implement a new EHR roughly five years ago, it searched for a system that could manage the academic medical center’s clinical, billing and revenue-cycle systems across all of its sites. Bringing in vendors to perform usability and functionality tests with hospital staff also played a major role in its final decision to choose Epic.

    “Because Epic is so heavily represented in large academic medical centers, many of our newer staff, residents, fellows, have practiced in an Epic medical center,” said Dr. Steve Peters, co-chair of the Plummer Project, Mayo’s nickname for the EHR installation. Mayo brought its final sites live on Epic in 2018, more than a year after launching the systemwide project in July 2017.

    But those rankings from research groups and input from consultants are not totally discounted. Grisim said Stanford Children’s uses the annual “Best in KLAS” rankings as part of its decisionmaking process, either before developing a request for proposals or after receiving responses, as a quick quality check.

    The trouble with rankings

    KLAS Research’s rankings have been dogged over the years by questions about its methodology and a perception of pay to play. The 2019 “Best in KLAS” rankings were based on interviews that the market research firm’s analysts conducted with C-level executives, managers and physician leaders at 4,500 hospitals and 2,500 clinics, but many of the reports the firm releases are based on much smaller samples. In a report on patient engagement published in February, Epic was listed as the top patient portal solution based on interviews with representatives from just 37 customer organizations.

    Epic scored 92 on the firm’s 100-point provider satisfaction scale. Athenahealth was the second-highest vendor listed in the report, with a score of 84.8, based on interviews with representatives from 30 customer organizations.

    KLAS will flag when it has limited survey responses on a solution that’s included in a report, leaving a note that reads “insufficient data.” For most of the provider software tools that KLAS evaluates, insufficient data means that the firm surveyed 15 or fewer customer organizations. Taylor Davis, executive vice president of strategy and development at KLAS, said these thresholds are based on confidence intervals. 

    “At 15 interviews, the confidence interval for somebody’s KLAS score tends to be plus or minus about 8 points,” Davis said. “If KLAS reports that your product is a 76 on the 100-point scale, you might be as low as the high 60s—it’s unlikely—or you might be as high as the low 80s, but you’re probably somewhere in the 70s. In about 15 interviews is statistically the first point, if we’ve done our job and randomly sampled, that we can start to say ‘Here’s where you are, generally.’ ”

    The firm’s target for sample sizes is higher, in the high 20s or 30s. At 30 interviews, the confidence interval goes down to plus or minus 3 to 4 points, he added. “We include (sample sizes) in every report,” Davis said. “We’re really open about what we do on our reports, and we know providers look at those (sample sizes) and take the feedback based on what they see.”

    KLAS has also been forced to tackle criticism that its rankings use a pay-to-play formula. KLAS addresses the concern on its website’s “frequently asked questions” section. The organization charges vendors fees to purchase its reports and to subscribe to KLAS membership—as a member, a vendor has access to the firm’s data and the opportunity to meet with analysts for feedback into its solutions. KLAS says that these payments do not affect a vendor’s performance score. 

    Cost of participation

    Allscripts CEO Paul Black said the company paid KLAS $455,000 in 2018. That includes subscription fees, which KLAS determines based on a vendor’s annual healthcare revenue, as well as costs associated with attendance at KLAS’ summits. 

    “I believe that KLAS should disclose how they get paid, just like industry analysts disclose if they have a position in a company,” Black said.

    When asked to comment on how Epic—this year’s “Best in KLAS” overall software suite—works with KLAS, including whether it had made payments to the firm in 2018, an Epic spokesperson said: “As with all vendors, we are charged an annual subscription fee to get access to the data on their website, and the price is based on our revenue.” 

    A Cerner spokesperson declined a request for comment, saying it’s the company’s corporate policy to not disclose contract amounts with partners due to a reasonable assumption of confidentiality between the parties.

    Many hospital leaders, such as Grisim, said they review KLAS’ reports for access to the firm’s research—the free-form responses providers give to the firm’s survey questions, which KLAS includes at the end of its reports—in addition to the rankings. That’s par for the course, according to Davis.

    “Providers report to us overwhelmingly that the most helpful research that we provide to them is the data and customer comments,” he said. It’s “the perspectives from their peers.”

    For these hospital IT leaders, the reports offer a pulse-check on their colleagues, adding perspectives that they might not have been able to reach directly. “It’s things you want to hear about from others who have used the technology you’re not currently using,” said Dr. John Halamka, CIO at Beth Israel Deaconess Medical Center in Boston.

    “I read these things to understand what others have experienced, but I’m a bit careful not to jump to concrete conclusions if sample sizes are small,” he said.

    There are many resources a CIO might consider—peer perspectives, market research, third-party consultants. But there’s no single, magic bullet that hospital CIOs can rely on. It’s about weighing all of this input across the board.

    “It’s looking at the KLAS research, picking up the phone and calling others you know in the industry, looking at (industry) blogs,” said Christian, who runs his own health IT opinion blog called the Irreverent CIO. “You have to take all of those as grains of salt as you piece the story together.”

    RELATED CONTENT

    Checklist: 6 steps to a new EHR purchase

    Largest number of certified EHR products in use, 2019

    Letter
    to the
    Editor

    Send us a letter

    Have an opinion about this story? Click here to submit a Letter to the Editor, and we may publish it in print.

    Recommended for You
    Healthcare data breaches
    Healthcare data breaches
    By the Numbers: National health information service providers
    By the Numbers: National health information service providers
    Sponsored Content
    Get Newsletters

    Sign up for enewsletters and alerts to receive breaking news and in-depth coverage of healthcare events and trends, as they happen, right to your inbox.

    Subscribe Today
    MH Magazine Cover

    MH magazine offers content that sheds light on healthcare leaders’ complex choices and touch points—from strategy, governance, leadership development and finance to operations, clinical care, and marketing.

    Subscribe
    Connect with Us
    • LinkedIn
    • Twitter
    • Facebook
    • RSS
    • Instagram

    Our Mission

    Modern Healthcare empowers industry leaders to succeed by providing unbiased reporting of the news, insights, analysis and data.

    MDHC_Logotype_white
    Contact Us

    (877) 812-1581

    Email us

     

    Resources
    • Contact Us
    • Advertise with Us
    • Ad Choices Ad Choices
    • Sitemap
    Editorial Dept
    • Submission Guidelines
    • Code of Ethics
    • Awards
    • About Us
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Modern Healthcare
    Copyright © 1996-2021. Crain Communications, Inc. All Rights Reserved.
    • News
      • This Week's News
      • COVID-19
      • Providers
      • Insurance
      • Government
      • Finance
      • Technology
      • Safety & Quality
      • People
      • Regional News
        • Midwest
        • Northeast
        • South
        • West
      • Digital Edition
    • Insights
      • ACA 10 Years After
      • Best Practices
      • Special Reports
      • Innovations
    • Transformation
      • Patients
      • Operations
      • Care Delivery
      • Payment
    • Data/Lists
      • Rankings/Lists
      • Interactive Databases
      • Data Points
    • Op-Ed
      • Bold Moves
      • Breaking Bias
      • Commentaries
      • Letters
      • Vital Signs Blog
      • From the Editor
    • Awards
      • Award Programs
        • 100 Most Influential People
        • 50 Most Influential Clinical Executives
        • Best Places to Work in Healthcare
        • Health Care Hall of Fame
        • Healthcare Marketing Impact Awards
        • Top 25 Emerging Leaders
        • Top 25 Innovators
        • Minorities in Healthcare
          • - Luminaries
          • - Top 25 Minority Leaders
          • - Minorities to Watch
        • Women in Healthcare
          • - Luminaries
          • - Top 25 Women Leaders
          • - Women to Watch
      • Nominate
      • Previous Award Programs
        • Excellence in Nursing Awards
        • Design Awards
        • Top 25 COOs in Healthcare
      • Other Award Programs
        • 100 Top Hospitals
        • ACHE Awards
    • Events
      • Conferences
        • Women Leaders in Healthcare Conference
        • Social Determinants of Health Symposium
        • Healthcare Transformation Summit
        • Leadership Symposium
        • Virtual Briefings
          • - Hospital of the Future
          • - Mental Health
          • - Patient Safety & Quality
          • - Strategic Marketing
          • - Virtual Health
          • - Workplace of the Future
      • Galas
        • Best Places to Work Awards Gala
        • Health Care Hall of Fame Gala
        • Top 25 Minority Leaders Gala
        • Top 25 Women Leaders Gala
      • Webinars
      • COVID-19 Event Tracker
    • Listen
      • Podcast - Next Up
      • Podcast - Beyond the Byline
      • Sponsored Podcast - Healthcare Insider
      • Video Series - The Check Up
      • Sponsored Video Series - One on One
    • MORE +
      • Advertise
      • Media Kit
      • Newsletters
      • Jobs
      • People on the Move
      • Reprints & Licensing