ACTS COVID-19 Collaborative Learning Community

Összehasonlított verziók

Régi verzió 42

changes.mady.by.user Jerry Osheroff

Mentés ekkor:

összehasonlítva

Új verzió Aktuális

changes.mady.by.user Jerry Osheroff

Mentés ekkor:

Kulcs

  • Beillesztett sor.
  • Törölt sor.
  • Formázás megváltoztatva.

This page

...

introduces work by ACTS Collaborative Learning Community participants to

...

improve how

...

evidence and guidance is handled (e.g., made more computable and standards-based

...

) to enhance how 'living' CDS interventions and eCQMs for specific COVID-19 targets (and beyond) are developed and updated in a virtuous knowledge ecosystem cycle.

  • The figure in section Section A . is an overview of potential figure illustrating enhanced information flow around the Evidence/Knowledge/Quality Ecosystem Cycle - i.e., driven by more computable and standards-based evidence and guidanceThe table in section B.
  • Section B is an outline of Collaborative participants joint efforts to better detect and managing evidence/guidance updates that could potentially alter living CDS interventions that participants have deployed
  • Section C outlines ecosystem enhancement needs and opportunities, as well as the notes on a potential concept demo toolkit (in the 4th table column) for addressing those needs 
  • The diagram in section C. illustrates Section D is a diagram illustrating where and how a concept demo toolkit that makes evidence and guidance more computable and standards-based could enhance the Evidence/Knowledge/Quality Ecosystem (and Learning Health System) Cycle
  • The outline in section D. provides Section E is an outline with more details on about a potential concept demo toolkit The email excerpt in section E. provides considerations related to using computable/standards-based evidence descriptions to make developing and updating computable clinical recommendations more efficient and effective. for improved evidence/guidance computability
  • Section F is notes from a 10/13/20 email about a concept demo among Collaborative participants for enhancing and connecting links in the knowledge ecosystem

A. Evidence Ecosystem Enhancement - Overview Diagram

...

[DOC search hyperlink]

Image Removed

...


Image Added


UMN=University of Minnesota, ASH=American Society for Hematology, ACEP=American College of Emergency Physicians, NACHC=National Association of Community Health Centers, ACG=Adapting Clinical Guidelines for the Digital Age, LRC=Librarian Reserve Corps, COKA=COVID Knowledge Accelerator, SRDR+=AHRQ's Systematic Review Data Repository

B: Near-term Approach for Propagating Down the Knowledge Supply Chain Notifications about Potentially Important Updates Pertinent to Collaborative Participants' Living CDS Interventions 

Goal:

Illustrate how for sample targets (anticoagulation and/or COVID-19 testing/triage) we can signal to care teams (through 'living' CDS interventions) when a change in the evidence-review-guidance supply chain content for this target indicates a change in recommended care. Or this change indicates that the strength of evidence/guidance supporting a recommendation has changed. (The latter is important so this new information can be factored into patient-clinician shared decision making accordingly.)

...

  • UMN/VA teams serve as a core for addressing the goal; they each manage all facets of this supply chain and also consume its results via CDS interventions that support care for their patient populations.
    • Cultivate synergies between these 'full cycle' efforts and related Collaborative participant efforts - e.g., NACHC (testing/triage in health centers), ACEP/EvidenceCare COVID-19 Severity Classification/Triage/Disposition tool (see here), Australia Living COVID-19 Guidelines (anticoagulation), U Melbourne COVID-CARE and related efforts, etc.
    • Have teams responsible in each of these organizations for evidence surveillance/synthesis, guidance development/updating, and CDS development/updating/deployment collaborate among themselves and with other organizations in the Collaborative on this 'update notification' process and tooling.
    Consider
  • Consider ways to coordinate/advance current efforts:  SRDR/COKA, C19HCC Digital Guideline WG, COVID-NMA, COVID-END, AU Living Guidelines, and related efforts collaborate to demonstrate notification system that suggests to living CDS owners/implementers that updates should be considered.
    • see below sampling of sources that could be leveraged
    Document how evidence/guidance changes
  • Document how evidence/guidance changes are detected and addressed in current VA/UMN/other processes
    • enhancing these approaches to include a notification function (applicable across approaches) that propagates supply chain updates to all pertinent stakeholders throughout the chain, including those responsible for developing/maintaining CDS interventions.  
  • Phased enhancement approach
    • Document current state: VA/UMN/Australia/others (business-driven requirements - what works, pain points, lessons learned)
    • Define/deliver desired future state (Individual/collective)
      • quick/easy enhancements to processes/tools/resources used for detecting and managing evidence/guidance updates  (e.g., leverage pilot 'web diff tool' to detect changes on target web pages)
      • deeper architecture refinements to achieve more computable/standards-based evidence/guidance processing (build on COKA/SRDR explorations)

...

C. Ecosystem Needs, Enhancement Opportunities and Potential Concept Demo Outline


Ecosystem Step

High Priority Enhancement Needs/Opportunities1

Potential SRDR+/COKA-enabled Enhancements

Potential Stakeholder-driven Proof of Concept Demo (for Key Targets)2

Other Notes/Comments

Process evidence

  • Quickly identify/select evidence pertinent to topic (e.g., PICO-based inclusion criteria for a study)
  • Data extraction (e.g., results: numerators/ denominators, aggregate measures) from studies is labor intensive and error prone
  • Identify research gaps that require additional attention
  • computable expressions for PICO criteria (now working on outcome definition component); if evidence has standardized PICO tags, it will be faster to identify/select evidence.
  • computable expressions for results (statistics); if evidence has standardized, structured results reported it will be faster and more accurate to extract/upload data into review authoring tool
  • If evidence is in a computable form, can better understand and describe nature of research gap (so it can be filled).
  • A team uses a pilot COKA-enabled tool to identify and apply COKA tags to all studies (previous and emerging) related to COVID-19 and anticoagulation, triage. [e.g., leverage Doc Search, other tools on Evidence/Guidance CoP page to identify the pertinent evidence; explore use of AI to automate this tagging (Lisa Lang/NLM and Brian Alper/COKA have begun discussing this)]
  • EPCs (e.g., UMN for anticoagulation, ? others for other targets) use a concept demo COKA-enhanced version of SRDR+ to illustrate production of living systematic reviews.
  • Systematic reviewers are proactively notified when there are new studies so that updates to the systematic reviews can be considered. 
  • Cochrane registry has PICO tags (as do other systems), but since these aren't standardized, info can be missed. (searching Cochrane on 'diaper rash' may not find evidence tagged as 'nappy rash' - standard disease codes would address this)
  • SRDR has FHIR-based expression of outcome. COKA has outcome definition viewer coming soon. With SRDR-defined outcome tags and Cochrane-defined outcome tags mapped to the same standard, a search in one system can find evidence in the other system.  
  • Identify communities that might do a test to refine AI algorithms to do these kinds of tags [Lisa Lang for more details]
  • Could start with simple, higher-level structures to get things rolling, then, over time make the standards more finer grained regarding PICO details.
Produce Living Guidance
  • Need to quickly/easily determine (e.g., within/ across systematic reviews) judgements about quality of evidence and certainty of findings. This is problematic because different systematic reviews express these in different ways, making this critical information difficult to assess within and across reviews.
  • computable expression for evidence certainty (certainty assessments and reasons for these assessments); 
  • Guideline developers (e.g,. SCCM/ASH for anticoag, ACEP for ED triage, ? CDC for ambulatory triage) use a concept demo COKA-enabled tool to produce living, computable guidance (e.g., building on the type of functionality AU Living Guidelines has implemented with MAGICapp - see anticoagulation example; consider synergies with WHO living guideline on drugs for COVID-19)
  • Guideline developers are proactively notified when there's an update to systematic reviews so that updates to the guidance can be considered. 

Develop Computable Guidance (e.g., CDS/eCQMs, other computable process enablements and assessments)

  • C19HCC Agile Knowledge Engineering Teams use the pilot COKA-enabled tool that produces living, computable guidance to drive developing/updating of Computable Guidelines - and CDS/eCQMs derived from them - via connection to their CPG Template (will soon be migrated to the publicly accessible CPG on FHIR IG)
  • Teams are proactively notified when there's an update to the guidance so that updates to the CDS/eCQMs can be considered. 

Implement CDS/eCQMs
  • Care delivery participants need mechanisms to convey priority needs for which they need guidance/support to those who are producing that information.
  • Implementers are challenged by technical and change management issues that often impede success in achieving QI goals.

  • Leverage/enhance tools that help CDS/eCQM implementers address technical and change management challenges they face in deploying these tools in ways that improve care team workflows/information flows/satisfaction and enhance care delivery and outcomes.

Analyze/Use Care Results 

(report, produce evidence)



  • Those who provide evidence (e.g., study authors) capture data using standard PICO tags so that after-publication coding isn't required. Research funder (NIH, PCORI could require this. Have ACEP pilot this with triage-related articles in JACEP?)

[cautionary note: getting structure into journal articles (e.g., structured abstracts) have been challenging - perhaps even more challenging for this level of standardization]

Cross-cutting Issues



...

2More information about 'building blocks' for creating components of this 'fantasy' (e.g., standards, sources for inputs/outputs, tools/methods platforms) is on the Community of Practice webpages (see navigation bar left side of this page), and in this emerging catalog from the COVID-END project

...

D. Overview Diagram for Proof of Concept Demo Toolkit (computable evidence slide.pptx)

Image Modified

...

E. Notes on a More Comprehensive Proof of Concept Software Toolset 

The 4 proof of concept tools and related repository outlined below can be placed on an open source developmental website for public dissemination. Content development for these tools will be driven by Collaborative participant current efforts, e.g., focused on COVID-19 testing/triage in ambulatory and ED settings and anticoagulation in inpatient settings.


Image Modified


Tool 1: Create/Store/Access Computable Study Results Representation   

...

Excerpt from Knowledge DRAFT Elicitation Tool:

Screenshot of the Knowledge Draft Elicitation ToolImage Modified

[intervening portions omitted]

...

Excerpt from Knowledge DRAFT Elicitation Tool: 


Section F: notes from a 10/13/20 email about a concept demo among Collaborative participants for enhancing and connecting links in the knowledge ecosystem

COVID-19 patient management targets being pursued by ACTS Collaborative participants (anticoagulation and testing/triage) present a promising opportunity for a concept demonstration of making the knowledge supply chain/ecosystem more integrated, efficient and computable. For example:

  • The University of Minnesota (UMN) currently has anticoagulation CDS deployed for hospitalized patients with COVID-19 that they seek to make more 'living' and FHIR-enabled. (They're generating evidence that this guidance has favorable mortality implications when followed.) 
    • Evidence/guidance UMN is using is on this page - in the process of being updated. 
    • UMN is working with the C19HCC Digital Guidelines WG on leveraging CPG on FHIR for computable guidance development and implementation.
    • UMN evidence processing efforts are increasingly supported by the UMN EPC (which is doing this work outside its AHRQ-funded efforts). 
  • ACTS Collaborative participants are driving initiatives that could support these evidence ecosystem enhancements efforts at UMN in a concept demonstration. 
  • Regarding COVID testing/triage, 
    • ACEP/EvidenceCare has produced an evidence-based severity classification tool and seeks strategies and tools to keep this guidance in sync with evolving evidence.
    • NACHC is likewise supporting deployment of testing/triage CDS in health centers across the US, and seeks better mechanisms for keeping this up to date. 
    • VA also interested in this topic and in ways to better interconnect it's evidence ecosystem (e.g., evidence synthesis program, VA/DOD guidelines) to support living CDS interventions. 
    • University of Melbourne has a related patient self-monitoring initiative, is likewise interested in evidence ecosystem enhancement efforts, and is planning to leverage this ACTS Participant Window as a focal point for enhancing how AU focused efforts leverage and support similar work by others in the Collaborative.
  • Collaborative participants have already begun outlining ways to demonstrate enhanced knowledge ecosystem/supply chain functioning - see sections A-E on this page.  


This all suggests that the timing is ripe to define one or more specific demonstrations for better refining and interconnecting the supply chain links outlined above to deliver enhanced care processes and outcomes. Starting in the near term, and building toward more robustness and scaling as the explorations mature.