DESTinY Potsdam meeting - breakout priorities by

Alive model

shonamcculloch — 2025-06-10 14:21:03 UTC

Brief overview of the Alive approach, implications for how we work with WP4 across all impact cases, ways of working, engagement of interest holders

Living evidence partnerships

shonamcculloch — 2025-06-10 14:21:22 UTC

Brief overview of what living means and implications, key elements to include in the protocols, and how we work with interest holders throughout the span of the project

Engagement plans for CoPs (communities of practice)

shonamcculloch — 2025-06-10 14:22:09 UTC

How do we work with the interest holders: first steps to input into the DEST, what considerations to make it living, how to support over time, what does the comms, asks and meetings schedule look like

IC2 and 5

shonamcculloch — 2025-06-10 14:22:24 UTC

Planning, topic, interest holders mapping, timelines

Evaluation across WPs - doesn't necessarily belong here / doesn't need to be led by WP1

shonamcculloch — 2025-06-10 14:23:09 UTC

Coordinate our evaluation efforts to avoid duplication, ensure we are all aligned and coordinated, especially in data/information gathering across WPs and from those in the communities of pratices (the users)

Data collection and sharing

shonamcculloch — 2025-06-10 14:23:32 UTC

We need a good strategy to share and collect data within and beyond the consortium. What data do we need? We need to define clear formats and requirements so that we can efficiently collect and archive relevant data

Interface evaluation

shonamcculloch — 2025-06-10 14:23:43 UTC

The human–repository interface is where we are currently lacking a lot of focus. We need to find the low-hanging fruit to improve basic capabilities like query development and searching. Doing so, we need to make sure to not get distracted with shiny features that don't actually speed up or otherwise improve work-flows. What are the big wins we can focus on next? We should not get distracted chasing LLMs—at the end of the day we need to present the data to humans?

Evaluation framework

shonamcculloch — 2025-06-10 14:23:57 UTC

What is the purpose of WP3? Is it just a facilitator between WP2 and others? Starting from the current evaluation framework, we need to define a clear scope of this workpackage and a shared understanding

Accuracy standards

shonamcculloch — 2025-06-10 14:24:09 UTC

Review results from survey on expectations of accuracy requirements when automating evidence synthesis

Planning next year

shonamcculloch — 2025-06-10 14:24:22 UTC

Following the evaluation framework, we need to map out the tasks for the following year and get commitments w.r.t. human resources. At the moment WP3 is just a side-quest for most.

Approach to mainstreaming

shonamcculloch — 2025-06-10 14:24:38 UTC

To include what are the expectations and timelines for mainstreaming ICs, what are the synergies and dependencies across the WPs, what overlap is there with CoP, and start developing plans for Impact Case 1.

Impact case dissemination and publication plans

shonamcculloch — 2025-06-10 14:24:47 UTC

Discuss and confirm where and how we plan to publish and disseminate the different impact cases (protocols, reviews, etc.)

IC2: From global to local evidence

shonamcculloch — 2025-06-11 07:46:09 UTC

Building an evidence map for climate & health in cities and human settlements

Synthesis methods development

shonamcculloch — 2025-06-11 07:46:29 UTC

expanding the methods toolkit for climate & health

Taxonomy / definitions / boundaries / vocabulary management

shonamcculloch — 2025-06-11 07:46:51 UTC

Evidence transfer

shonamcculloch — 2025-06-11 07:47:12 UTC

Finding suitable evidence when it is locally scare

Protocol workshop

shonamcculloch — 2025-06-11 07:47:36 UTC

Reviewing progress and planning ahead

Gold standards for DEST

shonamcculloch — 2025-06-11 07:48:53 UTC

we need further work on what is a gold standard DEST evaluation and what is a gold standard DEST evaluation dataset

Building a living evaluation infrastructure

shonamcculloch — 2025-06-11 07:49:08 UTC

Storytelling

shonamcculloch — 2025-06-11 07:49:32 UTC

As a means of communicating evidence - defining a blueprint application in DESTINY

Moving ahead from the EQWD

shonamcculloch — 2025-06-11 07:49:51 UTC

Early quick-win demonstrator

2025-06-11 09:54:29 UTC

Presentation of the scope of the demonstrator and its architecture. Then invite discussion around how we obtain feedback on: 1) scope; 2) taxonomy; 3) functionality; 4) UI

Moving to IP #1

2025-06-11 09:54:53 UTC

What do we need to do to move from the map we have to impact case study 1?

Data extraction speedboat

2025-06-11 09:55:11 UTC

Focus for the next few months: developing methods & tools for extracting data from PDF files (and other formats where needed). Description of task; discussion about what's needed; discussion about how to obtain the right datasets to develop the tools.

Accountability

2025-06-11 09:55:22 UTC

I am not sure how but we need to be accountable to each other and have some honest conversations about the work that each organization needs to deliver for the success of the collaboration

Scaling up the repository

2025-06-11 09:55:33 UTC

The repository has been designed to support multiple projects / downstream applications. We need to develop a strategy for considering when it's ready for additional use cases and how they should be supported / admitted etc

Optimising for study retrieval

2025-06-11 09:55:55 UTC

A blue sky / whiteboard session where we consider what we need to do next to optimise the repository for finding studies for specific reviews / maps (esp. those in living mode). Solutions may include developing an embeddings model / retrieving a proportion (or all?) full texts / developing a hybrid keyword / vector search.

Focusing our work on evidence-users

2025-06-13 05:59:34 UTC

It's key that we kick off the workshop with a focus on evidence-users and the real-world impacts we are working towards, to ensure this is the centre of our delivery (and not just our design). This could be a precursor to the Alive model and living partnerships sessions.