Policy Working Group Meeting: Using and Building Evidence by https://padlet.com/kballard32/vkcdacrnt6vt3sau Made with ♥ en-us 2021-01-29 16:44:08 UTC 2021-02-01 17:54:08 UTC hello@padlet.com Commitment to and use of evaluation and evidence – for program design, community needs assessments, implementation, continuous improvement, or evaluation – varies widely. jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142096935
Some but not all programs have been independently evaluated and some but not all have required local evaluations of participating sites.

Some programs have required (and supported) grantees to collect data and use existing evidence to assess needs, develop action plans, set targets, monitor progress, or make mid-course corrections.

However, these programs generally did not define desired outcomes or metrics from the outset, and data collection has focused more on process measures than on results.

Grantees often lack capacity to collect and use data effectively and may need technical assistance to do so.

Few programs have effectively engaged community members in the collection, interpretation, or application of data.

Many conventional metrics and analytic tools may not effectively prioritize racial equity.

]]> 2021-01-29 19:03:18 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142096935 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142211130 From a Promise Neighborhood perspective, it's important to align systems that work together. A cradle to career approach is effective, focusing on transition points, and being thoughtful about that. Important to create support streams for each transition.]]> 2021-01-29 19:30:19 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142211130 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142215490 Construction of infrastructure (people across systems, and all levels) to support the transitions. This cuts across all our observations on use of evidence, community engagement.]]> 2021-01-29 19:31:24 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142215490 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142218776 Establishing process measures, not just outcome measures. Good to track extent support infrastructure is built. It's a way to track maturity in activities. Ensuring you're using continuous improvement and data . systems indicators outside of the primary domain for a specific program]]> 2021-01-29 19:32:13 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142218776 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142223015 Federal government is used to collecting data on process measures, than on outcomes. But they don't define values/principles that link process measures to key outcomes. Making sure you're not reinforcing power dynamics that marginalize groups.]]> 2021-01-29 19:33:21 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142223015 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142225652 Not a lot of intentionality around defining outcomes. By not defining outcomes at the outset, we focus on output rather than community outcomes. For example, it is easier to talk about jobs created rather than measuring impact on wealth and well being and quality of those jobs. For example, look at job creation, but also look at job quality.]]> 2021-01-29 19:34:03 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142225652 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142230093 Building capacity of local people and institutions to use evidence and data as a way to drive process of change you're looking for  - but this is not well invested in. E.g. Casey foundation's training - how do you help leaders use data in a way that drives conversation and change. It's a skill we don't spend a lot of time helping local people do. ]]> 2021-01-29 19:35:11 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142230093 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142237338 Failure to optimize investment. On negative scale, you may reinforce bad habits, power dynamics. Gives place-based programming a bad name, and hurts public support for them.]]> 2021-01-29 19:36:58 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142237338 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142242246 Varying level of focus on implementation and outcomes. In Obama era, there was intentionality around these 6 observaitons. Federal government as the biggest battleship, but faces legislative constraints around pursuing innovation. Mixed level of achievement on the 6 areas. ]]> 2021-01-29 19:38:08 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142242246 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142247007 New administration will need seriousness around the 6 issues (but they're not the universe) - will require intentionality. Accountability - in every department and agency. ]]> 2021-01-29 19:39:23 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142247007 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142250340 Exec Order - where does responsibility lie? who at the agency is responsible? Who's waking up thinking about racial equity, building power etc? Without someone being focused on this exclusively - then attaining the outcome will be much more difficult.]]> 2021-01-29 19:40:15 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142250340 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142255860 Need to think about implementation as well as politics. ]]> 2021-01-29 19:41:39 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142255860 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142259773 Other observations? When will you do it, time horizon, how to measure results. Are there clearly defined goals, measures, metrics?]]> 2021-01-29 19:42:43 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142259773 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142266504 Recognize limits of presidential power. Think about politics, people, personalities.]]> 2021-01-29 19:44:25 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142266504 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142271410 Higher Ed - links to economic mobility, innovation, civic infrastructure that is not only constructed but perpetually maintained. COVID has made this salient. Infrastructure at local level that's bought into a vision. Infrastructure allows you to focus on specific outcomes. Civic infrastructure as invisible AND necessary across predictors of mobility.]]> 2021-01-29 19:45:45 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142271410 jameslw20 https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142277107 People: important to make sure there's responsibility. Not just having it be 5% of someone's job, but having people be fully focused on these goals.  ]]> 2021-01-29 19:47:15 UTC https://padlet.com/kballard32/vkcdacrnt6vt3sau/wish/1142277107