<?xml version="1.0"?>
<rss version="2.0">
   <channel>
      <title>13 May - SHINE Evaluation Toolkit Validation Exercise by Lyon Koh</title>
      <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9</link>
      <description>Thank you for joining us in this journey! Your contribution to validate this toolkit will be recognized. :)</description>
      <language>en-us</language>
      <pubDate>2025-05-12 04:07:13 UTC</pubDate>
      <lastBuildDate>2025-06-24 15:28:58 UTC</lastBuildDate>
      <webMaster>hello@padlet.com</webMaster>
      <image>
         <url></url>
      </image>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3447998912</link>
         <description><![CDATA[<p>Should resource management clarifications (eg costing of manpower hours, justification for why we need specific headcount, logistical costs, etc) be a part of the programme planning phase?</p><p><br/></p><p>Consideration: to justify requiring specific funding from funders, how will this cost be justified thru the outcome/ROI </p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 06:46:10 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3447998912</guid>
      </item>
      <item>
         <title>Thoughts</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448019048</link>
         <description><![CDATA[<p>Aside going to collect data, perhaps a note/FAQ on identifying what workable "data" is? So workers can understand data is something we are already collecting eg attendance, debrief themes vs something we need to separately collect </p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 06:56:18 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448019048</guid>
      </item>
      <item>
         <title>Assessment of Expertise Resources</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448024373</link>
         <description><![CDATA[<p>Programme lead - How to assess the expertise resources at each stage? for example, for data analyses how to assess the staff is competent in various data analyses, whether SHINE has internal resources, when to look for external resources? </p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 06:58:53 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448024373</guid>
      </item>
      <item>
         <title>Must we always use client-centric evaluation for data collection</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448034884</link>
         <description><![CDATA[<p>Difficulties in assessing and evaluating pre-post results for youths, especially when questions tend to be very arbitrary and lacking a lot more context or nuances. Wondering if professionals-led data collection and assessment/evaluation might also be accepted as data collection? </p><p>(E.g. using the YLSCMI assessment tool for pre-post evaluation)</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:03:56 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448034884</guid>
      </item>
      <item>
         <title>Scribe</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448058432</link>
         <description><![CDATA[<p>need to check accuracy of the transcription</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:14:54 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448058432</guid>
      </item>
      <item>
         <title>Stage 0</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448063446</link>
         <description><![CDATA[<p>double-check that the requisites of each stage are met</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:18:05 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448063446</guid>
      </item>
      <item>
         <title>develop shared language for data analyses</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448071437</link>
         <description><![CDATA[<p>develop or educate - does not mean staff need to have expertise</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:22:10 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448071437</guid>
      </item>
      <item>
         <title>automate data cleaning?</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448085464</link>
         <description><![CDATA[]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:30:38 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448085464</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448086337</link>
         <description><![CDATA[<p>Is there a list of people we can turn to if we have concerns/require clarifications? To consider using AI models/tools?</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:31:13 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448086337</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448094702</link>
         <description><![CDATA[<p>to include in FAQs:</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:35:54 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448094702</guid>
      </item>
      <item>
         <title>Keep in mind final aims</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448099670</link>
         <description><![CDATA[<p>If want to publish - IRB is strongly recommended. Otherwise, internal IRB etc </p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:38:52 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448099670</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448102656</link>
         <description><![CDATA[<p>if each stakeholder has indicated different outcomes, how to align the different outcomes yet reduce survey fatigue? </p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:40:44 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448102656</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448103653</link>
         <description><![CDATA[<p>to add in checklist:</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:40:59 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448103653</guid>
      </item>
      <item>
         <title>Importance of data collection</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448107126</link>
         <description><![CDATA[<p>How can we help to educate ground staff and inculcate the importance &amp; essentality of data collection and how it is already weaved into daily processes, such that it is done purposefully</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:43:18 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448107126</guid>
      </item>
      <item>
         <title>Data collection - Meaningful data collection</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448108642</link>
         <description><![CDATA[<p>To educate both planning &amp; ground staff to ensure that the data collection means and methods are able to meet the data collection aim.</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:44:26 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448108642</guid>
      </item>
      <item>
         <title>Incentivize responders</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448109635</link>
         <description><![CDATA[<p>How can we incentivize participants to respond, and the guidelines for incentivisation?</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:45:07 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448109635</guid>
      </item>
      <item>
         <title>How to tie down the most apt outcomes?</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448114125</link>
         <description><![CDATA[<p>For emerging/new programmes, team may have some outcomes in mind, but there may be some important outcomes or benefits to the youths which they feel is important as well.</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:47:57 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448114125</guid>
      </item>
      <item>
         <title>What is benchmarks and where to find it?</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448118250</link>
         <description><![CDATA[<p>links to SEF benchmarks, and other benchmarks of normed tools etc</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:50:34 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448118250</guid>
      </item>
      <item>
         <title>Helpful resources to include</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448119041</link>
         <description><![CDATA[<p>1) Fidelity checklist - to include an example of a script used in FGD/ guidelines on how to design a script used in qualitative interviews. </p><p><br/></p><p>2) Examples of benchmarks for a good fidelity training </p><p><br/></p><p>3) Inclusion of Internal Ethics Review form </p><p><br/></p><p>4) Guidelines of how to decide minimum sample size for data collection &amp; on how and how much to follow up on participants that did not respond/missed surveys</p><p><br/></p><p>5) Guidelines on whether we should reconsider participant criteria if there is low response rate, and if so, how should we restructure the criteria while meeting the intended aim of the data collection</p><p><br/></p><p>6) Inclusion of sector-specific governance for data collection (NCSS sector eval framework) &amp; Inclusion of SHINE specific policies regarding data collection from clients</p><p><br/></p><p>7) Inclusion of a document to highlight different methods of data collection (pros and cons), and to also be able to justify the choice of data collection method. </p><p><br/></p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:51:10 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448119041</guid>
      </item>
      <item>
         <title>how to use the data analysis tools responsibly and mentioned that they are free</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448120641</link>
         <description><![CDATA[]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:52:13 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448120641</guid>
      </item>
      <item>
         <title>Review of data collection fidelity</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448122079</link>
         <description><![CDATA[<p>Ways to review data collection fidelity (e.g. reviewing of recordings of FGD to ensure the FGD was done according to plan)</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:53:17 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448122079</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448127472</link>
         <description><![CDATA[<p>Need clarification about what "having a call to action" means</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:56:38 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448127472</guid>
      </item>
      <item>
         <title>Resources</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448129427</link>
         <description><![CDATA[<p>Having sections customised to different stakeholders is useful, makes it easy to understand what each stakeholder might be looking for.</p><p><br/></p><p>Resources also useful because they're all located in one place</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 07:57:53 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448129427</guid>
      </item>
      <item>
         <title>Identifying stakeholders should be done in earlier stages</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448132965</link>
         <description><![CDATA[<p>Stakeholders should already have been identified to ensure that the necessary data for each stakeholder has been collected. Rather, the focus should be on how to strategically engage each stakeholder e.g. how to present data to stakeholders, and what is each specific stakeholder particular about?</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:00:10 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448132965</guid>
      </item>
      <item>
         <title>Tailoring eval to funder</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448144061</link>
         <description><![CDATA[<p>Must take into account that content of the eval depends on what the funder is looking for. E.g. if they're only concerned about what the tangible return on each dollar of their investment is, they might not be so concerned about the programme's impact</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:07:42 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448144061</guid>
      </item>
      <item>
         <title>Considerations when looking for funders</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448145402</link>
         <description><![CDATA[<p><br/></p><p>Would be useful to have resources on possible factors to bear in mind when looking for funders. E.g. track record of potential funder's past partnerships, administration and budgeting procedures (example, disbursement vs reimbursement method)</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:08:45 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448145402</guid>
      </item>
      <item>
         <title>Power BI, AI models</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448148785</link>
         <description><![CDATA[<p>Actually knowing Power BI is enough, AI models might not be so relevant if we know how to use Power BI. But need to use additional brain space to learn Power BI</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:11:04 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448148785</guid>
      </item>
      <item>
         <title>how to identify stakeholders at ToC/LM stage? </title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448154762</link>
         <description><![CDATA[<p>who is important? will be different for every programme coz at different life stage. who are essential etc</p><p><br/></p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:15:39 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448154762</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448156368</link>
         <description><![CDATA[<p>Is the objective of the tool to articulate impact or outcome? Is it supposed to help differentiate outcome vs impact?</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:16:50 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448156368</guid>
      </item>
      <item>
         <title>How to prioritise feedback/suggestions</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448161358</link>
         <description><![CDATA[<p>After gathering feedback, how to prioritise what to follow up on?/How to know which gaps to tackle first? Some kind of framework to decide would be useful</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:20:08 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448161358</guid>
      </item>
      <item>
         <title></title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448168541</link>
         <description><![CDATA[<p>Step 0 and Step 1:</p><p>	• Is there a need for this service? Inward alignment and external alignment</p><p>	• Who are the interested parties? Who are our competitors? Who will be supportive?</p><p>	• Program decision tree (finance?)</p><p>	• Obtaining inputs from key stakeholders for further refinement</p><p>		○ May/not precede ToC and LM</p><p>		○ Youth-led is if input from key stakeholders come first, professional-led is if it does not come before ToC and LM</p><p>		○ For certain programmes (e.g., CRESTY), the key stakeholder input is alr determined before ToC and LM</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:25:51 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448168541</guid>
      </item>
      <item>
         <title>Risk Considerations</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448183163</link>
         <description><![CDATA[<p>Fidelity checklists - implement for higher risks situation e.g. heavily run by volunteers</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:37:06 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448183163</guid>
      </item>
      <item>
         <title>how to engage stakeholders and hold them responsible for the parts of the evaluation as agreed</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448187591</link>
         <description><![CDATA[]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:40:32 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448187591</guid>
      </item>
      <item>
         <title>toolkit inclined to programmes where team has full control. </title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448189069</link>
         <description><![CDATA[<p>many programmes tend to have stakeholders involved in different stages.</p>]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:41:48 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448189069</guid>
      </item>
      <item>
         <title>Do we need a guide to help users decide which stage the programme is at?</title>
         <author></author>
         <link>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448195915</link>
         <description><![CDATA[]]></description>
         <enclosure url="" />
         <pubDate>2025-05-13 08:47:00 UTC</pubDate>
         <guid>https://padlet.com/lyon_koh/odscyw5vlcwmq0f9/wish/3448195915</guid>
      </item>
   </channel>
</rss>
