Learning retrospective - ActivityInfo experience by CALI

Require the input of targets for each indicator. The USAID performance plan template includes them, so programs have them, they just aren't recording them in AI. We need to decide if these targets should be annual (requiring additions to data entry) or program lifetime.

2024-02-14 16:37:09 UTC

Asking for Indirect Participant numbers. Counting them is needlessly confusing to program staff (possibly souring them on counting the other IREX indicators), indirect participants are tenuously tied to impact at best, and the data is not used.

2024-02-14 16:38:03 UTC

Asking programs to enter data into AI on a quarterly basis.

2024-02-14 16:39:13 UTC

M&E still seen as a programmatic add-on, and not seen as an integral part of program implementation.

2024-02-14 16:40:03 UTC

The preference for simple counting indicators (outputs) rather than actual measurement of program effectiveness (outcomes).

2024-02-14 16:41:04 UTC

Establishment of a quarterly reporting process.

2024-02-14 16:41:32 UTC

Addition of IREX indicators into AMELPs.

2024-02-14 16:41:48 UTC

MEL staff involvement in program proposal development.

2024-02-14 16:42:23 UTC

Assessing program achievement of planned objectives.

2024-02-14 16:43:19 UTC

Investing in data collection, data analysis, and data visualization tools. If we want better programs, we need to invest in the tools that can get us there. AI is a great data management foundation. Now, let's provide the tools to build on that foundation.

2024-02-14 16:45:26 UTC

Add finance codes to programs in the program form and standardize program names

IREXCALI — 2024-02-14 17:00:24 UTC

It would be great to merge data in AI with other data systems but the lack of a shared unique identifier for programs makes it challenging.

Increased awareness of AI and the ask for MEL data

kpuntambekar — 2024-02-14 17:15:01 UTC

Establish an annual calendar of SEL/MEL activities so that we can plan our year, devote adequate time to data analysis, and not have deadlines sprung on us.

2024-02-14 17:16:13 UTC

The link to SEL and how programs can benefit from this exercise is still unclear. They still perceive this as primarily a exercise to help fulfil a requirement.

2024-02-14 17:16:42 UTC

Continuing messaging for use and integration of AI both to programs and SMT.

2024-02-14 17:17:44 UTC

require all programs to track participant data in AI

IREXCALI — 2024-02-14 17:17:55 UTC

This will help with issues around double counting and other data quality issues.

To include refined guidance on age disaggregation (age groups are guided by the donor requirements. In case if the donor does not have specific requirements over the age group, we should use age groups as defined by IREX: a. < 18 (children) b. 18-30 (youth)c. 31+ (adult)

2024-02-14 17:18:30 UTC

address the disconnect between quarterly reports and MEL data upload in AI

2024-02-14 17:18:46 UTC

General uptake of software has been good. People are interested in incorporating it into their programs

2024-02-14 17:19:22 UTC

Require indicator definitions, data sources, methods, and disaggregation info in the "add or edit" indicators form

IREXCALI — 2024-02-14 17:20:10 UTC

This will be particularly helpful for any cross-program learning and evaluation

To include definitions for SP Outcome codes somewhere, so anyone who sees IS-2 code - could go and read what that means actually (even if the current practice is that MEL Practice Lead assign the coding, going forward there needs to be more awareness among program colleagues/AI focal points on this)

2024-02-14 17:20:12 UTC

extend the proposed AI trainings to also include SEL outcome and REACH indicator orientations

2024-02-14 17:20:32 UTC

The early discussion around it I think sometimes made AI seem like a top-down need as opposed to a mutually beneficial software

2024-02-14 17:20:48 UTC

Need information about how to use the software on their programs

2024-02-14 17:21:20 UTC

So many gaps in program start/end dates and MEL points of contact. Also, redundancy with other systems programs are being asked to enter data into

IREXCALI — 2024-02-14 17:21:42 UTC

Standard tutorial/onboarding on AI as part of start-up stage for programs, with all the guidance, practices, resources and materials (this is being addressed)

2024-02-14 17:21:49 UTC

Equipping programs with information about it and then trusting them to use their judgement on how best to use it (flexibility within reason)

2024-02-14 17:22:18 UTC

Ensuring full data is submitted in AI when indicators are added initially for the program, including info on targets, definitions, etc.

2024-02-14 17:22:52 UTC

Add validation to the data entry form for certain or all indicators with % metrics

IREXCALI — 2024-02-14 17:23:38 UTC

open sessions to share the SEL report with the MEL leads and also with the organization as a whole ..so they can clearly see what was the result of their contributions and where they can leverage this data for their work

2024-02-14 17:24:29 UTC

Rolling out AI at the program level and providing guidance on that. Every program could/should manage their data in it

2024-02-14 17:24:49 UTC

I have weak capacity on AI capabilities when it comes to data analytics part, how to use AI for MEL tracking, etc.

2024-02-14 17:25:27 UTC

USAID reporting schedule mismatch with IREX reporting schedule

2024-02-14 17:45:30 UTC

Providing on-going support on AI: MEL leads/AI focal points being able to outreach to MEL Practice Lead and simply ask questions on AI (if more technical questions - then connect the program with the technical AI team/Charles and Sharon)

2024-02-14 17:46:45 UTC

why is the deadline for this so incompatible with program reporting

2024-02-14 17:56:03 UTC

Finalize formulations around definitions of IREX REACH indicators- to make it commplete and coherent across definitions used in the SP master table, what we have on a SharedPoint, and what we discussed in the Teams chat (we discussed this already)

2024-02-14 17:59:37 UTC

Add to the guidance on age disaggregation in Sharepoint and refer progrms to this when questions come up (see Diana and Matthew conversation in Teams)

IREXCALI — 2024-02-14 18:06:48 UTC

Help programs understand how their program is contributing to IREX's strategic plan outcomes - start by adding definitions or descriptions to the SEL codes in ActivityInfo

IREXCALI — 2024-02-14 18:09:10 UTC

AI improvements are something on-going: it would be great to come up with the way of raising/discussing/deciding/acting and making changes in AI. Maybe a shared document where we can pack things/requestions/questions and document follow up or something. We often raise many issues in Teams and then those discussions are left there and it is not clear what is the decision and if there will be a follow up. Maybe bring those issues during our regular MERL check in meetings.

2024-02-14 18:10:23 UTC

Talk to programs more about the value of ActivityInfo to them and how the data they submit is being used - Do this at trainings or webinars

IREXCALI — 2024-02-14 18:10:43 UTC

Clear up confusion around what FY to submit data for, especially for programs with different reporting years (e.g. a program has not analyzed data from FY23 for IREX indicators until Dec 2024 (FY24). Do they enter it in FY23 or FY24?)

IREXCALI — 2024-02-14 18:15:05 UTC

Targets - Can we test annual and Life of Program targets in ActivityInfo? Charles to create a test form for this that we can have a few programs pilot.

IREXCALI — 2024-02-14 18:16:07 UTC