Data informed decision making by Sarah Knight

Data collection approaches

2024-07-10 09:59:06 UTC

Anna (University of Westminster) - Didn't use any existing data. Decided to design own survey. Survey designed alongside framework and toolkit. Chose organisation digital culture as a theme. Based on 11 topic areas to assess maturity came up with survey questions. 60+ questions too long. Reduced down to 40 questions a lot to answer and analyse. 42 responses. from 4 teams. Looked at different response from each of 4 teams wasn't telling them much. What do they all have in common? Identified 5 areas with significant gaps to target and support.

Data collection approaches

2024-07-10 10:04:05 UTC

Sean (Bath Spa University) - focus on staff aspects rather than student. Approach where they combined data from 'top desk' (service management tool) staff survey (general and pulse) and NSS combined. To see where pain points are. A year later still struggling with use of SharePoint. Asked questions around 'how comfortable do you feel' etc.

2024-07-10 10:06:18 UTC

Julie (City University) New president, new strategy and no digital. Can't just assume it will get done.

Data collection approaches

2024-07-10 10:07:28 UTC

Jane (Manchester University) - new to insights survey launched last academic year. Doing analysis and feedback to various committees with framework in mind to raise awareness.

2024-07-10 10:08:05 UTC

More on digital wellbeing at Westminster what does it mean to people and how can they enhance it (Anna)

Data collection approaches

2024-07-10 10:14:58 UTC

Rob (Cardiff Met) Gartner data sets and IT benchmarking from another university and insights survey. Try to triangulate helped to start conversations. Wanted to be able to benchmark. Focus on the gaps. How can we give advice and guidance on how the framework can be used. Can Jisc present pathways to help people navigate? What's Rob's advice to other orgs? Wants to tell a story to the institution can help to triangulate and make change across org. Careful not to take data sets out of context.

2024-07-10 10:18:10 UTC

David (Uni of Bed) - picked experts from areas e.g. digital literacies. Understand what's expected. Strategy written by humans and other by Chat Gpt to show university that AI isn't going to solve all issues. Using all data sources to help uni understand what's important. ICT team doing something to do with digital transformation brought them closer. Learning experience on both sides. Asking questions to identify if people actually understand what accessibility is (for example)

2024-07-10 10:19:01 UTC

Lack of join-up and understanding about data. Data sets in different places. Needs sorting.

2024-07-10 10:20:36 UTC

Rachel - understanding maturity across themes (framework) digital fluency area of weakness and data. They gathered and analysed data use of framework gave them something tangiable. Strategic initiatives ongoing want to use framework to monitor progress - need to put to senior team to see what they think

2024-07-10 10:21:28 UTC

Rob (Northampton) - move toward having quality data at the moment data sets saying slightly different things.

2024-07-10 10:22:16 UTC

Some surveys seem to take so long to move to action

2024-07-10 10:24:07 UTC

Hull - used data maturity model with people and carried out workshops. Created own survey in background. Found it difficult to get people to engage with Jisc framework. Got experts in room to help inform next steps. Tweaking around maturity model survey too long and cumbersome. People they need to engage and don't want survey to be a barrier.

2024-07-10 10:25:37 UTC

Bedfordshire - students easy to engage.

Data collection approaches

2024-07-10 10:32:18 UTC

Hull - used online surveys challenge was having to do something with data. Designed own internal survey do a bit of analysis produce a radar graph. Challenge was sharing data back in a meaningful way. Used 'onsite day' to present back. People wanted it simplifying so key themes could be identified. They focused on digital culture. Helped with visualisation and next steps

2024-07-10 10:33:21 UTC

Judith - used surveys and workshops. Didn't have existing sources of data but they identified common themes. Given them strong set of evidence to present to ELT.

2024-07-10 10:35:44 UTC

Manus - need to be better at how we use data. Bit chaotic in way we collect data. People talk about data as evidence but it's down to the interpretation. Can you really rely on it as evidence if only a small portion of people respond to survey? How do we mitigate that? Data is only one part of the equation. Getting knowledgeable staff around the table as well as collecting data. Data can be a good starting point to give you something to discuss or direction. Looking to bring someone in to a data role.

2024-07-10 10:39:27 UTC

Teesside - set out to do a lot but had a lot of change internally. Data comes from conversations with people. Feedback from various initiatives. Wanted to do stuff around course design events e.g. courses that are being redesigned and how they can build in digital literacies. Student focus groups what does authenticate assessment mean to them? But things have stalled. New project around delivering AI across the organisation and working collaboratively with student union. Staff guidance, communications etc all done in collaboration. Getting guidance from student union around the language to use to engage students - best placed to understand what's going to have the biggest impact on students. Ann/Paul work is staff facing but this has been useful.

What extent has NSS played a role in projects?

2024-07-10 10:40:32 UTC

Teesside - could have fed into the projects they wanted to run but didn't get off the ground for one reason or another.

2024-07-10 10:42:37 UTC

Is there a consistent definition of what digital means at an institution? In some institutions it is viewed and the IT infrastructure and software

2024-07-10 10:49:20 UTC

Colleen - fact finding engaging with different stakeholders. Didn't use a data set per se. Collected people's views. Adapted maturity model to make AI relevant and digestible. Set up meetings. Got feedback, reviewed and collate into set of action plans. Sent out actions plans with a video of journey so far along with interactive survey - asking do they meet the needs etc. In process of getting that feedback.

2024-07-10 10:51:32 UTC

Education technology forum different voices from across the university people commissioned to do a review of systems and practices. They know stuff is happening but not to what extent. Learning analytics as an example - what's the data telling us now and what can we do with it? Subtle differences between the articulated and actual strategy. How do people know what the strategy means?

2024-07-10 10:53:20 UTC

Abertay - AI and assessment. Reality of AI is it destroying assessment? Doing a review of it but actually only a small percentage of disciplinaries. Don't pretend AI is the bad guy - how can they use it more proactively and positively. How are staff engaging with students on this?

2024-07-10 10:56:40 UTC

East London - survey of staff using gen AI to help formulate the guidelines. 3 areas - those who haven't used at all, those who pretend they don't but the do, those early adopters. Getting people to work smarter through the use of AI. Trying to bring professional and academic staff together only got 100 people responding. Internal challenges around getting approval can be slow.

2024-07-10 10:57:51 UTC

Less faculty involvement than they would like. Challenge is that they are talking about a lot of things at the minute. So need to think about how and when they fit that in.

2024-07-10 10:58:26 UTC

LJMU - Culture aspect first then to widen net and broaden introduction to the framework

2024-07-10 11:00:00 UTC

Abertay - Staff lacking confidence around AI - doing workshops to help build confidence.

LJMU - placement students using AI in the job so it's expected