Session 1 Stream A by Eszter Kalman

Task-based participation

2026-07-22 00:26:49 UTC

Could you please give an example of how task-based participation works in practice?

Weighting?

2026-07-22 00:29:43 UTC

How many marks for CP? Also, would love to see the marking rubric.

2026-07-22 00:30:13 UTC

How did you manage the inequity in group work contribution

Assessment Type and Disadvantage

2026-07-22 00:34:08 UTC

The idea of "disadvantage" might apply to any particular type of assessment - so a variety of assessments across a curriculum should create a more equitable playing field?

Bookings method

2026-07-22 00:34:36 UTC

How did you schedule bookings? Was each assessor responsible for their own bookings or centrally controlled? Did you use Microsoft Bookings?

Reducing anxiety thru a mock IO

2026-07-22 00:38:26 UTC

In the Business School, we found giving students an opportunity to do a mock IO before ther real one reduced anxiety (anecdotal).

jaydensterling1 — 2026-07-22 00:38:51 UTC

For the anxiety graphs before and after the oral exams, was there any statistical analysis in the changes?

Were these recorded?

2026-07-22 00:42:33 UTC

Between-scenario normalisation

2026-07-22 00:43:34 UTC

Did you release the unadjusted marks before normalisation across scenarios and assessors?

Recording

2026-07-22 00:44:14 UTC

Were these recorded. What was used to do that?

Scenarios

2026-07-22 00:45:43 UTC

Did the students get the scenarios in advance? Or the topic areas in advance? Or just in the room? Or just when they reached the assessor?

Calibration

2026-07-22 00:46:03 UTC

Have you looked at research on confidence and calibration? Look up publications by Professor Stankov. This can help explain your findings.

Students responding to surveys

2026-07-22 00:46:49 UTC

I found it so impressive how you managed to get so mant students to respond to your surveys. Would you have any advice on how you achieved this?

This type of assessment really helps to avoid cheating through AI.

2026-07-22 00:47:00 UTC

Scripted/unscripted conversation

2026-07-22 00:51:07 UTC

The prompts for the IO look quite structured. Can the assessor move away from the script so that it feels more like a natural conversation OR do they stick to the script to promote a consistent assessment experience???

Prompts

2026-07-22 00:52:09 UTC

One concern I have is to make sure the IOA is not a simple oral examination. The prompts seems rigid and leave not much room for the 'interactive' part. Can you comment on how free-flowing were the sessions?

Dealing with students with a script

2026-07-22 00:53:23 UTC

How did you regain control of conversations where students really wanted to use their own script?

Alison Casey

Assessor exhaustion

2026-07-22 00:55:02 UTC

For next time, is there anything you would to to support yourself? E.g. building in breaks, scheduling over multiple days, etc. Did you also find it feasible to mark these on the spot?

English language skills

2026-07-22 00:59:59 UTC

Assessing English language skills can be part of the communication degree. We graduate students with English language degrees to work in English speaking workplaces.

Group IOA idea

2026-07-22 01:00:17 UTC

I think this could certainly reduce the workload for the assessor and would support a more interactive discussion format, whilst simulating a realistic workplace experience (e.g. meeting with a client to present a proposal which often may happen with more than 1:1)

Prompts and possible grade levels

2026-07-22 01:00:58 UTC

Did students know the match between prompts and potential grades? This might influence their choices or regrets with chosen choices.

What was your process of training your assessors to ensure fair marking?

2026-07-22 01:01:30 UTC

Comparison to simulated teaching assessments

2026-07-22 01:03:12 UTC

How did interactive orals compare to the traditional ‘teach a lesson’ style assessments?

Secure

2026-07-22 01:04:38 UTC

Do students know the questions in advance and prepare and regurgitate during the oral?

Take up of Cogniti agent?

2026-07-22 01:07:46 UTC

What was the voluntary % take up of the agent?

Does the practice bot support audio responses, or is it purely text-based? I'm interested in whether it can simulate a real-time conversation for students.

2026-07-22 01:08:35 UTC

Bot audio responses

2026-07-22 01:09:37 UTC

Does the practice bot support audio responses, or is it purely text-based? I'm interested in whether it can simulate a real-time conversation for students.

What were your marking and feedback methods?

2026-07-22 01:10:42 UTC

Did you use SRES or a rubric with comments in canvas?

What was the weighting of this task?

2026-07-22 01:11:04 UTC

Feedback by Audio or Video Recordings?

2026-07-22 01:11:43 UTC

You mentioned that students wanted more feedback and you had a shorter time to give it. Have you considered recording a video or audio for your students? Most of us can speak faster than we write so it can sometimes be a way that the students can get more feedback!

Marking criteria?

2026-07-22 01:15:41 UTC

How was it marked?

Scheduling tool

2026-07-22 01:19:16 UTC

Which scheduling tool you use for students bookings

Did you do the interactive orals in lecture time - like week 12/13 or during exam time?

2026-07-22 01:20:07 UTC

Is 15 mins enough per student for assessment?

2026-07-22 01:22:18 UTC

How much were you able to cover? What was the weighting? (or what do you think would be the maximum weighting?) Did you have a rubric?

Using a chatbot for the oral?

2026-07-22 01:22:20 UTC

What is your response to using a dedicated chat bot for the interview and recording that interaction and assessing it?

Mark differentiation

2026-07-22 01:25:21 UTC

Is there a distribution or are marks clumped together?

Equitable participation for group-based IOAs

2026-07-22 01:25:49 UTC

How would the marker assess and manage equitable participation from each group member in an IOA?

Using a chatbot for the interview?

2026-07-22 01:27:52 UTC

What is your response to assessing a recording of students' interaction with a dedicated chatbot?