Updating assessments by LFurze

What are the key skills/knowledge being assessed?

leonfurze — 2025-03-03 00:04:36 UTC

Based on the assessment

Which aspects are particularly vulnerable to the MISuse of AI? Why?

leonfurze — 2025-03-03 00:05:59 UTC

What would constitute appropriate AI use?

leonfurze — 2025-03-03 00:06:11 UTC

In what ways would AI use NOT get in the way of a student demonstrating the required skills and knowledge?

leonfurze — 2025-03-03 00:06:24 UTC

Which aspects, if any, would need to be changed to ensure the assessment is fair and gives a valid impression of the students' skills and knowledge?

leonfurze — 2025-03-03 00:06:42 UTC

leonfurze — 2025-03-03 00:08:19 UTC

Skills Assessed

sgunn21 — 2025-03-03 00:45:29 UTC

Skills = explaining, developing a hypothesis, design & improving method of investigation, analysing data, justifying conclusions, selecting evidence.

Essentially (the whole thing) however, this task is susceptible to students asking AI to anlayse data, define and explain scientific knowledge etc

2025-03-03 00:45:34 UTC

sgunn21 — 2025-03-03 00:46:44 UTC

Use of AI to coach/provide feedback on any of the assessable skills.

2025-03-03 00:47:23 UTC

Asking for feedback on formula application. Make sure that it is used accurately. Checking that response aligns withthe criteria.

maccawork — 2025-03-03 00:47:44 UTC

Using AI to explore concepts/processes to better understand the task - front loading

2025-03-03 00:48:30 UTC

The step that requires students to design an experiment seems rather vulnerable to AI misuse because the creative and critical thinking is outsourced.

The practical element of the experiment..?

2025-03-03 00:48:49 UTC

leonfurze — 2025-03-03 00:48:50 UTC

If a student can demonstrate the ability to develop a hypothesis, does it matter if they have used AI? https://research.google/blog/accelerating-scientific-breakthroughs-with-an-ai-co-scientist/

sgunn21 — 2025-03-03 00:48:51 UTC

Identifying words that could be cut if over word count.

leonfurze — 2025-03-03 00:50:05 UTC

"Spelling punctation and grammar" is probably not on the criteria/rubric

Access/equity

leonfurze — 2025-03-03 00:51:02 UTC

If ONE student has access to an AI tool, ALL students need equal access. What happens if one student has (free) Perplexity, and another has (paid) ChatGPT Deep Research? Or Google Gemini for Scientific Research?

sgunn21 — 2025-03-03 00:51:14 UTC

Task conditions. If the teacher genuinely wants to assess all of the highlighted skills, then they would need to ensure (all) students submit evidence under the same conditions - ie - not using computers/AI. Alternatively, the teacher would need to decide which skills they want to assess outside of AI use.

Misuse

2025-03-03 00:52:03 UTC

Every component other than the valid collection of data through the experiment assuming it wasn't grabbed later via AI.

Break down the task

leonfurze — 2025-03-03 00:52:42 UTC

Do all aspects of this task need to be assessed at once? Maybe 'research' is a Level 2 task, the practical is Level 1, and the write up is Level 3, but they are assessed at different points of the Unit instead of all at the end

Group work

leonfurze — 2025-03-03 00:53:18 UTC

Since this is a group task, you'd still have to make sure that everyone has contributed equally even if they have used AI