S&I Workshop by https://padlet.com/natteric/5bl1qiim4thuyfc4 5th February 2021 en-us 2021-02-03 11:05:21 UTC 2025-12-17 12:35:08 UTC hello@padlet.com What information are we missing? What else do we need to know/find out? natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1158095008 2021-02-03 11:07:54 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1158095008 What information are we missing? What else do we need to know/find out? natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1158123224 2021-02-03 11:16:36 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1158123224 What information are we missing? What else do we need to know/find out? natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1158123610 2021-02-03 11:16:44 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1158123610 User engagement (KMK) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167529497 Reason for lack of retention,. Is this the lack of feedback for the user, or challenges in on-boarding. Is the nature of the task sufficiently engaging, simple linear progression through a prompt-response style task?]]> 2021-02-05 10:07:47 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167529497 Mic not being tested - are they going straight to 'answer a question' instead? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167530235 2021-02-05 10:08:05 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167530235 What are our learner's goals? Are they preparing for Linguaskill or other exam? Or maybe they want to practice less formally? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167530514 HG]]> 2021-02-05 10:08:10 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167530514 Initial set up https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167531199 - too many words for a non-english speaker, can we lead them thro set up with mostly pictures? HL]]> 2021-02-05 10:08:22 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167531199 better feedback https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167531712 2021-02-05 10:08:34 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167531712 Learner feedback: enjoyment of topics/task types/desired outcome from use of S&I https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167531744 2021-02-05 10:08:34 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167531744 The differences between the S&I and W&I audience? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167532134 2021-02-05 10:08:43 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167532134 JS: How would learners like to practise? A whole test or in smaller parts? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167532565 2021-02-05 10:08:52 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167532565 How do S&I learners want to engage? Little & often, or more focused for longer? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167532645 HG]]> 2021-02-05 10:08:54 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167532645 Motivation ideas https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167533896 awards, what's next if they continue]]> 2021-02-05 10:09:25 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167533896 More robust feedback e.g. what are you doing (pronouncing) wrong, how should it be done and how can you improve it? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167534565 2021-02-05 10:09:40 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167534565 record of development https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167534668 2021-02-05 10:09:42 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167534668 NR: Should S&I be evolved in the same way as W&I? How does it need to be different? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167534739 2021-02-05 10:09:43 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167534739 User 'trust' perception in results when defined as research project. Will user behavior change when 'released' as a product? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167535263 2021-02-05 10:09:53 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167535263 Listening to what you said https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167538154 Diane said a user can only replay their answer, nothing else.  We should be able to let them try again.  Also, could we provide sample answers for them to play so they could match the sounds and pronunciation better?

]]> 2021-02-05 10:10:46 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167538154 How do you know what your 'speaking' level is? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167538779 2021-02-05 10:10:59 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167538779 NR: Is mobile first optimisation enough? Does it need to be app based? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167539593 2021-02-05 10:11:14 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167539593 Assumption that full product would require teacher feedback? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167540087 2021-02-05 10:11:25 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167540087 menu to see what is in each unit https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167541007 when there is more content, so sts can choose which units to do depending in aims....]]> 2021-02-05 10:11:40 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167541007 Word stress, pronunciation, fluency, etc would be good to include as part of Sandi's analysis. CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167541169 2021-02-05 10:11:43 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167541169 NR: How would S&I complement existing portfolio? What other speaking practice do we have? How can this differentiate? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167541919 2021-02-05 10:12:00 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167541919 What does 'confidence' actually mean and what its value to the user is? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167543925 2021-02-05 10:12:43 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167543925 can we use the ASR transcript as a form of feedback? Could we get learners to 'correct' their own script as a hybrid Write/Speak activity? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167544391 2021-02-05 10:12:54 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167544391 Content (KMK) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167544825 Should we continue S&I as a multi-level test - same content all levels]]> 2021-02-05 10:13:03 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167544825 S&I on separate platform, does it make sense to split skills? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167545055 2021-02-05 10:13:08 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167545055 NR: What are the optimum conditions for recording / mic check? Do we / can we specify? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167546961 2021-02-05 10:13:47 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167546961 Are new learners seeking a quicker demonstration of S&I's offering before investing? Might not want to spend 30 minutes speaking into a product before having it prove itself somehow. HG https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167548579 2021-02-05 10:14:22 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167548579 NR: why are we losing people through the funnel? Will splitting the tests into smaller parts solve this? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167552020 2021-02-05 10:15:32 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167552020 The can do bite sizes and it's saved. Don't have to do a whole unit https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167552707 2021-02-05 10:15:43 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167552707 NR: does the growth trajectory link to LS growth? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167564665 2021-02-05 10:20:04 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167564665 NR: what are the dependencies for the graphs? e.g. do we need UX work? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167568712 2021-02-05 10:21:26 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167568712 Do users know what CEFR is? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167579344 2021-02-05 10:25:13 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167579344 NR: who is ELSA speech being backed by and what are their plans? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167639610 2021-02-05 10:46:52 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167639610 NR: More info from HE/adult segment needs to come https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167645477 2021-02-05 10:48:56 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167645477 User needs (MJFG) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167712724 What feedback do candidates actually want - especially pronunciation? Links with appropriate teaching material (CUP?).]]> 2021-02-05 11:11:58 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167712724 What's needed to reach a pedology sound 'improve' solution. Is anyone at this point? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167713455 2021-02-05 11:12:14 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167713455 seperate to W&I or together https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167713469 2021-02-05 11:12:14 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167713469 NR: what are our priority markets: geographies & segments? Where is the need most felt and what are the strongest pains? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167714043 2021-02-05 11:12:27 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167714043 TB: How does S&I fit in with other speaking learning products being developed across CAE and CUP? (Unless this was discussed when I was gone!) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167715171 2021-02-05 11:12:49 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167715171 What's the most popular speaking app and why? natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167715838 2021-02-05 11:13:01 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167715838 Will the learners we want to appeal to tend to have an associated teacher, or be working in class, or be more self-guided at home? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167715929 HG]]> 2021-02-05 11:13:04 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167715929 In terms of feedback, what would help a learner improve and would the feedback need to be in their own language? natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167717128 2021-02-05 11:13:28 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167717128 Mode of interaction (MJFG) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167717971 In the market what form of learning/assessment interaction do students find more useful.]]> 2021-02-05 11:13:46 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167717971 Partnership may be the biggest opportunity in China? CG https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167718447 2021-02-05 11:13:57 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167718447 NR: How many users can the current research project accommodate? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167718730 2021-02-05 11:14:01 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167718730 Will learners / teachers prefer a single app tackling all aspects broadly, or several smaller, more specifically targeted apps? HG https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167719335 2021-02-05 11:14:14 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167719335 Think it's really important not to attempt to 'copy' what exists in the market now but focus on the free speech capabilities we have which seem more sophisticated than the majority of competitors we have just seen https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167719949 2021-02-05 11:14:26 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167719949 'Fear of Failure' pops everywhere in research. What can we do to help change that mindset? e.g. make 'failure' positive? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167720305 2021-02-05 11:14:35 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167720305 TK: fun and motivating interface for different types of learners? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167721037 2021-02-05 11:14:50 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167721037 Do users have a preference for a native app, or is mobile web ok too? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167721100 2021-02-05 11:14:52 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167721100 NR: what is carnegie providing for Empower? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167723946 2021-02-05 11:15:51 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167723946 NR: Speaking only or integrated skills e.g. listen & speak, read & speak? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167725439 2021-02-05 11:16:24 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167725439 Segment with the greatest technical and commercial feasibility? Schools/HE/B2C? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167726376 2021-02-05 11:16:44 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167726376 Opportunity for mix of interacting with machine sometimes, and sometimes with other learners ? (KMK) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167729747 Perhaps other learner interactions unassessed, at least initially

]]> 2021-02-05 11:17:50 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167729747 AI generated content with infinite examples? CN natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167731457 2021-02-05 11:18:23 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167731457 NR: which key markets are trailing in speaking skills beyond Turkey & mexico? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167754304 2021-02-05 11:26:58 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167754304 NR: what are the quick wins we can do easily? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167757206 2021-02-05 11:28:03 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167757206 NR: does it plot scores as progress if tasks are repeated? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167771663 2021-02-05 11:33:34 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167771663 NR: What does task / content focus need to be to support speech needs in market and Cambridge's automarker ambitions in assessments? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167827099 2021-02-05 11:55:01 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167827099 TB: What data does S&I need to provide that LS is not providing? What is the data generation purpose of S&I? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167831377 2021-02-05 11:56:46 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167831377 JS: can we gather L1/age from all users? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167901875 2021-02-05 12:25:10 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167901875 TB: Is S&I providing data now that LS is not / cannot? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167903237 2021-02-05 12:25:44 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167903237 NR: prioritise data needs https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167904841 2021-02-05 12:26:21 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167904841 https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167908642 TB: What extra legal / data considerations would there be if we wanted to target S&I at children? (Parental consent, etc.)]]> 2021-02-05 12:27:53 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167908642 Do we have a framework/structure for collecting the data for research? Standard T&C that can be included? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167908855 2021-02-05 12:27:58 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167908855 S&I Feedback (MJFG) https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167909380 How (or if) S&I is going to support research in feedback. What is the split between CAE/ELiT/ALTA/ for implementation responsibility?]]> 2021-02-05 12:28:09 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167909380 Split testing of backends and its effect on learner motivation / engagement / improvement - HG https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167910200 2021-02-05 12:28:30 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167910200 AP: PISA for YL, other task types avaialble. https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167914116 2021-02-05 12:29:59 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167914116 Do we have a SDK for the API? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167916130 2021-02-05 12:30:47 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167916130 Technical considerations for China? https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167919212 2021-02-05 12:32:02 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167919212 If users lack language resources, how can we help them? natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167919934 2021-02-05 12:32:21 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1167919934 TB: This is more of a general R&D capability question, rather than one linked to S&I specifically but I'll ask it here anyway. How important is that the EliT-EST Speech API can accurately handle read aloud task (and other types of constrained tasks where the expected answer is known)? I know that other product teams (e.g. NPD for DYL, CUP for some Compass) are (planning on) using Soapbox Labs (https://www.soapboxlabs.com/) for their products, in part because their ASR (currently!) handles younger learners better than ours, but also because it handles these types of tasks better. If this type of task IS important across Cambridge, then we should *consider* developing this capability ourselves (to save on ongoing operational costs, for example). As Mark & Kate mentioned, this would be possible, but would of course mean prioritizing this development against other R&D work. https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1168200338 2021-02-05 13:51:18 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1168200338 FEEDBACK (15) natteric https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1186724232 2021-02-10 10:55:24 UTC https://padlet.com/natteric/5bl1qiim4thuyfc4/wish/1186724232