Embedded AI for NIME: Challenges and Opportunities by

Embedded AI for NIME: Challenges and Opportunities by https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv With this workshop we aim to bring together researchers with the common interest of working with and developing embedded AI for New Interfaces for Musical Expression (NIME), and to jointly identify the challenges, trends, and technologies in use. Furthermore, we expect it to serve as the starting point for an embedded AI NIME community and as future reference to help newcomers get started with embedded AI. en-us 2022-06-21 12:49:08 UTC 2025-09-29 11:43:16 UTC hello@padlet.com Challenges abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226793335 (of embedded AI | for NIME)]]> 2022-06-21 13:02:58 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226793335 Tools and technologies abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226793778 (for embedded AI | for NIME)]]> 2022-06-21 13:03:28 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226793778 The 'hello world' of embedded AI abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226794071 (for NIME)]]> 2022-06-21 13:03:50 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226794071 Critical approaches to embedded AI abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226794129 (for NIME)]]> 2022-06-21 13:03:54 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226794129 Opportunities abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226794204 (for embedded AI | for NIME)]]> 2022-06-21 13:04:01 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2226794204 abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232381369 2022-06-28 11:24:23 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232381369 Embedded AI 'NIME commons'? abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232385929 * Inspired by NIME Workshops on NIMEhub, NIME archiving
* Embedded AI data, models and compute?

(as suggested on Jack Armitage's keynote)]]> 2022-06-28 11:32:53 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232385929 What is success? (from Rebecca Fiebrink's keynote) abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232396297 accuracy? efficiency, latency?]]> 2022-06-28 11:51:41 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232396297 Why AI? Why Embedded AI? abenitotemprano https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232396531 2022-06-28 11:52:09 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232396531 A few ML Opportunities (reflections from RF Keynote) stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232438294

Complex and new mappings.

New Design Approaches

Embedded systems lend themselves to small data sets (NB they don't have to be large)

Many ML NIME systems can actually be simple and focussed (less need to allow for noisy users), and a bit of looseness might in fact be quite nice.

Does the ML component need to be in Real-time? Use ML to pre-prepare a corpus or look-up

table for example.

]]> 2022-06-28 12:53:46 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232438294 Releasing ML NIME Interfaces (from RF keynote) stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232440843 Things to think about...

How accessible is it?
What controls are you going to make available?

Please add more! :)

]]> 2022-06-28 12:57:03 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232440843 How can we helpfully use any parallels between craft methods and creating NIME ML? stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232444769 Jack expressed an interest and Rebecca presented a cyclic development model of

=> building a model =>playing => use data from the playing to =>build ....]]> 2022-06-28 13:02:25 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232444769 "Browsers" vs Native (from Hanoi) stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232453931 Can we bypass a lot of programming and hardware specific 'pain' by looking for browser type environments? Can this approach actually widen the access to our projects?

]]> 2022-06-28 13:13:37 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232453931 Following Rebecca's "smaller is better"... https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232700474 A lot of AI for audio comes from MIR. Goals and constraints in MIR are quite different, with the result that huge models digesting entire pre-acquired music events are the norm in the discourse. Due to the real-time nature of musical instrument interaction, NIME has no choice but to focus on the other end of the spectrum. I would argue that less leading-edge architectures are actually going to be more useful for NIME. I also believe that attention towards minimal-latency time-domain models is long overdue!

Andrea]]> 2022-06-28 18:51:07 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232700474 How have you approached making usable/useful user interfaces for embedded AI systems? rebeccafiebrink https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232704237 2022-06-28 18:58:34 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232704237 Big shout for the developers cracking the hard code! stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232721984 Getting systems like PyTorch running on BELA and Pi are out of reach of many artists - list here any amazing projects that do just that. Thanks to these pioneers!]]> 2022-06-28 19:34:28 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232721984 Key hardware focus for World or Hello Worlds stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232759986 What are the key hardware - Jetson, BELA, Raspberry Pi

]]> 2022-06-28 20:54:55 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232759986 Information points stevesymons https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232760689 Dedicated Discord? WiKi? a postable place?]]> 2022-06-28 20:56:15 UTC https://padlet.com/abenitotemprano/ap10ewnxjwxvg9lv/wish/2232760689