My Sonic Sketch by Kaylah Tan

Text: Text Sonification and the Literacoustics of Language-to-MIDI

kaylahetan — 2024-08-15 16:04:18 UTC

** Frequency (wavelength) is the basic unit of Singling because it has a value that can be easily encoded to output a note programmatically (Wolfe). Using jFugue, note and microtone; these calculations are normalized to fit within a target; we convert the frequency of each word or character to a Combination of MIDI octave range defined by the user. As previously discussed. Sonification by Singling works either with individual letters according to preset frequency values, or with words according to the LGC values.

** Users also set the default behavior of each note. In this case, users can choose from three default behaviors: 1) Overtones: Default mode of operation where notes (pitch) are determined by the ordering of alphabetic frequencies or by the numbering of LGCs in relation to the overtone series (see Figure 2). 2) Static: Every note would sound the same, determined by base settings, unless otherwise instructed.Mute: Notes are muted unless otherwise instructed by sound transformation(s). These predetermined features enable users to interact with textual data in different ways, adjusting the process to different contexts of uses of Singling. Lastly, the user can toggle on or off the use of sentiment values.

Workshop Activity: Analyzing in TextInspector and Length of Time to Read

kaylahetan — 2024-08-15 16:15:29 UTC

From the paragraph starting with "Frequency (wavelength) is..."

Reading time w/ 84 words: 25 seconds

USING: https://niram.org/read/

Difficulty: LIMITATION, words > 100
Flesch Kincaide grade: 13.99
Lexical diversity: 88.91
Academic words: 69.7%

From the paragraph starting with "Users also set the..."

Reading time w/ 111 words: 34 seconds

USING: https://niram.org/read/

Difficulty: 70.2%
Flesch Kincaide grade: 15.96
Lexical diversity: 83.09
Academic words: 12.50%

"Frequency (wavelength) is the..."

kaylahetan — 2024-08-15 16:36:56 UTC

What we want:

with a 25 second read time, the length of the sound should be no more than 25 seconds
the one limitation is difficulty score, we weren't given one due to the short word length --> solution: difficulty changes the flow of sound. given that we aren't given a number, the sound will stay consistent.
for the Flesch Kincaide grade, which essentially checks the readability, where in this case it scores 13.99, which is difficult and high.
for the Lexical diversity, the score is 83.09 which means the text contains lots of grammatical properties
with the academic words scoring at 69.7%, we can see that this read is best for academia, holding a lot of information

READ TIME

kaylahetan — 2024-08-15 16:39:51 UTC

Length of sound is roughly 25 seconds, though this is 30 seconds, to add more consideration into longer read time for a denser read

DIFFICULTY LEVEL

kaylahetan — 2024-08-15 16:43:56 UTC

this is our limitation, because we only have 84 words and it can only give us a score if the words are over 100, we aren't given a score.
- therefore, i want the sound to be less muted, and more clear

FLESCH KINCAIDE GRADE

kaylahetan — 2024-08-15 16:47:46 UTC

with the score being relatively high and therefore the readability is a bit more difficult, there will be more dramatic elements to the text. for example, this riff will start the song off.
- The longer the riff, the higher the flesch kincaide score is and vice versa.
- Since the score is high, the riff will be longer

LEXICAL DIVERSITY

kaylahetan — 2024-08-15 17:04:12 UTC

since the score is pretty large, that means the whole paragraph of text contains a diverse range of lexico properties.
- whenever crossing over a word that gives an alert to the software that it's a lexico word, there will be a this playing the background of the sound

ACADEMIC WORDS

kaylahetan — 2024-08-15 17:05:19 UTC

will be very similar to the lexical diversity, i want it to have one chord played for the lexical diversity (let's say e and c) and then for academic words, the other chords will play

FEEDBACK

kaylahetan — 2024-08-15 19:54:35 UTC

Analytical approach to the sound mappings, grounded in the text features
Overall feeling of the sentences based in the lexical diversity
What is Flesch-Kincaide? Readability (calibrated onto a grade range)
Really liked combo of sounds (guitar + piano), and how you were thinking about chords and chord progression
Complexity of chords could reflect complexity metrics; also frequency/density of the chords
Kaylah: Doing the sonic sketch helped figure out the stages of sonifciation design; the world of needs, what you will have to do
Nice bridge between the systematic and subjective
Different processes emerging (mapping text --> quant -> sounds, or text --> visuals --> sounds) -- we should do this for everyone!

ideas

kaylahetan — 2024-08-27 03:39:05 UTC

what if we do this just for research papers, like for example anytime an author gets quotes within the whole sonification, there's a ding