Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki

This protocol investigates the role of visual imagery in the bouba/kiki effect. With the training and noticing, the bouba/kiki shape-audio regularities effects the bouba/kiki effect and the recognition of individual bouba and kiki shapes. And finally, what mental images they produce.

This protocol is unique in that it keeps under control visual imagery and the sensory information during training and testing. Conduct the three experiments in a quiet room that is neutral in color, and with all participants individually. Ask the participants in the blindfold group to put on their blindfold before setting up the tactile test materials, and make sure they keep their blindfold on throughout and between all three experiments.

Place the rubber mat directly in front of the participant. Invite the participant to explore the rubber mat before placing any of the tactile test materials on top. Next, place the MP3 player directly in front of the participant with the loudspeaker closest to them.

Explain that two picture cards will be presented on the rubber mat. Each one picturing a tactile shape. Then, explain that some audio will be played from the MP3 player and that this audio will correspond to one of the tactile shapes.

After this, place the two picture cards on the rubber mat. Ask the participant to make a fist using both hands and to place their fists on top of the presented picture cards, guiding them if needed. Place the left hand on top of the participants fists.

Ask the participant to explore the two tactile shapes when the hand on top of their fist is removed. And to say yes when they have finished their exploring. When ready to begin remove the left hand from the participants fists.Yes.

As soon as the participant says yes cover the picture cards, and play the audio from the MP3 player. bouba Then, ask the participant to signal which tactile shape the associate with the audio. And that one.

And to note the shape given, making sure to not respond to the answer. Explain that one picture card picturing a tactile shape will be presented on the rubber mat and that some audio will be played from the MP3 player. Then, explain that the participant will be asked to name both the tactile shape and the audio as either bouba or kiki.

Place the picture card on the rubber mat. Ask the participant to make a fist using both hands. And to place their fist on top of the presented picture card, guiding them if needed.

Place the left hand on top of the participants fists. When ready to begin remove the left hand from the participants fists and play the audio from the MP3 player allowing the participant time to name the tactile shape and the audio. Make sure the participant provides only one name.

As soon as the participants names the tactile shape and the audio. kiki Cover the picture card and note the name given, making sure to not respond to the answer. Explain that some copy paper or plastic embossing film will be placed on top of the rubber mat and that the participant will be asked to draw on it.

Invite the participant to try out the different drawing equipment and to decide for themselves which they prefer. The copy paper or plastic embossing film, and rollerball pen or saddleback style? Next, explain that some audio will be played from the MP3 player and that the participant will be drawing the tactile shape they associate with this audio, saying yes when they have finished their drawing.

After this, place the copy paper or plastic embossing film on the rubber mat. Ask the participant to make a fist using both hands while holding either the rollerball pen or saddleback style. And to place their fist on top of the copy paper or plastic embossing film, guiding them if needed.

Place the left hand on top of the participants fists. When ready to begin remove the left hand from the participants fists and play the audio from the MP3 player. allowing the participant time to draw the tactile shape.

As soon as the participant says yes.Yes. Remove their drawing from the rubber mat and label it in the bottom right corner with the correct trial number, making sure to not respond to the drawing. Finally, ask a group of scorers to answer two multiple choice questions per picture in the questionnaire as outlined in the text protocol.

In this study 50%of the participants who are congenitally blind, 75%were blindfolded, and approximately 83%were fully sighted showed an instant bouba/kiki effect. Long term and consistently across all three repeated within group measures, the blind and vision group showed the bouba/kiki effect were as the blindfold group did not. On the third and final within group measure for example 75%of the participants who were congenitally blind 50%who were blindfolded and 100%were fully sighted showed the bouba/kiki effect.

Approximately 92%of the participants who were congenitally blind, 75%who were blindfolded, and 100%were fully sighted, instantly recognized the congruous bouba/kiki shape and audio. Long term, the blind group recognized the bouba/kiki shapes regardless of whether they were presented together with congruous or incongruous audio. And the blindfold and vision group only when presented together with congruous audio.

Approximately 73%of the participants who were congenitally blind, approximately 89%who were blindfolded, and 80%were fully sighted, instantly drew a mental image. A shape that corresponded to the presented auditory bouba/kiki. Long term, the blind and the vision group drew tactile visual shapes that corresponded to the audio, where as the blindfold group did not.

This protocol is flexible. Large and small samples, as well as specific individuals can be tested against themselves in various within group measures and/or against other groups of individuals in between group measures on accuracy and/or exploration time.