The kinetic congruency between visual and musical rhythms and its effect on memory performance

• Main Authors: Cheng-ho, Huang, 黃正和
• Other Authors: I-Ping Chen
• Format: Others
• Language: zh-TW
• Published: 2002
• Online Access: http://ndltd.ncl.edu.tw/handle/74566822438209378130

碩士 === 國立交通大學 === 應用藝術所 === 90 === Vision and audition are the two most important senses for humans. There are many lines of evidence showing that there are intricate interactions between vision and audition. In the media world, it has become more and more common to integrate visual and audio modalities to achieve better communication. Good communication efficiency is certainly not warranted by simply lumping visual and audio information together. There must be some constraints to meet for a multi-modality presentation to be effective. The goal of this study was to spell out some of these underlying constraints. We have investigate the effect of the following variables on the memory of a word list: (1) Whether there was a kinetic congruency between visual and musical rhythms or not. (2) The type of motion associated with the words. (3) The melody and the rhythm of the accompanying music. The results showed that kinetic congruency gave rise to a better memory performance. However, the enhancement diminished as the duration was lengthened. Therefore, it is important to keep the presentation time within a short range to prevent the perceptional weariness. We also found that the type of motion could have an effect on memory, the “enlarging” type being more effective than the “elongating” type. As for the musical variables, melody appeared to have some effect on memory performance. Rhythm did not seem to have any significant effect on memory.