Wang, Y., Behne, D., & Jiang, H. (2009). Influence of native language phonetic system on audio-visual speech perception. Journal of Phonetics, 37, 344–356.
Presentation: Angela
Summary: Hsiao-chien
The study aims to explore how auditory-visual speech perception in L2 is affected by L1 phonetic system. Previous studies have shown that the McGurk effect was found cross-linguistically, but language-specific patterns exist (e.g., Chinese perceivers show less use of visual cues). For L2 learners, visual speech categories were more difficult to acquire when they do not contrast phonetically in learners’ L1s. This investigated how Korean and Mandarin listeners weighed L2 audio-visual cues under the influence of their L1s and how these cues helped their L2 perception.
Three groups of young adults, 15 native Canadian English, 15 native Korean, 20 native Mandarin speakers, were recruited in the experiments. There were 18 English CV syllables containing a fricative onset ([f], [v], [θ], [ð], [s], or [z]) followed by a vowel ([i], [a], or [u]). These syllables were the basis for developing four modalities (A, V, AV-congruent, or AV-incongruent). The subjects were asked to perform an identification task. Results showed that Korean and Mandarin listeners perceived the AV-congruent condition better than A or V conditions for labiodentals and interdentals. Nonnatives, particularly the Mandarin group, were more likely to confuse interdentals with alveolars. On the other hand, the results for the AV-incongruent condition showed that the Mandarin group was more easily confused and were more affected by the visual information, while the Koreans were more inclined to use auditory information. In general, the authors suggested that humana perception of L2 was influenced by L1, and visual information helped the perception of L2 sound. In addition, L2 AV speech cues might not be acquired simultaneously, but in a complementary manner.
