1887
Volume 46, Issue 1
  • ISSN 1810-7478
  • E-ISSN: 2589-5230
USD
Buy:$35.00 + Taxes

Abstract

Abstract

In this paper, the McGurk effect displayed by native Mandarin Speakers is examined in the light of reaction time (RT) and response types. Two within-subject factors, FACE and ACCENT, and one between-subject factor, English Proficiency, were incorporated in the experiment. The results showed that FACE and ACCENT, but not English Proficiency, had effects on the participants’ RT and response types. When a foreign ACCENT was dubbed onto a familiar FACE, the RT was the longest, and the McGurk effect was most likely to be found. Other kinds of McGurk stimuli composition did not receive different RT but induced different response types. When the FACE was foreign, regardless of the ACCENT, the participants tended to respond with perceptive illusion. The author concluded that the expectations of the perceiver influenced the use of multisensory integration and thus the longer RT and the appearance of the McGurk effect.

Loading

Article metrics loading...

/content/journals/10.1075/consl.00011.yu
2020-05-01
2024-10-12
Loading full text...

Full text loading...

References

  1. Beauchamp, Michael S.
    2017Beauchamp: McGurkStimuli. RetrievedFebruary 4, 2019, fromhttps://openwetware.org/mediawiki/index.php?title=Beauchamp:McGurkStimuli&oldid=1034510
    [Google Scholar]
  2. Bovo, Roberto, Andrea Ciorba, Silvano Prosser, and Alessandro Martini
    2009 The McGurk phenomenon in Italian listeners. Acta Otorhinolaryngologica Italica29.4:203–208.
    [Google Scholar]
  3. Burnham, Denis, and Susanna Lau
    1998 The effect of tonal information on auditory reliance in the McGurk effect. Paper presented at theAVSP’98 International Conference on Auditory-Visual Speech Processing, University of New South Wales, Sydney.
    [Google Scholar]
  4. Chen, Yuchun, and Valérie Hazan
    2007 Developmental factor in auditory-visual speech perception-the McGurk effect in Mandarin-Chinese and English Speakers. Paper presented at theAVSP2007 International Conference on Auditory-Visual Speech Processing, Kasteel Groenendaal, Hilvarenbeek, Netherlands.
    [Google Scholar]
  5. Fuster-Duran, Angela
    1996 Perception of conflicting audio-visual speech: An examination across Spanish and German. Speechreading by Humans and Machines: Models, Systems, and Applications, ed. byDavid G. Stork and Marcus E. Hennecke, 135–143. Berlin: Springer. 10.1007/978‑3‑662‑13015‑5_9
    https://doi.org/10.1007/978-3-662-13015-5_9 [Google Scholar]
  6. Hirata, Yukari, and Spencer D. Kelly
    2010 Effects of lips and hands on auditory learning of second-language speech sounds. Journal of Speech, Language, and Hearing Research53.2:298–310. 10.1044/1092‑4388(2009/08‑0243)
    https://doi.org/10.1044/1092-4388(2009/08-0243) [Google Scholar]
  7. Kotz, Sonja A., and Kerrie Elston-Güttler
    2004 The role of proficiency on processing categorical and associative information in the L2 as revealed by reaction times and event-related brain potentials. Journal of Neurolinguistics17.2–3:215–235. 10.1016/S0911‑6044(03)00058‑7
    https://doi.org/10.1016/S0911-6044(03)00058-7 [Google Scholar]
  8. Magnotti, John F., Debshila Basu Mallick, Guo Feng, Bin Zhou, Wen Zhou, and Michael S. Beauchamp
    2015 Similar frequency of the McGurk effect in large samples of native Mandarin Chinese and American English speakers. Experimental Brain Research233.9:2581–2586. 10.1007/s00221‑015‑4324‑7
    https://doi.org/10.1007/s00221-015-4324-7 [Google Scholar]
  9. McGurk, Harry, and John MacDonald
    1976 Hearing lips and seeing voices. Nature264:746–748. 10.1038/264746a0
    https://doi.org/10.1038/264746a0 [Google Scholar]
  10. Munro, Murray J., and Tracey M. Derwing
    1995 Processing time, accent, and comprehensibility in the perception of native and foreign-accented speech. Language and Speech38.3:289–306. 10.1177/002383099503800305
    https://doi.org/10.1177/002383099503800305 [Google Scholar]
  11. Nath, Audrey R., and Michael S. Beauchamp
    2012 A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. NeuroImage59.1:781–787. 10.1016/j.neuroimage.2011.07.024
    https://doi.org/10.1016/j.neuroimage.2011.07.024 [Google Scholar]
  12. Navarra, Jordi, and Salvador Soto-Faraco
    2007 Hearing lips in a second language: Visual articulatory information enables the perception of second language sounds. Psychological Research71.1:4–12. 10.1007/s00426‑005‑0031‑5
    https://doi.org/10.1007/s00426-005-0031-5 [Google Scholar]
  13. Marian, Viorica
    2009 Audio-visual integration during bilingual language processing. The Bilingual Mental Lexicon: Interdisciplinary Approaches, ed. byAneta Pavlenko, 52–78. Bristol, Buffalo & Toronto: Multilingual Matters. 10.21832/9781847691262‑005
    https://doi.org/10.21832/9781847691262-005 [Google Scholar]
  14. Sams, Mikko, Petri Manninen, Veikko Surakka, Pia Helin, and Riitta Kättö
    1998 McGurk effect in Finnish syllables, isolated words, and words in sentences: Effects of word meaning and sentence context. Speech Communication26.1–2: 75–87. 10.1016/S0167‑6393(98)00051‑X
    https://doi.org/10.1016/S0167-6393(98)00051-X [Google Scholar]
  15. Sekiyama, Kaoru
    1997 Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception & Psychophysics59.1:73–80. 10.3758/BF03206849
    https://doi.org/10.3758/BF03206849 [Google Scholar]
  16. Sekiyama, Kaoru, and Yoh’ichi Tohkura
    1991 McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. The Journal of the Acoustical Society of America90.4:1797–1805. 10.1121/1.401660
    https://doi.org/10.1121/1.401660 [Google Scholar]
  17. Sueyoshi, Ayano, and Debra M. Hardison
    2005 The role of gestures and facial cues in second language listening comprehension. Language Learning55.4:661–699. 10.1111/j.0023‑8333.2005.00320.x
    https://doi.org/10.1111/j.0023-8333.2005.00320.x [Google Scholar]
  18. Tona, Risa, Yasushi Naito, Saburo Moroto, Rinko Yamamoto, Keizo Fujiwara, Hiroshi Yamazaki, Shogo Shinohara, and Masahiro Kikuchi
    2015 Audio-visual integration during speech perception in prelingually deafened Japanese children revealed by the McGurk effect. International Journal of Pediatric Otorhinolaryngology79.12:2072–2078. 10.1016/j.ijporl.2015.09.016
    https://doi.org/10.1016/j.ijporl.2015.09.016 [Google Scholar]
  19. Tse, Chi-Shing, and Jeanette Altarriba
    2012 The effects of first- and second-language proficiency on conflict resolution and goal maintenance in bilinguals: Evidence from reaction time distributional analyses in a Stroop task. Bilingualism: Language and Cognition15.3:663–676. 10.1017/S1366728912000077
    https://doi.org/10.1017/S1366728912000077 [Google Scholar]
/content/journals/10.1075/consl.00011.yu
Loading
/content/journals/10.1075/consl.00011.yu
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error