簡易檢索 / 詳目顯示

研究生: 項瑞芳
Shiang, Ruei-Fang
論文名稱: 體現動作推理與英語句子閱讀理解
Embodied Inferences in Action and EFL Sentence Reading Comprehension
指導教授: 陳秋蘭
學位類別: 博士
Doctor
系所名稱: 英語學系
Department of English
論文出版年: 2020
畢業學年度: 108
語文別: 英文
論文頁數: 111
中文關鍵詞: 體現認知英語閱讀動作模擬眼動軌跡動詞
英文關鍵詞: Action Simulation, Mirror Neurons, Multimodal, Situation Model
DOI URL: http://doi.org/10.6345/NTNU202000848
論文種類: 學術論文
相關次數: 點閱:175下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 從體現認知的觀點來看,閱讀理解的深度取決於建構多模態表徵的能力。多年以來,研究已發現當動詞為實驗刺激時,在第二語閱讀者腦中觀察到與動作模擬相關的腦區活動。但是目前尚未有任何研究觀察這個現象是否也會出現在當實驗刺激為動作語句。 因此本研究極欲探究體現模擬是否會在英語為外語者閱讀動作語句時出現。這項研究收集了大學生在進行句圖辨識作業時的反應時間和眼動軌跡,並在作業結束後進行線索回溯放聲作業。在句圖作業裡,句子裡描述的動作與圖中出現的動作可能相符或不符。圖片裡的關鍵區域則設在動作者的肢體上。反應時間的結果顯示,抑制效應出現在句圖動作不符時。在眼動資料上,當句圖動作相符時,肢體的凝視時間比在不符的情況下短暫。但是這個效應的顯著性並不是出現在初期處理時間的指標上。而線索回溯放聲作業的資料也顯示,其結果與以上兩種研究方法得到的結果均一致。總的來說,在閱讀英語動作語句時,英語為外語的讀者是可以依據句中描述的情境而模擬與情境相關的動作的。這個結果意味著,即便不是讀者的優勢語言,體現模擬依然在閱讀理解中扮驗重要角色。

    From the perspective of embodied cognition, an ability to construct multimodal representations is the key to achieving high-level reading comprehension. For years, studies have shown that motor simulation occurs in L2 learners exposed to isolated action verbs, but it is still unknown whether the same simulations also occur during L2 processing of action verbs within sentences. This study explores whether embodied simulations of action sentences can be observed among EFL readers. Fifty-six advanced EFL college-aged readers were recruited to do a sentence-picture verification task during which their response time and viewing behaviors were measured. In the task, each sentence implicitly described an action that was either congruous or incongruous with a pictured action. The head, hands, and legs of the character performing the action were set as Areas of Interest (AOIs) using an eye tracking system. Cued retrospective reports were also collected by way of audio-visual recording after the experiment to cross-verify the quantitative data. An impeding effect was observed from the response time data in the incongruous condition. Consistent with the response time data, eye tracking data revealed that fixation time was longer at the body effector executing an action in the incongruous condition compared to the congruous condition. This trend was most pronounced in the late processing eye movement measures. Furthermore, post-experiment cued retrospective reports indicate that processing for the actions was not a priority in comparison to the processing of other objects or entities. Overall, advanced EFL readers did automatically simulate and infer the actions relevant to situations described in English sentences, indicating that embodied grounding is crucial to reading comprehension in one’s less dominant language.

    TABLE OF CONTENTS ACKNOWLEDGEMENT i CHINESE ABSTRACT ii ENGLISH ABSTRACT iii TABLE OF CONTENTS v LIST OF TABLES vi LIST OF FIGURES vi CHAPTER 1 INTRODUCTION 1 CHAPTER 2 LITERATURE REVIEW 4 Embodied Cognition 4 Embodied Cognition and Language Comprehension 6 Embodiment and Inferences 11 Association Between Embodied Cognition and Eye Movements 15 Eye Movement Research in Embodied Cognition and Educational Studies 16 L2 Semantic Processing 18 Learning Action Verbs 22 Mirror Neurons and Action Verbs in L2 Instruction 25 Summary & The Present Study 28 CHAPTER 3 METHODOLOGY 35 Participants 35 Materials 36 Apparatus 37 Measurements 38 Design and Procedure 41 Analyses 43 CHAPTER 4 RESULTS 48 Global Analyses 48 Local Analyses 49 Qualitative Data: Retrospective Verbalization 56 CHAPTER 5 DISCUSSION 64 CHAPTER 6 CONCLUSION, IMPLICATIONS, AND FUTURE DIRECTIONS 76 BIBLIOGRAPHY 80 APPENDIX A: EXPERIMENTAL MATERIALS 103 APPENDIX B: CODING SCHEME OF RETROSPECTIVE REPORTS 110

    Abutalebi, J. (2008). Neural aspects of second language representation and language control. Acta Psychologica, 128(3), 466-478.
    Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). Tracking
    the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38, 419-439.
    Altmann, G. T. (2004). Language-mediated eye movements in the absence of a visual world: The ‘blank screen paradigm’. Cognition, 93(2), 79-87.
    Altmann, G. T. (2011). Language can mediate eye movement control within 100 milliseconds, regardless of whether there is anything to move
    the eyes to. Acta Psychologica, 137, 190-200.
    Altmann, G. T., & Kamide, Y. (2004). Now you see it, now you don’t: Mediating the mapping between language and the visual world. In J. M. Henderson, & F. Ferreira (Eds.), The interface of language, vision, and action: Eye movements and the visual world (pp. 347-386). East Sussex: Psychology Press.
    An, L., Wang, Y., & Sun, Y. (2017). Reading words or pictures: Eye movement patterns in adults and children differ by age group and receptive language ability. Frontiers in Psychology, 8, 791.
    Anderson, S. E., & Spivey, M. J. (2009). The enactment of language: Decades of interactions between linguistic and motor processes. Language and Cognition, 1(1), 87-111.
    Anderson, A. J., Zinszer, B. D., & Raizada, R. D. (2016). Representational similarity encoding for fMRI: Pattern-based synthesis to predict brain activity using stimulus-model-similarities. NeuroImage, 128, 44-53.
    Andry T. (2019) The Qualitative Analysis in Eye Tracking Studies: Including Subjective Data Collection in an Experimental Protocol. In S.,Yamamoto, H., Mori (Eds.), Human Interface and the Management of Information. Information in Intelligent Systems. HCII 2019. Lecture Notes in Computer Science (pp. 335-346). Cham: Springer.
    Arbib, M. A. (2013). Precis of how the brain got language: the mirror system hypothesis. Language and Cognition, 5(2-3), 107-131.
    Arbib, M. A., Gasser, B., & Barrès, V. (2014). Language is handy but is it embodied? Neuropsychologia, 55, 57-70.
    Arbib, M. A. (2015). Language evolution: an emergentist perspective. In B. MacWhinney & W. O’Grady (Eds.), The handbook of language emergence (pp. 600-623). Oxon, Wiley.
    Aziz-Zadeh, L., Wilson, S. M., Rizzolatti, G., & Iacoboni, M. (2006). Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Current Biology, 16(18), 1818-1823.
    Badre, D., & Wagner, A. D. (2007). Left ventrolateral prefrontal cortex and the cognitive control of memory. Neuropsychologia, 45(13), 2883-2901.
    Ball, L., Eger, N., Stevens, R., & Dodd, J. (2006). Applying the post-experience eye-tracked protocol (PEEP) method in usability testing. Interfaces, 67, 15-19.
    Barsalou, L. W. (2008). Grounded cognition. Annual Review Psychology, 59, 617-645.
    Barsalou, L. W., Simmons, W. K., Barbey, A. K., & Wilson, C. D. (2003). Grounding conceptual knowledge in modality-specific systems. Trends in Cognitive Sciences, 7(2), 84-91.
    Bisley, J. W., & Goldberg, M. E. (2003). Neuronal activity in the lateral intraparietal area and spatial attention. Science, 299(5603), 81-86.
    Bonhage, C. E., Meyer, L., Gruber, T., Friederici, A. D., & Mueller, J. L. (2017).
    Oscillatory EEG dynamics underlying automatic chunking during sentence
    processing. NeuroImage, 152, 647-657.
    Borghi, A. M., & Pecher, D. (2011). Introduction to the special topic
    embodied and grounded cognition. Frontiers in Psychology, 2(187), 1-3.
    Braunstein, V., Ischebeck, A., Brunner, C., Grabner, R. H., Stamenov, M., & Neuper, C. (2012). Investigating the influence of proficiency on semantic processing in bilinguals: An ERP and ERD/S analysis. Acta Neurobiologiae Experimentalis, 72(4), 421-38.
    Buccino, G., Vogt, S., Ritzl, A., Fink, G. R., Zilles, K., Freund, H. J., & Rizzolatti, G. (2004). Neural circuits underlying imitation learning of hand actions: an event-related fMRI study. Neuron, 42(2), 323-334.
    Buchweitz, A., Shinkareva, S. V., Mason, R. A., Mitchell, T. M., & Just, M. A.
    (2012). Identifying bilingual semantic neural representations
    across languages. Brain and Language, 120, 282–289.
    Burgess, C., & Lund, K. (1997). Modelling parsing constraints with high-dimensional context space. Language and Cognitive Processes, 12(2-3), 177-210.
    Castelhano, M. S., & Henderson, J. M. (2008). The influence of color on the perception of scene gist. Journal of Experimental Psychology: Human perception and performance, 34(3), 660-675.
    Chan, A. H., Luke, K. K., Li, P., Yip, V., Li, G., Weekes, B., & Tan, L. H. (2008). Neural correlates of nouns and verbs in early bilinguals. Annals of the New York Academy of Sciences, 1145(1), 30-40.
    Chan, M. K., & Tai, J. (1994). From nouns to verbs: verbalization in Chinese dialects and East Asian languages. In Camacho, J., Choueiri, L. (Eds.), Sixth North American Conference on Chinese Linguistics. NACCL-6. Graduate Students in Linguistics (GSIL), USC, Los Angeles, (pp. 49 – 74). Retrieve from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.541.250&rep=rep1&type=pdf
    Chee, M. W. L., Hon, N., Lee, L, H., & Soon, C. S., (2001). Relative language
    proficiency modulates BOLD signal change when bilinguals perform semantic
    judgments. Neuroimage, 13, 1155-1163.
    Chee, M. W., Tan, E., and Thiel, T. (1999) Mandarin and English single word
    processing studied with fMRI. Journal of Neuroscience, 19, 3050– 3056.
    Chee, M. W., Weekes, B., Lee, K. M., Soon, C. S., Schreiber, A., Hoon, J. J., & Chee, M. (2000). Overlap and dissociation of semantic processing of Chinese characters, English words, and pictures: evidence from fMRI. Neuroimage, 12(4), 392-403.
    Chen, H. C., Lai, H. D., & Chiu, F.C. (2010). Eye tracking technology for learning and education. Journal of Research in Education Sciences, 55(4), 39-68.
    Childers, J. B., & Tomasello, M. (2006). Are Nouns Easier to Learn Than Verbs? Three Experimental Studies. In K. Hirsh-Pasek & R. Golinkoff (Eds.). Action meets word: How children learn verbs (pp. 311-335). New York: Oxford University Press.
    Childers, J. B., & Tomasello, M. (2002). Two-year-olds learn novel nouns, verbs, and conventional actions from massed or distributed exposures. Developmental Psychology, 38(6), 967-978.
    Choi, S., & Gopnik, A. (1995). Early acquisition of verbs in Korean: A cross-linguistic study. Journal of Child Language, 22(3), 497-529.
    Clahsen, H., & Felser, C. (2006). How native-like is non-native language processing? Trends in Cognitive Sciences, 10(12), 564-570.
    Cooke, A., Grossman, M., DeVita, C., Gonzalez-Atavales, J., Moore, P., Chen, W., ...& Detre, J. (2006). Large-scale neural network for sentence processing. Brain and Language, 96(1), 14-36.
    Conklin, K., Pellicer-Sánchez, A., & Carrol, G. (2018). Eye-tracking: A guide for applied linguistics research. Cambridge: Cambridge University Press.
    Correia, J., Formisano, E., Valente, G., Hausfeld, L., Jansma, B., & Bonte, M. (2014). Brain-based translation: fMRI decoding of spoken words in bilinguals reveals language-independent semantic representations in anterior temporal lobe. Journal of Neuroscience, 34(1), 332-338.
    Craighero, L., Fadiga, L., Rizzolatti, G., & Umiltà, C. (1999). Action for perception: a motor-visual attentional effect. Journal of experimental psychology: Human Perception and Performance, 25(6), 1673-1692.
    Dai, E-Y., Kong, A. P., & Weekes, B. S. (2012). Recovery of naming and discourse production: A bilingual anomic case study. Aphasiology, 26(6), 737-756.
    De Graef, P., Christiaens, D., & d'Ydewalle, G. (1990). Perceptual effects of scene context on object identification. Psychological Research, 52(4), 317-329.
    De Grauwe, S., Willems, R. M., Rueschemeyer, S. A., Lemhöfer, K., & Schriefers, H.
    (2014). Embodied language in first-and second-language speakers: Neural
    correlates of processing motor verbs. Neuropsychologia, 56, 334-349.
    De Koning, B. B., Wassenburg, S. I., Bos, L. T., & van der Schoot, M. (2017). Mental simulation of four visual object properties: similarities and differences as assessed by the sentence–picture verification task. Journal of Cognitive Psychology, 29(4), 420-432.
    De La Rosa, S., Ferstl, Y., & Bülthoff, H. H. (2016). Visual adaptation dominates bimodal visual-motor action adaptation. Scientific Reports, 6, 1-8.
    De Vega, M. (2015). Toward am embodied approach to inferences in
    comprehension: the case of action language. In E. J. O’Brien, A. E. Cook, & R. F. Lorch (Eds.), Inferences during reading (pp.160-181). Cambridge: Cambridge University Press.
    Ding, G., Perry, C., Peng, D., Ma, L., Li, D., Xu, S., ... & Yang, J. (2003). Neural mechanisms underlying semantic and orthographic processing in Chinese–English bilinguals. NeuroReport, 14(12), 1557-1562.
    Ditman, T., Brunyé, T. T., Mahoney, C. R., & Taylor, H. A. (2010). Simulating an enactment effect: Pronouns guide action simulation during narrative comprehension. Cognition, 115(1), 172-178.
    Dove, G. (2016). Three symbol ungrounding problems: Abstract concepts and the future of embodied cognition. Psychonomic Bulletin & Review, 23(4), 1109-1121.
    Eberhard, K. M., Spivey-Knowlton, M. J., Sedivy, J. C., & Tanenhaus, M. K. (1995). Eye movements as a window into real-time spoken language comprehension in natural contexts. Journal of Psycholinguistic Research, 24(6), 409-436.
    Eger, N., Ball, L. J., Stevens, R., & Dodd, J. (2007, September). Cueing retrospective verbal reports in usability testing through eye-movement replay. Paper presented at the 21st British HCI Group Annual Conference University of Lancaster, UK. Retrieve from: https://www.scienceopen.com.document_file/cdf74a9a-e231-43
    51-a346-217aa3daf9bf/ScienceOpen/001_Eger.pdf.
    Elbabour, F., Alhadreti, O., & Mayhew, P. (2017). Eye tracking in retrospective think-aloud usability testing: is there added value?. Journal of Usability Studies, 12(3), 95-110.
    Engelen, J. A., Bouwmeester, S., de Bruin, A. B-H. & Zwaan, R. A. (2011).
    Perceptual simulation in developing language comprehension. Journal of
    Experimental Child Psychology, 110, 659-675.
    Fadiga, L., & Craighero, L. (2006). Hand actions and speech representation in Broca's area. Cortex, 42(4), 486-490.
    Fazio, P., Cantagallo, A., Craighero, L., D’ausilio, A., Roy, A. C., Pozzo, T., ... &
    Fadiga, L. (2009). Encoding of human action in Broca's area. Brain, 132(7), 1980-1988.
    Ferstl, Y., Bülthoff, H., & de la Rosa, S. (2017). Action recognition is sensitive to the identity of the actor. Cognition, 166, 201-206.
    Feyereisen, P. (2009). Enactment effects and integration processes in younger and older adults’ memory for actions. Memory, 17(4), 374-385.
    Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: A review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology, 61(6), 825-850.
    Foroni, F. (2015). Do we embody second language? Evidence for ‘partial’ simulation during processing of a second language. Brain Cognition, 99, 8–16.
    Foroni, F., & Semin, G. R. (2013). Comprehension of action negation involves inhibitory simulation. Frontiers in Human Neuroscience, 7, 209, 1-9.
    Francis, W. S. (2005). Bilingual semantic and conceptual representation. In J. F. Kroll, &A. M. B. De Groot (Eds.). Handbook of bilingualism: Psycholinguistic approaches (pp. 251-277). New York: Oxford University Press.
    Francis, W. S., Tokowicz, N., & Kroll, J. F. (2014). The consequences of language proficiency and difficulty of lexical access for translation performance and priming. Memory & Cognition, 42(1), 27-40.
    Frankland, S. M., & Greene, J. D. (2015). An architecture for encoding sentence meaning in left mid-superior temporal cortex. Proceedings of the National Academy of Sciences, 112(37), 11732-11737.
    Friederici, A. D. (2002). Towards a neural basis of auditory sentence processing. Trends in Cognitive Sciences, 6(2), 78-84.
    Friederici, A. D. (2004a). The neural basis of syntactic processes. In G. Zybatow (Ed.), The cognitive neurosciences III (pp. 789-801). Cambridge, MA: MIT Press.
    Friederici, A. D. (2004b). Event-related brain potential studies in language. Current Neurology and Neuroscience Reports, 4(6), 466-470.
    Friederici, A. D., & Alter, K. (2004). Lateralization of auditory language functions: a dynamic dual pathway model. Brain and Language, 89(2), 267-276.
    Gallese, V., & Cuccio, V. (2018). The neural exploitation hypothesis and its implications for an embodied approach to language and cognition: Insights from the study of action verbs processing and motor disorders in Parkinson's disease. Cortex, 100, 215-225.
    Gentner, D. (1982). Why nouns are learned before verbs: Linguistic relativity versus natural partitioning. In S. Kuozaj (Ed.) Language development: Language, thought, and culture (pp. 301-334). New Jersey: Lawrence Erlbaum.
    Gentner, D. (2006). Why verbs are hard to learn. In K. Hirsh-Pasek, & R. Golinkoff, (Eds.) Action meets word: How children learn verbs (pp. 544-564). Oxon: Oxford University Press.
    Glenberg, A. M., & Gallese, V. (2012). Action-based language: A theory of language acquisition, comprehension, and production. Cortex, 48(7), 905-922.
    Glenberg, A. M., Gutierrez, T., Levin, J. R., Japuntich, S., & Kaschak, M. P. (2004). Activity and imagined activity can enhance young children’s reading
    comprehension. Journal of Educational Psychology, 96, 424–436.
    Glenberg, A. M., Jaworski, B., Rischal, M., & Levin, J. R. (2007). What brains are for: Action, meaning, and reading comprehension. In D., MacNamara (Ed.) Reading comprehension strategies: Theories, interventions, and technologies, (pp.221-240). New York: Lawrence Erlbaum Associates.
    Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9(3), 558-565.
    Glenberg, A. M., & Robertson, D. A. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43(3), 379-401.
    Godfroid, A. (2019). Eye tracking in second language acquisition and bilingualism: A research synthesis and methodological guide. Oxon: Routledge.
    Gopnik, A., Choi, S., & Baumberger, T. (1996). Cross-linguistic differences in early semantic and cognitive development. Cognitive Development, 11(2), 197-225.
    Gottlieb, J. (2007). From thought to action: the parietal cortex as a bridge between perception, action, and cognition. Neuron, 53(1), 9-16.
    Graesser, A. C., Singer, M., & Trabasso, T. (1994). Constructing
    inferences during narrative text comprehension. Psychological Review, 101,
    371–395.
    de Grauwe, D. S., Willems, R. M., Rueschemeyer, S-R, Lemhöfer, K., & Schriefers, H.(2014). Embodied language in first-and second-language speakers: Neural correlates of processing motor verbs. Neuropsychologia, 56, 334-349.
    Griffiths, T. L., Steyvers, M., & Tenenbaum, J. B. (2007). Topics in semantic representation. Psychological Review, 114(2), 211-244.
    Grosjean, P., Ibanez, F., & Etienne, M. (2018). pastecs: Package for Analysis of Space-Time Ecological Series. https://CRAN.R-project.org/package=pastecs
    Guan, C. Q., Meng, W., Yao, R., & Glenberg, A. M. (2013). The motor system contributes to comprehension of abstract language. PloS One, 8(9), 1-11.
    Hald, L. A., van den Hurk, M., & Bekkering, H. (2015). Learning verbs more effectively through meaning congruent action animations. Learning and Instruction, 39, 107-122.
    Han, C. C., Hung, D. L., & Tsai, J. L. (2008). The connections among our minds, eyes and physical world: Looking at the link between visual perception and mental imagery from the perspective of neuroscience. Science Education Monthly, 308 (5-1), 16-23.
    Hansen, J. P. (1991). The use of eye mark recordings to support verbal retrospection in software testing. Acta Psychologica, 76(1), 31–49.
    Hahne, A. (2001). What’s different in second-language processing? Evidence from even-related brain potentials. Journal of Psycholinguistics Research, 30(3), 251-266.
    Hahne, A., & Friederici, A. D. (2001). Processing a second language: Late learners' comprehension mechanisms as revealed by event-related brain potentials. Bilingualism: Language and Cognition, 4(2), 123-141.
    Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301–307.
    Hauk, O., & Pulvermüller, F. (2004). Neurophysiological distinction of action words in the fronto-central cortex. Human Brain Mapping, 21, 191-201.
    Havas, D. A., Glenberg, A. M., & Rinck, M. (2007). Emotion simulation during language comprehension. Psychonomic Bulletin & Review, 14(3), 436-441.
    Havas, D. A., Glenberg, A. M., Gutowski, K. A., Lucarelli, M. J., & Davidson, R. J. (2010). Cosmetic use of botulinum toxin-A affects processing of emotional language. Psychological Science, 21(7), 895-900.
    Henderson, J. M., & Hollingworth, A. (1999). The role of fixation position in detecting scene changes across saccades. Psychological Science, 10(5), 438-443.
    Henderson, J. M., & Pierce, G. L. (2008). Eye movements during scene viewing: Evidence for mixed control of fixation durations. Psychonomic Bulletin & Review,15(3), 566-573.
    Henderson, J. M., Weeks Jr, P. A., & Hollingworth, A. (1999). The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology: Human perception and performance, 25(1), 210-228.
    Hernandez, A. E., & Li, P. (2007). Age of acquisition: its neural and computational mechanisms. Psychological Bulletin, 133(4), 638.
    Hernandez, A., Li, P., & MacWhinney, B. (2005). The emergence of competing modules in bilingualism. Trends in Cognitive Sciences, 9(5), 220-225.
    Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxon: Oxford University Press.
    Huang, P. S., & Chen, H. C. (2016). Gender differences in eye movements in solving text-and-diagram science problems. International Journal of Science and Mathematics Education, 14(2), 327-346.
    Hyönä, J., Lorch Jr, R. F., & Rinck, M. (2003). Eye movement measures to study global text processing. In J. Hyönä, R. Radach, & H. Deubel (Eds) The Mind's Eye: Cognitive and applied aspects of eye movement research (pp. 313-334). Netherland: Elsevier.
    Iacoboni, M., & Wilson, S. M. (2006). Beyond a single area: motor control and language within a neural architecture encompassing Broca's area. Cortex, 42(4), 503-506.
    Illes, J., Francis, W. S., Desmond, J. E., Gabrieli, J. D., Glover, G. H., Poldrack, R., ... & Wagner, A. D. (1999). Convergent cortical representation of semantic processing in bilinguals. Brain and Language, 70(3), 347-363.
    Imai, M., Li, L., Haryu, E., Okada, H., Hirsh-Pasek, K., Golinkoff, R. M., & Shigematsu, J. (2008). Novel noun and verb learning in Chinese, English, and Japanese speaking children. Child Development, 79(4), 979-1000.
    Kambanaros, M. (2009). Group effects of instrumentality and name relation on action naming in bilingual anomic aphasia. Brain and Language, 110(1), 29-37.
    Kang, H. (2014). Understanding online reading through the eyes of first and second language readers: An exploratory study. Computers & Education, 73, 1-8.
    Kaschak, M. P., Madden, C. J., Therriault, D. J., Yaxley, R. H., Aveyard, M., Blanchard, A. A., & Zwaan, R. A. (2005). Perception of motion affects language processing. Cognition, 94(3), 79-89.
    Kaschak, M. P., Zwaan, R. A., Aveyard, M., & Yaxley, R. H. (2006). Perception of auditory motion affects language processing. Cognitive Science, 30(4), 733-744.
    Kersten, A. W., & Smith, L. B. (2002). Attention to novel objects during verb learning. Child Development, 73(1), 93-109.
    Kintsch, W., & van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychological Review, 85(5), 363–394.
    Kotz, S. A. (2009). A critical review of ERP and fMRI evidence on L2 syntactic processing. Brain and Language, 109(2-3), 68-74.
    Kroll, J. F. (2015). On the consequences of bilingualism: We need language and the brain to understand cognition. Bilingualism: Language and Cognition, 18(1), 32-34.
    Kroll, J. F., & De Groot, A. M. (Eds.). (2009). Handbook of bilingualism: Psycholinguistic approaches. Oxon: Oxford University Press.
    Kroll, J. F., & Dijkstra, A. (2002). The bilingual lexicon. In R. Kaplan (Ed.), Handbook of Applied Linguistics (pp. 301-321). Oxon: Oxford University Press.
    Kroll, J. F., Dussias, P. E., Bice, K., & Perrotti, L. (2015). Bilingualism, mind, and brain. Annual Review of Linguistics, 1(1), 377-394.
    Kroll, J. F., Van Hell, J. G., Tokowicz, N., & Green, D. W. (2010). The Revised Hierarchical Model: A critical review and assessment. Bilingualism: Language and Cognition, 13(3), 373-381.
    LaBerge, D., & Samuels, S. J. (1974). Toward a theory of automatic information processing in reading. Cognitive Psychology, 6(2), 293-323.
    Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104(2), 211-240.
    Li, X., Bicknell, K., Liu, P., Wei, W., & Rayner, K. (2014). Reading is fundamentally similar across disparate writing systems: A systematic characterization of how words and characters influence eye movements in Chinese reading. Journal of Experimental Psychology: General, 143(2), 895.
    Li, P., Jin, Z., & Tan, L. H. (2004). Neural representations of nouns and verbs in Chinese: an fMRI study. Neuroimage, 21(4), 1533-1541.
    Liversedge, S. P., Drieghe, D., Li, X., Yan, G., Bai, X., & Hyönä, J. (2016). Universality in eye movements and reading: A trilingual investigation. Cognition, 147, 1-20.
    Llanos, C., Rodriguez, M., Rodriguez-Sabate, C., Morales, I., Sabate, M. (2013). Mu-rhythm changes during the planning of motor and motor imagery actions. Neuropsychologia, 51 (6), 1019–1026.
    Macedonia, M., & Knösche, T. R. (2011). Body in mind: How gestures empower foreign language learning. Mind, Brain, and Education, 5(4), 196-211.
    Mahon, B. Z., & Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology-Paris, 102(1-3), 59-70.
    Mannaert, L-N. H., Dijkstra, K., & Zwaan, R. A. (2017). Is color an integral part of a rich mental simulation? Memory & Cognition, 45(6), 974-982.
    Marian, V., Bartolotti, J., Rochanavibhata, S., Bradley, K., & Hernandez, A. E. (2017). Bilingual cortical control of between-and within-language competition.Scientific Reports, 7(1), 1-11.
    Martin, C. D., Garcia, X., Breton, A., Thierry, G., & Costa, A. (2015). World
    knowledge integration during second language comprehension. Language
    Cognition and Neuroscience, 31, 206-216.
    McNamara, D. S., & Magliano, J. (2009). Toward a comprehensive model of
    comprehension. In B. Ross (ed.), The Psychology of Learning and Motivation (pp. 297-384). New York: Elsevier.
    Meyer, L., Obleser, J., Anwander, A., & Friederici, A. D. (2012). Linking ordering in Broca's area to storage in left temporo-parietal regions: The case of sentence processing. Neuroimage, 62(3), 1987-1998.
    Meyer, L., Obleser, J., & Friederici, A. D. (2013). Left parietal alpha enhancement during working memory-intensive sentence processing. Cortex, 49(3), 711-721.
    Midgley, K. J., Holcomb, P. J., & Grainger, J. (2009). Language effects in second language learners and proficient bilinguals investigated with event-related potentials. Journal of Neurolinguistics, 22(3), 281-300.
    Miller, E. K. (2000). The prefrontal cortex and cognitive control. Nature Reviews Neuroscience, 1(1), 59–65.
    Mishra, R. K., & Marmolejo-Ramos, F. (2010). On the mental representations
    originating during the interaction between language and vision. Cognitve
    Processing, 11(4), 295-305.
    Newman, A., Tremblay, A., Nichols, E., Neville, H., Ullman, M. (2012). The
    influence of language proficiency on lexical-semantic processing
    in native and late learners of English: ERR evidence. Journal of Cognitive
    Neuroscience, 24, 1205–1223.
    Pavlenko, A. (2014). The bilingual mind: And what it tells us about language and thought. Cambridge: Cambridge University Press.
    Pavlenko, A. (2012). Affective processing in bilingual speakers: disembodied cognition? International Journal of Psychology, 47, 405–428.
    Pavlenko, A. (2017). Do you wish to waive your rights? Affect and decision-
    making in multilingual speakers. Current Opinion of Psychology, 17(C), 74–78.
    Pecher, D. (2018). Curb your embodiment. Topics in Cognitive Science, 10(3), 501-517.
    Petrie, H., & Harrison, C. (2009). Measuring user’s emotional reactions to websites. In Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (pp. 3847-3852). Retrieved from:https://dl.acm.org/doi/pdf/10.1145/1520340.1520582
    Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., & R Core Team (2019). nlme:
    Linear and nonlinear mixed effects models. R package version 4.1-141.
    Retrieved from https://CRAN.R-project.org/package=nlme
    Postma, A., & Barsalou, L. W. (2009). Spatial working memory and imagery: From eye movements to grounded cognition [Editorial]. Acta Psychologica, 132(2), 103–105.
    Prat, C. S. (2011). The brain basis of individual differences in language comprehension abilities. Language and Linguistics Compass, 5(9), 635-649.
    Pulvermüller, F. (2001). Brain reflections of words and their meaning. Trends in Cognitive Sciences, 5(12), 517-524.
    Pulvermüller, F. (2004) Lexical access as a brain mechanism. Behavioral and Brain Sciences, 27, 297-298.
    Pulvermüller, F. (2013). Semantic embodiment, disembodiment or misembodiment? In search of meaning in modules and neuron circuits. Brain and Language, 127(1), 86-103.
    Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature
    Review of Neuroscience, 6, 576–582.
    Pulvermüller, F., & Fadiga, L. (2010). Active perception: sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience, 11(5), 351-360.
    Pulvermüller, F., Hauk, O., Nikulin, V. V., & Ilmoniemi, R. J. (2005). Functional links between motor and language systems. European Journal of Neuroscience, 21, 793–797.
    R Core Team. (2016). R: A language and environment for statistical computing.
    Vienna, Austria: R Foundation for Statistical Computing. Retrieved from
    https://www. R-project.org/
    Richardson, D. C., Altmann, G. T., Spivey, M. J., & Hoover, M. A. (2009). Much ado about eye movements to nothing: a response to Ferreira et al.: Taking a new look at looking at nothing. Trends in Cognitive Sciences, 13(6), 235-236.
    Richardson, D., & Matlock, T. (2007). The integration of figurative language and static depictions: An eye movement study of fictive motion. Cognition, 102, 129-138.
    Rizzolatti, G. (2005). The mirror neuron system and its function in humans. Anatomy and Embryology, 210(5-6), 419-421.
    Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-192.
    Rizzolatti, G., Scandolara, C., Matelli, M., & Gentilucci, M. (1981). Afferent properties of periarcuate neurons in macaque monkeys. II. Visual responses. Behavioural Brain Research, 2(2), 147-163.
    Rizzolatti, G., Sinigaglia, C., & Anderson, F. (2008). Mirrors in the brain: How our minds share actions, emotions, and experience. New York: Oxford University Press.
    Romero-Rivas, C., Corey, J. D., Garcia, X., Thierry, G., Martin, C.D., & Costa, A.
    (2017). World knowledge and novel information integration during L2 speech
    comprehension. Bilingualism: Language and Cognition, 20, 576-587.
    Samuels, S. J. (1994). Toward a theory of automatic information processing in reading, revisited. In R. B. Ruddell, M. R. Ruddell, & H. Singer (Eds.), Theoretical models and processes of reading (p. 816–837). Newark: International Reading Association.
    Santana, E. J., & de Vega, M. (2013). An ERP study of motor compatibility effects in action language. Brain Research, 1526, 71-83.
    Schumann, J. H., Crowell, S. E., Jones, N. E., Lee, N., & Schuchert, S. A. (2014). The neurobiology of learning: Perspectives from second language acquisition. Oxon: Routledge.
    Seifert, C. M., Robertson, S. P., & Black, J. B. (1985). Types of inferences generated during reading. Journal of Memory and Language, 24(4), 405-422.
    Sell, A. J., & Kaschak, M. P. (2011). Processing time shifts affects the execution of motor responses. Brain and Language, 117(1), 39-44.
    Sestieri, C., Shulman, G. L., & Corbetta, M. (2017). The contribution of the human posterior parietal cortex to episodic memory. Nature Reviews Neuroscience, 18(3), 183-192.
    Shao, Z., Roelofs, A., & Meyer, A. S. (2012). Sources of individual differences in the speed of naming objects and actions: The contribution of executive control. The Quarterly Journal of Experimental Psychology, 65(10), 1927-1944.
    Sheikh, N. A., & Titone, D. A. (2013). Sensorimotor and linguistic information attenuate emotional word processing benefits: An eye-movement study. Emotion, 13(6), 1107-1121.
    Sheikh, N. A., & Titone, D. (2016). The embodiment of emotional words in a second language: An eye-movement study. Cognition and Emotion, 30(3), 488-500.
    Shiang, R. F. (2018). Embodied EFL reading activity: Let’s produce comics. Reading in a Foreign Language, 30, 108-129.
    Shtyrov, Y., Hauk, O., & Pulvermüller, F. (2004) Distributed neuronal networks for encoding category-specific semantic information: The mismatch negativity to action words. European Journal of Neuroscience, 19, 1083-1092.
    Speed, L. J. & Vigliocco, G. (2014). Eye movements reveal the dynamic simulation of speed in language. Cognitive Science, 36, 367-382.
    Spivey, M. J., & Geng, J. J. (2001). Oculomotor mechanisms activated by imagery and memory: Eye movements to absent objects. Psychological Research, 65(4), 235-241.
    Spivey, M. J., & Richardson, D. (2009). Language processing embodied and embedded. In P. Robbins & R. Aydede (Eds.).The Cambridge handbook of situated cognition (pp. 382-400). Cambridge: Cambridge University Press.
    Spivey, M. J., Richardson, D., & Dale, R. (2009). The movement of eye and hand as a window into language and cognition. In E. Morsella, J. A. Bargh & P. M. Gollwitzer (Eds.).Oxford handbook of human action (pp.225-249). New York: Oxford University Press.
    SR-Research (2017). EyeLink User Manual [Computer software manual].
    Retrieve from https://www.sr-support.com/
    SR-Research (2017). Eyelink data viewer user’s manual. Retrieve from https://www.sr-support.com/
    Stanfield, R. A., & Zwaan, R. A. (2001). The effect of implied orientation derived from verbal context on picture recognition. Psychological Science, 12(2), 153-156.
    Stein, M., Federspiel, A., Koenig, T., Wirth, M., Lehmann, C., Wiest, R., ... & Dierks, T. (2009). Reduced frontal activation with increasing 2nd language proficiency. Neuropsychologia, 47(13), 2712-2720.
    Su, Y. C., Cheng, C. M., & Chen, H. C. (2010). The backward inference processing of jokes: Evidence from eye movement. Chinese Journal of Psychology, 56(1), 83-95.
    Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language
    comprehension. Science, 268, 1632-1634.
    Tardif, T. (1996). Nouns are not always learned before verbs: Evidence from Mandarin speakers' early vocabularies. Developmental Psychology, 32(3), 492-504.
    Tardif, T. (2006). 18 But Are They Really Verbs? Chinese Words for Action. In K., Hirsh-Pasek & R. M., Golinkoff (Eds.), Action meets word: How children learn verbs, (pp.477-498). New York: Oxford University Press.
    Taylor, L. J., Lev-Ari, S., & Zwaan, R. A. (2008). Inferences about action engage action systems. Brain and Language, 107(1), 62-67.
    Taylor, L. J., & Zwaan, R. A. (2009). Action in cognition: The case of language.
    Language and Cognition, 1, 45–58.
    Taylor, L. J., & Zwaan, R. A. (2010). Grasping spheres, not planets. Cognition, 115(1), 39-45.
    Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M.,& Scifo, P.
    (2005). Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience, 17, 273–281.
    Tettamanti, M., Manenti, R., Della Rosa, P. A., Falini, A., Perani, D., Cappa, S. F., & Moro, A. (2008). Negation in the brain: Modulating action representations. Neuroimage, 43(2), 358-367.
    Tettamanti, M., & Moro, A. (2012). Can syntax appear in a mirror system? Cortex, 48(7), 923-935.
    Thompson, K. G., & Bichot, N. P. (2005). A visual salience map in the primate frontal eye field. Progress in Brain Research, 147, 249-262.
    Thompson, K. G., Biscoe, K. L., & Sato, T. R. (2005). Neuronal basis of covert spatial attention in the frontal eye field. Journal of Neuroscience, 25(41), 9479-9487.
    Tian, L., Chen, H., Zhao, W., Wu, J., Zhang, Q., De, A., ... & Parviainen, T. (2020). The role of motor system in action-related language comprehension in L1 and L2: An fMRI study. Brain and Language, 201, 1-12.
    Tomasino, B., & Rumiati, R. I. (2013). Introducing the special topic "The when and why of sensorimotor processes in conceptual knowledge and abstract concepts "[Editorial]. Frontiers in Human Neuroscience, 7, 1-3.
    Ullman, M. T. (2004). Contributions of memory circuits to language: The declarative/procedural model. Cognition, 92(1), 231–270.
    van Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York: Academic Press.
    van Elk, M., van Schie, H. T., Zwaan, R. A., & Bekkering, H. (2010). The functional role of motor activation in language processing: Motor cortical oscillations support lexical-semantic retrieval. Neuroimage, 50(2), 665-677.
    van Gog, T., Pass, F., van Merriënboer, J. G., & Witte, P. (2005). Uncovering the
    problem-solving process: Cued retrospective reporting versus concurrent and
    retrospective reporting. Journal of Experimental Psychology: Applied, 11, 237-244.
    Vigliocco, G., Perniss, P., & Vinson, D. (2014). Language as a multimodal
    phenomenon: implications for language learning, processing and evolution.
    Philosophical Transactions of the Royal Society B, 369, 1-7.
    Vigliocco, G., Vinson, D. P., Druks, J., Barber, H., & Cappa, S. F. (2011). Nouns and verbs in the brain: a review of behavioural, electrophysiological, neuropsychological and imaging studies. Neuroscience & Biobehavioral Reviews, 35(3), 407-426.
    Vukovic, N., and Shtyrov, Y. (2014). Cortical motor systems are involved in second language comprehension: evidence from rapid mu-rhythm desynchronisation. Neuroimage, 102(2), 695–703.
    Vukovic, N., and Williams, J. N. (2014). Automatic perceptual simulation of first language meanings during second language sentence processing in bilinguals. Acta Psychologica, 145(C), 98–103.
    Wang, A., Zhou, W., Shu, H., & Yan, M. (2014). Reading proficiency modulates parafoveal processing efficiency: Evidence from reading Chinese as a second language. Acta Psychologica, 152, 29-33.
    Wartenburger, I., Heekeren, H. R., Abutalebi, J., Cappa, S. F., Villringer, A., & Perani, D. (2003). Early setting of grammatical processing in the bilingual brain. Neuron, 37(1), 159-170.
    Wassenburg, S. I., & Zwaan, R. A. (2010). Rapid Communication: Readers Routinely Represent Implied Object Rotation: The Role of Visual Experience. Quarterly Journal of Experimental Psychology, 63, 1665-1670.
    Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. New York, NY: Springer.
    Willems, R. M., & Casasanto, D. (2011). Flexibility in embodied language understanding. Frontiers in Psychology, 116, 1-11.
    Willems, R. M., Toni, I., Hagoort, P., & Casasanto, D. (2010). Neural dissociations between action verb understanding and motor imagery. Journal of Cognitive Neuroscience, 22(10), 2387–2400.
    Xue, G., Dong, Q., Jin, Z., Zhang, L., & Wang, Y. (2004). An fMRI study with semantic access in low proficiency second language learners. NeuroReport, NeuroReport, 15(5), 791-796.
    Yang, C. L., Perfetti, C. A., Tan, L. H., & Jiang, Y. (2018). ERP indicators of L2 proficiency in word-to-text integration processes. Neuropsychologia, 117, 287-301.
    Yang, J., Tan, L. H., & Li, P. (2011). Lexical representation of nouns and verbs in the late bilingual brain. Journal of Neurolinguistics, 24(6), 674-682.
    Yang, Y., Wang, J., Bailer, C., Cherkassky, V., & Just, M. A. (2017). Commonalities and differences in the neural representations of English, Portuguese, and Mandarin sentences: When knowledge of the brain-language mappings for two languages is better than one. Brain and Language, 175, 77-85.
    Zarr, N., Ferguson, R., & Glenberg, A. M. (2013). Language comprehension warps the mirror neuron system. Frontiers in Human Neuroscience, 7, 1-5.
    Zinszer, B. D., Anderson, A. J., Kang, O., Wheatley, T., & Raizada, R. D. (2016). Semantic structural alignment of neural representational spaces enables translation between English and Chinese words. Journal of Cognitive Neuroscience, 28(11), 1749-1759.
    Zwaan, R. A. (1999a). Embodied cognition, perceptual symbols, and situation
    models. Discourse Processes, 28, 81-88.
    Zwaan, R. A. (1999b). Situation Models: The mental leap into imagined worlds. Current Directions in Psychological Science, 15, 15-18.
    Zwaan, R. A. (2004). The immersed experiencer: Toward an embodied theory of language comprehension. Psychology of Learning and Motivation, 44, 35-62.
    Zwaan, R. A., & Brown, C. M. (1996). The influence of language proficiency and comprehension skill on situation-model construction. Discourse Processes, 21, 289–327.
    Zwaan, R. A., & Madden, C. J. (2005). Embodied sentence comprehension. In D. Pecher & R. A. Zwaan (Eds.), Grounding cognition: The role of perception
    and action in memory, language, and thinking (pp. 224–245). Cambridge:
    Cambridge University Press.
    Zwaan, R. A. (2014). Embodiment and language comprehension: reframing the discussion. Trends in Cognitive Sciences, 18(5), 229-234.
    Zwaan, R. A., & Pecher, D. (2012). Revisiting mental simulation in language comprehension: Six replication attempts. PloS One, 7(12) 1-10.
    Zwaan, R. A., & Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123(2), 162-185.
    Zwaan, R. A., & Singer, M. (2003). Text comprehension. In A. C. Graesser, M. A. Gernsbacher, & S. R. Goldman (Eds.). Handbook of discourse processes (pp. 89-127). New Jersey: Routledge.
    Zwaan, R. A., Stanfield, R. A., & Yaxley, R. H. (2002). Language comprehenders mentally represent the shapes of objects. Psychological Science, 13(2), 168-171.
    Zwaan, R. A., & Taylor, L. J. (2006). Seeing, acting, understanding: Motor
    resonance in language comprehension. Journal of Experimental Psychology: General, 135(1), 1-11.
    Zwaan, R. A., Taylor, L. J., & De Boer, M. (2010). Motor resonance as a function of narrative time: Further tests of the linguistic focus hypothesis. Brain and Language, 112, 143-149.

    無法下載圖示 本全文未授權公開
    QR CODE