簡易檢索 / 詳目顯示

研究生: 關蕙芯
Kam, Emily Fen
論文名稱: 人人都需要 “字幕” 嗎?探討不同學習行為 如何影響字幕對英語聽力理解之效度
Captions for All?Validating the Effect of Captions on L2 Learners with Different Online Processing Profiles
指導教授: 劉宇挺
Liu, Yeu-Ting
學位類別: 碩士
Master
系所名稱: 英語學系
Department of English
論文出版年: 2018
畢業學年度: 106
語文別: 英文
論文頁數: 88
中文關鍵詞: 第二語言英語聽力多媒體學習字幕學習型態記憶能力
英文關鍵詞: L2 listening, multimedia learning, captions, modality preference, working memory capacity
DOI URL: http://doi.org/10.6345/THE.NTNU.DE.036.2018.A07
論文種類: 學術論文
相關次數: 點閱:297下載:74
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

在多媒體學習中,字幕影片常用來訓練第二語言英語聽力。過去研究也發現字幕能協助第二語言學習者理解英語影片內容。然而,近年來有一整合分析發現,學習者不同的學習行為,會讓他們在理解字幕影片的英語內容時,受到字幕影響的程度也有所差異。此研究探討學習者的兩種學習行為—學習型態 (聽覺與視覺型)和記憶能力(高或低)—如何影響字幕對英語聽力理解之效度。84名英語學習者的結果顯示,上述兩種學習行為對字幕的效度有不同程度的影響,甚至有顯著的交互作用。此研究發現學習者的記憶能力高度影響學習型態對英語聽力理解之效果。對記憶能力較差的學習者而言,他們的學習型態對英語聽力理解並無顯著的影響;然而,對記憶能力較佳的學習者而言,觀看無字幕的影片對聽覺型的學習者而言比較合適,反之,視覺型的學習者比較適合觀看有字幕的影片來增進聽力理解。本研究結果再次呼應不同學習行為對英語聽力的重要影響,特別是學習者如何透過字幕理解英語多媒體的資訊內容。同時,本論文也提出對教師、學習者與多媒體研發者對於英語聽力之建議,尤其針對不同學習行為提出適切的字幕影片以提升學習者的英語聽力。

Captioned video is widely used by L2 learners to enhance their exposure to native oral input beyond the classroom setting. Such exposure to captioning has been found to provide useful visual aid for parsing and understanding L2 oral discourse. Notwithstanding, a recent meta-analysis has shown that captioning exerts a selective effect on L2 learners with different input processing profiles. This study investigated whether L2 learners’ modality preferences (visual vs. auditory) and working memory capacity (high vs. low) would modulate the effect of captions on L2 listening outcomes. Results from 84 participants revealed that both cognitive variables impacted their L2 listening to different extents. Notably, working memory capacity modulates the impact of L2 learners’ modality preferences on their listening outcome. Modality preference did not exert any significant impact on the listening outcome from those with lower working memory capacity. For the L2 learners with high working memory capacity, their modality preference was crucial in determining their listening outcome; in this case, visual learners did best when watching videos with captions, whereas auditory learners exhibited the best listening outcome with captions were not provided. The findings in this study further shed light on the importance of taking individual differences into consideration when employing captioned videos to maximize L2 learners’ listening for different pedagogical purposes.

CHAPTER 1 INTRODUCTION 1 CHAPTER 2 LITERATURE REVIEW 6 2.1 Theoretical Underpinnings of Using Captions to Assist Multimodal L2 Processing 7 2.2 Empirical Studies of Captioning on L2 Listening 13 2.3 The Role of L2 Proficiency Profiles on Captioning in L2 Listening 15 2.4 Working Memory and its Potential Role in Modulating the Effect of Captio. 19 2.5 Preferred Input Modality and its Potential Role in Modulating the Effect of Captions 22 2.6 Summary 25 CHAPTER 3 METHODOLOGY 27 3.1 Participants 27 3.2 Materials 27 3.2.1 Video Selection 27 3.2.2 Caption Viewing Conditions 29 3.3 Design 29 3.4 The Assessment Tasks and Scoring 32 3.4.1 The CRT 32 3.4.2 Reading-Span Task (RST) 36 3.4.3 The Listening Comprehension Test 39 3.4.4 Questionnaire 40 3.4.5 Interview 41 3.5 Data Collection Procedure 42 3.6 Statistical Analysis 42 CHAPTER 4 RESULTS 44 4.1 Quantitative 44 4.1.1 Descriptive Statistics 44 4.1.2 A three-way ANOVA 46 4.2 Qualitative data 52 CHAPTER 5 DISCUSSION 58 5.1 RQ1: Does preferred modality modulate the effect of captioning? 59 5.1.1 Effects of caption mode on auditory learners 60 5.1.2 Effects of caption modes on visual learners 62 5.2 RQ 2: Does working memory capacity modulate the effect of captioning? 64 5.2.1 Effects of caption modes on L2 learners with lower working memory capacity 65 5.2.2 Effects of caption modes on L2 learners with higher working memory capacity 66 CHAPTER 6 CONCLUSIONS 69 6.1 Conclusion and implications 69 6.1.1 Differentiated instructions for optimal implementations of captions in multimodal listening 70 6.1.2 The implementation of CRT and RST for pedagogical purposes 73 6.2 Future suggestions and limitations 74 References 75 Appendix 1 Information Sheet and Consent Form 80 Appendix 2 Listening Comprehension Questions 82 Appendix 3 Questionnaires 85

Al-Shehri, S., & Gitsaki, C. (2010). Online reading: A preliminary study of the impact of integrated and split-attention formats on L2 students’ cognitive load. ReCALL, 22(3): 356–375.
Baddeley, A. D. (2003). Working memory: Looking back and looking forward. Nature Reviews Neuroscience, 4, 829–839.
Baddeley, A. D., & Hitch, G. (1974). Working memory. In G. H. Bower (Ed.), The psychology of learning and motivation (pp. 47–89). San Diego, CA: Academic Press.
Bird, S.A., & Williams, J.N. (2002). The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics, 23(4), 509–533.
Bloomfield, A., Wayland, S. C., Rhoades, E., Blodgett, A., Linck, J., & Ross, S. (2010). What makes listening difficult? Factors affecting second language listening comprehension. College Park, MD: University of Maryland, Center for Advanced Study of Language.
Chai, J., & Erlam, R. (2008). The effect and the influence of the use of video and captions on second language learning. New Zealand Studies in Applied Linguistics, 14(2), 25–44.
Chang, C. C., Tseng, K. H., & Tseng, J. S. (2011). Is single or dual channel with different English proficiencies better for English listening comprehension cognitive load and attitude in ubiquitous learning environment? Computers & Education, 57(4), 2313–2321.
Colflesh, G. J., & Conway, A. R. (2007). Individual differences in working memory capacity and divided attention in dichotic listening. Psychonomic Bulletin & Review, 14(4), 699–703.
Danan, M. (2004). Captioning and subtitling: Undervalued language learning strategies. Meta, 49(1): 67–77.
Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning & Verbal Behavior, 19, 450–466.
Engle, R. W., Cantor, J., & Carullo, J. J. (1992). Individual differences in working memory and comprehension: A test of four hypotheses. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(5), 972–992.
Engle, R.W., Kane, M.J., & Tuholski, S.W. (1999). Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 102–134). New York: Cambridge University Press.
Friedman, N. P., & Miyake, A. (2004). The reading span test and its predictive power for reading comprehension ability. Journal of Memory & Language, 51, 136–158.
Garza, T. J. (1991). Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals, 24(3), 239–258.
Gebhard, J. (2000). Teaching English as a foreign or second language: A teacher self -development and methodology Guide. United States of America: The University of Michigan Press.
Goh, C. C. M. (2000). A cognitive perspective on language learners’ listening comprehension problems. System, 28, 55–75.
Gruba, P. (2004). Understanding digitized second language videotext. Computer Assisted Language Learning, 17(1), 51–82.
Guichon, N., & Mclornan, S. (2008). The effects of multimodality on L2 learners: Implications for CALL resource design. System, 36(1), 85–93.
Hasler, B. S., Kersten, B., & Sweller, J. (2007). Learner control, cognitive load and instructional animation. Applied Cognitive Psychology, 21(6), 713–729.
Hayati, A., & Mohmedi, F. (2011). The effect of films with and without subtitles on listening comprehension of EFL learners. British Journal of Educational Technology, 42(1), 181–192.
Huang, H.C., & Eskey, D. E. (1999). The effects of closed-captioned television on the listening comprehension of intermediate English as a second language (ESL) students. Journal of Educational Technology Systems, 28(1), 75–96.
Jong, T. D. (2010). Cognitive load theory, educational research, and instructional design: Some food for thought. Instructional Science, 38(2), 105–134.
Leveridge, A. N. (2015). The removal of target language captioning supports. In Turel, V. (Ed), Intelligent design of interactive multimedia listening software (pp. 75–101). Hershey: Information Science Reference.
Leveridge, A. N., & Yang, J. C. (2012). Effect of medium: A conceptual framework for the removal of supporting captions for EFL listening comprehension in multimedia instructional delivery. In: 15th International CALL Research Conference: Proceedings.Taiwan: Taichung.
Leveridge, A. N., & Yang, J. C. (2013a). Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545-559.
Leveridge, A. N., & Yang, J. C. (2013b). Testing learner reliance on caption supports in second language listening comprehension multimedia environments. ReCALL, 25(02), 199-214.
Liu, Y. T., & Todd, A. G. (2014). Dual-modality input in repeated reading for foreign language learners with different learning styles. Foreign Language Annals, 47(4), 684–706.
Low, R., & Sweller, J. (2005). The modality principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 147–158). New York: Cambridge University Press.
Lwo, L., & Lin, M. C. T. (2012). The effects of captions in teenagers’ multimedia L2 learning. ReCALL, 24(2), 188–208.
Markham, P. (1989). The effects of captioned television videotapes on the listening comprehension of beginning, intermediate and advanced ESL students. Educational Technology, 29, 38–41.
Markham, P. L., & Peter, L. (2003). The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, 31(3), 331–341.
Markham, P., Peter, L., & McCarthy, T. (2001). The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5), 439–445.
Mayer, R. E. (1996). Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction. Educational Psychology Review, 8(4), 357–371.
Mayer, R. E. (1999). Research-based principles for the design of instructional messages: The case of multimedia explanations. Document Design Journal of Research and Problem Solving in Organizational Communication, 1(1), 7–19.
Mayer, R. E. (2001). Multimedia learning. New York: Cambridge University Press.
Mayer, R. E. (2005a). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), Cambridge handbook of multimedia learning (pp. 31–48). New York: Cambridge University Press.
Mayer, R. E. (2005b). Principles for managing essential processing multimedia learning: Segmenting, pretraining, and modality principles. In R. E. Mayer (Ed.), Cambridge handbook of multimedia learning (pp. 169–182). New York: Cambridge University Press.
Mayer, R. E. (2010). Applying the science of learning to medical education. Medical Education, 44: 543–549.
Miyake, A., & Friedman, D. (1998). Individual differences in second language proficiency: Working memory as language aptitude. In A. F. Healy & L. E. Bourne, Jr (Eds.), Foreign language learning: Psycholinguistic studies on training and retention (pp. 339–364). Mahwah, NJ: Erlbaum.
Mirzaei, M. S., Meshgi, K., Akita, Y., & Kawahara, T. (2017). Partial and synchronized captioning: A new tool to assist learners in developing second language listening skill. ReCALL, 29(02), 178–199.
Moreno, R. (2006). Optimizing learning from animations by minimizing cognitive load: Cognitive and affective consequences of signaling and segmentation methods. Applied Cognitive Psychology, 21, 1–17.
Moreno, R., & Mayer, R. E. (2007). Interactive multimodal learning environments. Educational Psychology Review, 19, 309–326.
Oxford, R. L. (2003). Language learning styles and strategies: Concepts and relationships. IRAL, 41(4), 271–278.
Perez, M. M., Noortgate, W. V. D., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739.
Pujola, J.T. (2002). CALLing for help: Researching language learning strategies using help facilities in a web-based multimedia program. ReCALL,14(2), 235–262.
Reid, J. (1995). Learning styles in the ESL/EFL classroom. Boston: Heinle & Heinle.
Révész, A. (2012). Working memory and the observed effectiveness of recasts on different L2 outcome measures. Language Learning, 62(1), 93–132.
Scarcella, R. & Oxford, R. (1992). The tapestry of language learning: The individual in the communicative classroom. Boston: Heinle & Heinle.
Stewart, M. A., & Pertusa, I. (2004). Gains to language learners from viewing target language closed-captioned films. Foreign Language Annals, 37(3), 438–442.
Sun, Y., & Dong, Q. (2004). An experiment on supporting children’s English vocabulary learning in multimedia context. Computer Assisted Language Learning, 17(2), 131–147.
Sydorenko, T. (2010). Modality of input and vocabulary acquisition. Language Learning and Technology, 14, 50–73.
Taylor, G. (2005). Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38(3), 422–427.
Turner, M. L., & Engle, R. W. (1989). Is working memory capacity task dependent? Journal of Memory and Language, 28(2), 127–154.
Vandergrift, L. (2004). Listening to learn or learning to listen? Annual Review of Applied Linguistics, 24, 3–25.
Vanderplank, R. (2010). Déjà vu? A decade of research on language laboratories, television and video in language learning. Language Teaching, 43(1), 1–37.
Vigliocco, G., Perniss, P., & Vinson, D. (2014). Language as a multimodal phenomenon: Implications for language learning, processing and evolution. Philos Trans R Soc Lond B Biol Sci, 369, 1–7.
Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1), 65–86.
Winke, P., Gass, S., & Sydorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye‐tracking study. The Modern Language Journal, 97(1), 254–275.

下載圖示
QR CODE