簡易檢索 / 詳目顯示

研究生: 林寀雯
Lin, Tsai-Wen
論文名稱: 以測驗和眼動型態建構交互作用效果的圖文閱讀理解模式
Constructing a model of reading comprehension of interaction effect with figure and text by test and eye movement
指導教授: 吳昭容
Wu, Chao-Jung
學位類別: 博士
Doctor
系所名稱: 教育心理與輔導學系
Department of Educational Psychology and Counseling
論文出版年: 2015
畢業學年度: 104
語文別: 中文
論文頁數: 117
中文關鍵詞: 交互作用效果統計圖文閱讀理解眼動型態圖文整合
英文關鍵詞: interaction effect, statistical figure and text, reading comprehension, eye movement, integration of figure and text
論文種類: 學術論文
相關次數: 點閱:300下載:22
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報

本研究以眼動資料與測驗結果,建構交互作用效果的統計圖文閱讀理解模式。論文中包含三個研究。研究一發現交互作用效果對於一般成人而言是複雜的概念,不同領域專家的看法也不完全一致。但交叉型態的圖示能使讀者連結到「交互」的字面意義,協助判讀。因此,研究二以交叉統計圖的有無為實驗操弄,發現統計圖確實影響閱讀理解的歷程和效果,但提升幅度未如預期的佳。於是,研究三以圖文訊息對應性和圖形對稱性的觀點,修改統計圖,並以讀者閱讀理解表現與眼動資料討論圖文整合的歷程。
研究一包含兩個部分,1-1探討一般民眾對交互作用效果的解讀,研究對象為12位大專(含)以上,包含研究所與社會人士之民眾,不限領域。研究先提供受訪者一個交互作用效果的範例,接著請他們判斷後續兩個文本的現象是否為交互作用效果,並解釋原因。結果發現,讀者的解讀多侷限在交互作用的字面意義,且認為單純主要效果的描述相當難理解,而略有基礎統計概念者可簡略描述資料分析方式;此外,讀者會將交叉圖形連結交互一詞進行解釋。研究1-2藉由領域專家獲得交互作用效果的重要概念內涵,以編製後續實驗材料,研究對象為醫藥、物理、心理計量三個領域,共16位領域專家。研究材料是兩個交互作用效果文本,受訪者需判斷該文本是否為交互作用效果,並以口頭與繪圖說明之。結果顯示,心理計量專家著重於變項概念與統計考驗的重要性,並運用統計學交互作用效果的概念,進行跨文本的解釋,其他領域專家則是針對專業領域中交互作用的運作機制進行論述。最後,整合研究一的結果,得出交互作用效果包含基本的和進階的概念。
研究二的研究對象為60位大學生(含)以上的社會人士,探討純文與圖文並置對讀者交互作用效果的閱讀理解之影響。於正式眼動實驗前,以301位大學生(含)以上的社會人士進行團測,以確立實驗材料的難度是否適合一般大眾閱讀,並掌握讀者所需的閱讀時間以利設計正式實驗。研究二採單因子受試者間設計,實驗組閱讀圖文並置的版本,控制組則閱讀純文字的版本。閱讀時以眼動儀記錄眼動軌跡,兩組在閱讀完實驗材料後,都接著進行閱讀理解測驗。結果發現,多了統計圖後,提升了讀者整體的閱讀理解正確率,特別是基本概念的題目,亦即藉由統計圖座標軸標示的變項可以協助讀者讀取表層特徵。眼動追蹤資料顯示,多了圖之後,讀者的閱讀時間並未增加,而是分配時間去讀圖,節省讀文的時間;但圖文版的讀者在句末較少進行語意統整,可能因抱持仰賴圖的態度,而未投入與純文組同等程度的努力去讀文。
研究三的研究對象為70位大學生(含)以上的一般成人。實驗設計採單因子受試者間設計,實驗材料是沿用研究二的交互作用效果的文字內容,以圖文訊息對應性與圖形對稱性為實驗操弄,修改統計圖的編製方式,共有三種實驗材料版本—非對稱、對稱和單圖。非對稱組和對稱組的文本中都有兩張圖,差別在於兩張圖的交叉開口是否對稱;單圖組有一張交叉開口對稱的圖(同對稱組的其中一張圖)。結果發現,(一)對稱組與單圖組在閱讀理解正確率無顯著差異,但兩組的眼動型態有所差異,顯示圖文訊息對應性影響閱讀歷程但對閱讀理解的影響不大。相較於單圖組在讀完文之後始去讀圖,兩張圖會促使讀者在閱讀歷程中途(段落2和段落4)遇到圖文對應的訊息就去讀圖。推測其因,雙圖提供較完整的訊息且也較為醒目,吸引讀者在尚未讀完文時就去讀圖。(二)非對稱與對稱在閱讀理解正確率無顯著差異,但兩組的眼動型態亦有所差異,顯示圖形對稱性影響閱讀歷程但對理解的影響不大。非對稱組花較多的時間讀文,且有更多跨圖間的閱讀。即圖形兩邊開口不對稱易引發讀者思考該表徵的意義,而增加讀文的時間,且在圖間來回搜尋以比對兩張圖的差異。此外,閱讀過程中,非對稱組會同時參照二圖,反之,對稱組僅到所讀到的段落之鄰近圖示閱讀。即非對稱組視兩張圖為獨立的,需同時參照並比對雙圖的差異來確定圖文訊息是否對應;然而,對稱組則視雙圖為相同的圖形樣式,因此採取便利的閱讀路徑,僅到靠近文的圖上搜尋圖文對應的訊息。(三)非對稱與單圖的比較旨在分析兩種實驗操弄加乘的效果,結果非對稱組在基本和進階概念的理解都有較佳的傾向。
本研究以交互作用效果統計圖文的版置概括有無圖示、圖文訊息對應(雙圖與單圖),以及圖像知覺(非對稱與對稱)等實驗操弄,提出統計圖文閱讀理解的模式。相對於純文的閱讀,加入統計圖會使讀者從圖文參照中,讀取圖所蘊涵的語意和空間表徵,形成他們對交互作用效果的基本概念,也節省讀文的時間。其次,雙圖的知覺醒目性會引導讀者在閱讀文章中途就去參照圖,再繼續處理文。最後,統計圖形的不對稱性,會影響讀者的閱讀時間與圖文整合的型態。

關鍵字:交互作用效果、統計圖文、閱讀理解、眼動型態、圖文整合

This study composing of three researches aimed to construct a model of reading comprehension of interaction effect with statistical text and figure. First, it was found in the Research 1 that interaction effect is a complicated concept for the public and field experts hold diverse perspectives of it even though. Yet, the cross-over figure could prime readers to associate the shape of cross-over with the surface meaning of “interaction”. Hence, adding a cross-over figure of interaction effect was used as the manipulation in the Research 2, which was explored to influence the process and the performance of reading comprehension. Nevertheless, the effect of adding a cross-over figure was not as great as the expected. Accordingly, consistency of information between figure and text and symmetry of figure were operated in the Research 3 to explore the effect on participants’ performance and process of reading comprehension.
Two sub researches were involved in the Research 1. Research 1-1 aimed to explore how the public comprehended interaction effect with 12 participants. Participants would read an interaction effect example and then they were asked to interpret interaction effect in the following two tests and make explanations. It was revealed that participants’ interpretation was the surface meaning of interaction and they claimed the difficulty of description of simple main effect. Furthermore, some participants with basic statistical background knowledge could make simple explanations of data analysis. Research 1-2 aimed to come by the important concepts of interaction effect to make the following experimental materials. 16 participants were field experts of medicine, physics and psycho-statistics. Participants would read two text of interaction effect and then interpret interaction effect both with verbal explanations as well as drawing figures. It was found that experts of psycho-statistics focused on the concept of variable and test significance and were inclined to utilize general principles of statistics to interpret different text, meanwhile experts of other fields emphasized on the mechanism of interaction effect. Last, fundamental and advanced concepts of interaction effect were obtained.
The Research 2 aimed to explore the effect on participants’ reading comprehension of interaction effect from text and text with figure. There were 60 participants. A group test was held with 301 participants to confirm the readability and the difficulty of experimental materials and to design the experimental procedure before the formal experiments. One-factor between groups was used in the Research 2 with text group as control group and text with figure group as experimental group. EyeLink 2000 was utilized to record participants’ eye movement during experiments.
It was explored that adding a statistical figure promoted participants’ accuracy of performance of reading comprehension especially on items belonging to fundamental concepts, which revealed the effect of statistical figure on benefitting participants to grab the surface representations from figure. Total fixation duration were not on increase; participants distributed reading time on figure to save the reading time on text. For another thing, text with figure group performed less semantic integration in the end of sentences, which could refer to it that participants in this group consumed less mental effort on reading text for they had intention to depend on figure.
The Research 2 aimed to realize how the effect of manipulations, involving consistency of information between figure and text and symmetry of figure impacted on participants’ reading comprehension. There were 70 participants. Experimental materials were text with two unsymmetrical cross-over figures (experimental group 1), text with two symmetrical cross-over figures (experimental group 2), and text with one symmetrical cross-over figure (baseline group). Results are shown as follows. First, there is no test significance of performance of reading comprehension between experimental group 2 and baseline group. However, eye movement between these two groups revealed differences on the process of reading comprehension that experimental group 1 would read the figures during reading text meanwhile experimental group 2 would read the figure after reading the whole text. Second, differences of eye movement between experimental group 1 and baseline group showed that unsymmetrical figures facilitated participants to contemplate the meaning of this representation so as to spend more time on text and eye movement across figures. Additionally, experimental group 1 would refer to two figures simultaneously for they regarded two figures independent. Yet, experimental group 1 would trace back to the figure just next to the read text for they held two figures independent were the same. Last, the effect of two manipulations would influence enhance both basic and advanced concepts of interaction effect.
Composition was concerned as the integrative concept to combine all the manipulations in this study so as to construct the model of reading comprehension of statistical text with figure. Semantic and spatial representations of figure benefited readers to form concepts of interaction effect and save the reading time on text. Salience of figure guided readers to refer to figure during reading text. Finally, symmetrical and unsymmetrical figures would influence the reading time and integration of figure and text.
Keyword:interaction effect, statistical figure and text, reading comprehension, eye movement, integration of figure and text

緒論...............................1 研究背景與目的......................1 統計學上的交互作用效果及其類型......4 圖文整合閱讀理解之理論及其眼動研究..10 圖文整合眼動研究的分析指標.........16 研究一.............................19 研究1-1 ..........................19 研究對象..........................19 實驗材料..........................19 實驗程序..........................20 結果與分析........................21 研究1-2...........................23 研究對象..........................23 實驗材料..........................23 實驗程序..........................24 結果與分析........................25 研究1-1與1-2之綜合討論.............28 研究二..............................31 研究對象..........................32 實驗材料..........................32 實驗程序..........................38 結果與分析........................39 討論.............................52 研究三...........................57 研究對象.........................59 實驗材料.........................59 實驗程序.........................60 結果與分析.......................61 討論............................68 綜合討論...........................73 參考文獻...........................85 附錄..............................93 附錄一...........................93 附錄二...........................97 附錄三..........................101 附錄四..........................103 附錄五..........................105 附錄六..........................107 附錄七..........................109 附錄八..........................113 附錄九..........................115 附錄十..........................117

中文部分
王保進(2006)。英文視窗版SPSS與行為科學研究。台北市:心理。
國立編譯館(2000)。教育大辭書(五)。台北市:文景。
岳修平、林維真、李孟潔、黃瀞瑩、葉思岑(2011)。電子書漫畫之閱讀
歷程與行為初探。教學科技與媒體,95,69-78。
林宜隆(1999)。整合性犯罪偵查專家系統之研究現況與未來趨勢。檔案
與微縮,52,6-19。
林清山(2012)。心理與教育統計學。台北市:東華。
柯華葳、陳明蕾、廖家寧(2005)。詞頻、詞彙類型與眼球運動型態:來
自篇章閱讀的證據。中華心理學刊,47(4),381-398。
陳建勳、陳麗芳、王慧瑜(2005)。應用關聯規則在門診出方行為與潛藏
藥物交互作用分析的研究。醫療資訊雜誌,14(4),41-53。
陳琪瑤、吳昭容(2012)。幾何證明文本閱讀的眼動研究:圖文比重及圖
示著色效果。教育實踐與研究,25(2),35-66。
陳學志、賴惠德、邱發忠(2010)。眼球追蹤技術在學習與教育上的應
用。教育科學研究期刊,55(4),39-68。
蓋允萍、鍾昌宏、王國華、張惠博(2014)。以視覺設計文法比較臺澳科
學教科書圖像 ―以七年級生物分類單元為例。科學教育學刊,
22(2),109-134。
劉子鍵、林怡均(2011)。發展二階段診斷工具探討學生之統計迷思概
念:以「相關」為例。教育心理學報,42(3),379-400。
劉湘瑤、李麗菁、蔡今中(2007)。社會認識觀與社會性科學議題抉擇判
斷之相關性探討。科學教育學刊,15(3),335-356。  
蔡介立、顏妙璇、汪勁安(2005)。眼球移動測量在中文閱讀研究之應
用。應用心理研究,28,91-104。
盧秀琴、宋家驥(2010)。高中奈米科技課程的專家概念與情境式問卷之
建構。教育實踐與研究,23(1),85-114。
簡郁芩(2012)。從圖文閱讀的眼動型態建構與驗證機械動態表徵的認知
模式。國立臺灣師範大學教育心理與輔導系博士論文,未出版,臺北
市。
簡郁芩、吳昭容(2012)。以眼動型態和閱讀測驗表現探討箭頭在科學圖
文閱讀中的圖示效果。中華心理學刊,54(3),385-402。
蘇蘅(2002)。新聞學裡的罪與罰─報紙與電視新聞如何再現青少年犯
罪。新聞學研究,70,59-96。
西文部分
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008).
Mixed-effects modeling with crossed random effects for
subjects and items. Journal of memory and language,
59(4), 390-412.
Baron, R. M., & Kenny, D. A. (1986). Moderator-mediator
variable distinction in social psychological research:
Conceptual, strategic, and statistical considerations.
Journal of Personality and Social Psychology, 51(6),
1173-1182.
Ben-Zvi, D., & Garfield, J. B. (Eds.). (2004). The
challenge of developing statistical literacy,
reasoning and thinking. Dordrecht: Kluwer Academic
Publishers.
Ben-Zvi, D., & Garfield, J. (2005). Statistical literacy,
reasoning, and thinking: Goals, definitions, and
challenges. In D., Ben-Zvi, & J. B. Garfield, (Eds.),
The challenge of developing statistical literacy,
reasoning and thinking (pp. 3-15). Dordrecht: Kluwer
Academic Publishers.
Carpenter, P. A., & Shah, P. (1998). A model of the
perceptual and conceptual process in graph
comprehension. Journal of Experimental Psychology:
Applied, 4, 75-100.
Cook, M., Carter, G. & Wiebe, E. N. (2008).The
interpretation of cellular transport graphics by
students with low and high prior knowledge.
Internatioal Journal of Science Education, 30, 239-
261.
David S. M., & William. I. N. (2012). 統計學的世界。(鄭惟
厚譯)。台北:天下文化 (原著出版於1991年)。 
Drieghe, D., Rayner, K., & Pollatsek, A. (2005). Eye
movements and word skipping during reading revisited.
Journal of Experimental Psychology: Human Perception
and Performance, 31(5), 954-969.
Elmes, D. G., Kantowitz, B. H., & Roediger, I. H. L.
(2011). Research methods in psychology. Belmont, CA:
Cengage learning.
Epelboim, J., & Suppes, P. (2001). A model of eye
movements and visual working memory during problem
solving in geometry. Vision Research, 41, 1561-1574.
Evans, M. A., & Saint-Aubin, J. (2005). What children are
looking at during shared storybook reading: Evidence
from eye movements. Psychological Science, 16, 913-
920.
Freedman, E. G., & Shah, P. (2002). Toward a model of
knowledge-based graph comprehension. In Diagrammatic
representation and inference (pp. 18-30). Berlin:
Springer.
Gal, I. (2002). Adults' statistical literacy: Meanings,
components, responsibilities. International
Statistical Review, 71(1), 1-51.
Hannus, M., & Hyönä, J. (1999). Utilization of
illustrations during learning of science textbook
passages among low- and high-ability children.
Contemporary Educational Psychology, 24, 95-123.
Hegarty, M., & Just, M. A. (1993). Constructing mental
models of machines from text and diagrams. Journal of
Memory and Language, 32, 717-742.
Hegarty, M., & Mayer, R. E., & Green, C. E. (1992).
Comprehension of arithmetic word problems: evidence
from students' eye fixations. Journal of Educational
Psychology, 84(1), 76-84.
Hegarty, M., Carpenter, P. A., & Just, M. A. (1991).
Diagrams in the comprehension of scientific texts. In
R. Barr, M. L. Kamili, P. B. Mosenthal, & P. D. Person
(Eds), Handbook of reading research (Vol.2) (pp. 641-
668). New York : Longman.
Jian, Y. C., Wu, C. J., & Su, J. H. (2014). Learners’ eye
movements during construction of mechanical kinematic
representations from static diagrams. Learning and
Instruction, 32, 51–62.
Juhasz, B. J., & Rayner, K. (2003). Investigating the
effects of a set of intercorrelated variables on eye
fixation durations in reading. Journal of Experimental
Psychology: Learning, Memory, and Cognition, 29,
1312–1318.
Johanna, K. K., & Jukka, H. (2008). Perspective-driven
text comprehension. Applied
Cognitive Psychology, 22, 319-334.
Johnson, C. I., & Mayer, R. E. (2012). An eye movement
analysis of the spatial contiguity effect in
multimedia learning. Journal of Experimental
Psychology: Applied, 18(2), 178-191.
Just, M. A., & Carpenter, P. A. (1987). The psychological
of reading and language comprehension. Newton, MA:
Allyn and Bacon.
Kintsch, W. (1988). The use of knowledge in discourse
processing: A construction-integration model.
Psychology Review, 95, 163-182.
Lin, T. W., Wu, C. J., & Sommers, S. (2012, July). The
influence of reading figures in geometry proof on eye
movement. In T. Y. Tso (Ed.), Proceedings of the
36thConference of the International Group for the
Psychology of Mathematics Education, Vol. 3, p. 147-
152. Taipei, Taiwan: PME.
Mayer, R. E. (2001). Multimedia learning. Cambridge, UK:
Cambridge University Press.
Mayer, R. E. (2005). Cognitive theory of Multimedia
learning. In R. E. Mayer (Ed.), Cambridge handbook of
Multimedia learning (pp. 31-48). New York: Cambridge
University Press.
Mayer, R. E. (2011). Instruction based on visualizations.
In R. E. Mayer & P. A. Alexander (Eds.), Handbook of
research on learning and instruction (pp. 427-445).
New York: Routledge.
Melinda, V. (2002). Checking the pulse: Midwestern
reporters’ opinion on their ability to report health
care news. American Journal of Public Health, 92(7),
1158-1160.
Millis, K. K. & Just, M. A. (1994). The influence of
connectives on sentence comprehension. Journal of
Memory and Language, 33, 128-147.
Muller, D., Judd, C. M., & Yzerbyt, V. Y. (2005). When
moderation is mediated and mediation is moderated.
Journal of Personality and Social Psychology, 89(6),
852-863.
Pinker, S. (1990). A theory of graph comprehension. In R.
Freedle (Ed.), Artificial intelligence and the future
of testing (pp. 73-126). Hillsdale, NJ: Erlbaum.
Rayner, K. (1998). Eye Movements in reading and
information processing: 20 year of research.
Psychological Bulletin, 124(3), 372-422.
Rayner, K., Rotello, C. M., Stewart, A. J., Keir, J., &
Duffy, S. A. (2001). Integrating text and pictorial
information: Eye movements when looking at print
advertisements. Journal of Experimental Psychology:
Applied, 7, 219-226. 
Rayner, K. (2009). Eye Movements and attention in
reading, scene perception, and visual search. The
Quarterly Journal of Experimental Psychology, 62(8),
1457- 1506.
Schnotz, W., & Bannert, M. (2003). Construction and
interference in learning from multiple
representations. Learning and Instruction, 13, 141-
156.
Schnotz, W., Ludewig, U., Ulrich, M., Horz, H., McElvany,
N., & Baumert, J. (2014). Strategy shifts during
learning from texts and picture. Journal of
Educational Psychology, 106 (4),974-989.
Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010).
A closer look at split visual attention in system- and
self-paced instruction in multimedia learning.
Learning and Instruction, 20 (2), 100-110.                              Shah, P., & Freedman, E. G. (2009). Bar and line graph
comprehension: An interaction of top-down and bottom-
up processes. Topics in Cognitive Science, 3(3), 560-
578.                              Shah, P., & James, H. (2002). Review of graph comprehension research: Implications for instruction. Educational Psychology Review, 14(1), 47-69.                           
Shah, P., Mayer, R. E., & Hegarty, M. (1999). Graphs as aids to knowledge construction: Signaling techniques for guiding the process of graph comprehension. Journal of Educational Psychology, 91, 690-702.                              Stanovich, K. E. (2012). 這才是心理學。(楊中芳譯)。台北:遠流。(原著出版於2004年)
Unsworth, L. (2006). Towards a metalanguage for
multiliteracies education: Describing the meaning-
making resources of language-image interaction.
English Teaching: Practice and Critique, 5(1), 55-76.
Williams, R. S., & Morris, R. K. (2004). Eye movements,
word familiarity, and vocabulary acquisition. European
Journal of Cognitive Psychology, 16(1/2), 312-339.
Winter, B. (2013). Linear models and linear mixed effects
models in R with linguistic
applications. Retrieved from http://arxiv.org/pdf/
1308.5499.pdf.
Zohar, A. (1995). Reasoning about interactions between
variables. Journal of Research in Science Teaching,
32(10), 1039-1063.

下載圖示
QR CODE