研究生: |
顏永進 Yung-Chin Yen |
---|---|
論文名稱: |
XML-Based跨平台CAT系統之設計與評估 Design and Evaluation of an XML-Based Platform-Independent Computerized Adaptive Testing System |
指導教授: |
何榮桂
Ho, Rong-Guey |
學位類別: |
碩士 Master |
系所名稱: |
資訊教育研究所 Graduate Institute of Information and Computer Education |
論文出版年: | 2002 |
畢業學年度: | 90 |
語文別: | 英文 |
論文頁數: | 51 |
中文關鍵詞: | 項目反應理論 、電腦化適性測驗 、Extensible Markup Language (XML) 、Personal Digital Assistants (PDA) 、Pocket PC |
英文關鍵詞: | Item Response Theory (IRT), Computer Adaptive Testing (CAT), Extensible Markup Language (XML), Personal Digital Assistants (PDA), Pocket PC |
論文種類: | 學術論文 |
相關次數: | 點閱:259 下載:8 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
電腦化測驗的發展由來已久,早期的發展本質上均屬古典測驗(traditional tests)的電腦化,電腦化適性測驗(computer adaptive testing)應用項目反應理論(item response theory)的原理,能以較少的試題精確的估計出受試者的能力,若能將電腦化適性測驗的施測平台由個人電腦擴展至PDA(Personal Digital Assistants)或ebook等手持裝置,對電腦化測驗的發展自有其助益。
本研究旨在提出一套跨平台電腦化適性測驗架構,讓電腦化適性測驗的施測平台更為多樣化。為評估此一架構之可行性,並瞭解受試者對不同施測平台的反應,研究者實際設計一套以XML(extensible markup language)為題庫描述規範的web-based 電腦化適性測驗系統,將五十名高中生分為兩組,各組學生以不同順序於PC及PDA上接受同一份英文字彙電腦化適性測驗,並在測驗結束後填寫一份測驗環境反應問卷。
重覆量數t考驗的結果顯示於不同平台上實施電腦化測驗,在受試者能力估計、測驗時間及測驗長度上均無顯著差異,然而多數學生均偏好於PDA上進行測驗。由此可發現以PDA為電腦化適性測驗的施測平台不僅在施測精確度及效率上不亞於PC。
The purpose of this work is to design and evaluate an XML-Based platform-independent CAT system which can expand the diversity of CAT administering platform. By using XML to describe item bank, we make it more convenient to implement CAT on different platform, such PC and PDA.
An experiment was designed to evaluate the effects of CAT administration platform on precision and efficiency. 50 senior high school students were recruited to take an English vocabulary CAT both on PC and PDA which enabled them to compare the relative advantages and disadvantages of the two different administration platforms firsthand. All the tests used the same size, well-calibrated item bank.
Taken collectively, the results indicate that the platform on which examinees taking CAT didn’t affect the performance of CAT. The result of questionnaire toward testing environment shows that most examinees prefer to take test on PDA. It leads to a conclusion that using PDA to administer CAT is both as precision and effective as PC, however, more enjoyable and convenient.
Apple. (2002). Personal digital assistant. Retrieved May 10, 2002 from WWW: http://www.theapplemuseum.com/products/pda/pda.html.
Arbortext, Inc. (1992). SGML: Getting started. Retrieved May 12, 2002 from www: http://www.arbortext.com/data/getting_started_with_SGML/getting_started_with_sgml.html.
Baker, F. B. (2001). The basics of item response theory. Retrieved May 10, 2002 from WWW: http://ericae.net/irt/.
Coyle, F. P. (2002). XML, web services, and the data revolution. Indianapolis: Addison-Wesley.
Darnell, R., Larson, M., & Kirsanov, D. (1997). HTML unleashed. Sams.net Publishing.
Hambleton, R. K., Swaminathan, H. & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park: SAGE Publications.
Ho, R. G. (2000). Tailored testing - Adaptive testing. Journal of Testing and Counseling, 157, 3288-3293. (in Chinese)
Ho, R. G., & Kuo, T. H. (1997). Networking adaptive testing. Paper presented at the Sixth International Conference on Computer-Assisted Instruction, 186-196, Taipei, Taiwan. (in Chinese)
Jon. B. (1997). XML, Java, and the future of the web. Retrieved May 12, 2002 from www: http://www.ibiblio.org/pub/sun-info/standards/xml/why/xmlapps.htm.
Jung, F. (2000). XML backgrounder - Technology and applications. Retrieved May 10, 2002 from WWW: www.softwareag.com/xml/about/e-XML_Backgrounder_WP03E0700.pdf.
JyotishSoft (2002). History of Palm. Retrieved May 10, 2002 from WWW: http://jyotishsoft.hypermart.net/pdahist.htm.
Kuo, T. H. (1997). Distance adaptive testing system - Design, implementation and evaluation. Unpublished master's thesis. National Taiwan Normal University. Taipei, Taiwan.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
Owen, R. J. (1975). A baysian sequential procedure for quantal response in the context of adaptive mental testing. Journal of the American Statistical Association, 70, 351-356.
PDA cortex. (2002). Survey reports PDAs enhance patient care. Retrieved May 10, 2002 from WWW: http://www.pdacortex.com/avantgo_survey.htm.
Rainer, G. (2002). XML - Lingua franca for computers … or more? Retrieved May 12, 2002 from www: http://www.isis-xml.com/eng_profile/1s345_tb.htm.
Ted. V. (2001). PDAs rule the school. Pen Computing, 42, November 2001. Retrieved May 10, 2002 from WWW: http://www.pencomputing.com/palm/Pen42/pdasinschool.html.
Tim. B. L. (1999). Weaving the web. New York: HarperCollins Publishers.
Wainer, H., Dorans, N., Flaughter, R. Green, B., Mislevy, R., Steinberg, L. & Thissen, D. (1990). Computerized adaptive testing: A primer. Hillsdale, New Jersey: Lawrence Erlabum Associates, Publishers.
Wainer, H. (2000). CATs: Whither and whence. International Journal of Methodology and Experimental Psychology, 21, 121-133. Retrieved May 10, 2002 from WWW: http://www.uv.es/psicologica/articulos1y2.00/wainer.pdf.
Weiss, D.J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6, 473-492.
Wong, D. (2001). Test equating. Retrieved May 10, 2002 from WWW: www.msu.edu/~dwong/CEP900/Testequating.doc.
World Wide Web Consortium (1999a). HyperText Markup Language activity statement. Retrieved May 12, 2002 from www: http://www.w3.org/MarkUp/Activity.
World Wide Web Consortium (1999b). XML Schema requirements. Retrieved May 12, 2002 from www: http://www.w3.org/TR/NOTE-xml-schema-req.
World Wide Web Consortium (1999c). CSS and XSL: Which should I use? Retrieved May 12, 2002 from www: http://www.w3.org/Style/CSS-vs-XSL.
World Wide Web Consortium (2002a). Web style sheets. Retrieved May 12, 2002 from www: http://www.w3.org/Style/.
World Wide Web Consortium (2002b). Cascading style sheets. Retrieved May 12, 2002 from www: http://www.w3.org/Style/CSS.
World Wide Web Consortium (2002c). The Extensible Stylesheet Language (XSL). Retrieved May 12, 2002 from www: http://www.w3.org/Style/XSL/.
World Wide Web Consortium (2002d). Document Object Model (DOM). Retrieved May 12, 2002 from www: http://www.w3c.org/DOM/.
World Wide Web Consortium (2002e). Document Object Model activity statement. Retrieved May 12, 2002 from www: http://www.w3c.org/DOM/Activity.html.
World Wide Web Consortium (2002f). Document Object Model FAQ. Retrieved May 12, 2002 from www: http://www.w3c.org/DOM/faq.