研究生: |
郭明翰 ming han kuo |
---|---|
論文名稱: |
階梯教室之學生上課動作分析系統 Students' gesture analysis system in a lecture theatre |
指導教授: |
方瓊瑤
Fang, Chiung-Yao |
學位類別: |
碩士 Master |
系所名稱: |
資訊工程學系 Department of Computer Science and Information Engineering |
論文出版年: | 2010 |
畢業學年度: | 98 |
語文別: | 中文 |
論文頁數: | 65 |
中文關鍵詞: | 動作辨識 、階梯教室 、region gorwing 、object segmentation |
論文種類: | 學術論文 |
相關次數: | 點閱:122 下載:5 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本篇論文主要探討階梯教室學生上課動作分析系統。動作分析在教育領域尤其重要,老師可藉由觀察學生的動作知道學生的學習狀況。例如學生舉手,老師可對學生不懂的部份加以說明,提高學生的學習效率。
本研究將攝影機架設在階梯教室前面以擷取學生上課影像。系統先定位教室椅背高度線,並取出影像前景顏色。藉由motion與前景顏色資訊整合判斷出影像前景點。接著利用影像前景點為種子進行region growing,並將擴展出的regions利用region combination演算法定位學生物件。本系統使用學生物件的組成關係變化辨識六種動作,分別為舉右手、舉左手、舉雙手、趴下、站立與正常坐姿。實驗結果顯示提出方法可以解決一些環境的問題,並對實驗遇到其他問題有分析與討論。
最後本研究還有能改進的部份,未來希望能整合其他資訊或者更適合的方法讓本研究更完整。
This paper presents a students’ gestures recognition system in a theater classroom. Gesture recognition is important in many fields, especially in education field. Teacher can know students’ situation by observing their gestures in class. For example, students raise their hands may have question in class, so teacher can explain that make students clear in problem.
In this study the PTZ camera is set in front of the classroom to capture the student sequence. The system first preprocess the input image to locate the main line and extract foreground color. Then system combine motion and foreground color to judge foreground pixels. System use these foreground pixels as seeds to do region growing. Then system apply region combination algorithm to do object segmentation. Six student gesture, including different gesture of raising the right hand, raising the left hand, raising two hands, lining prone, standing up and normal, are classified by the relationship of objects. The experimental results show that the proposed method can solve some experimental situation problem, and the other problem also analyzed and discussed.
Finally, the study have some part can be improved. In the future year, I hope that better technology and information can added to this system in order to make the research more complete.
[Mit07] S. Mitra and T. Acharya, “Gesture Recognition: A Survey,” IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, Page(s):311 - 324, 2007.
[Min99] M. H. Yang and N. Ahuja “Recognizing Hand Gesture Using Motion Trajectories,” Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, in USA, Page(s):652 – 657, 1999.
[Nat08] P. Natarajan and R. Nevatia “Online, Real-time Tracking and Recognition of Human Actions,” Proceedings of IEEE Workshop on Motion and video Computing, (WMVC 2008), Page(s):1 - 8, 2008.
[Pen00] P. Hong, M. Turk and T. S. Huang, “Gesture Modeling and Recognition Using Finite State Machines,” Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition, in France, Page(s):410 - 415, 2000.
[Wan08] K. Wan and H. Sawada, “Dynamic Gesture Recognition Based on the Probabilistic Distribution of arm Trajectory,” Proceedings of International Conference on Mechatronics and Automation, Page(s):426 – 431, 2008.
[Wei08] W. H. Andrew Wang and C. L. Tung, “Dynamic N Using Hand Gesture Recognition Hierarchical Dynamic Bayesian Networks Through Low-Level Image Processing” Proceedings of International Conference on Machine Learning and Cybernetics, Page(s):3247 – 3253, 2008.
[Sar08] M. E. Sargin, Y. Yemez, E. Erzin and A. M. Tekalp, “Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Page(s):1330 – 1345, 2008.
[Kai09] K. Huang, D. Tao, Y. Yuan, X. Li, and T. Tan, “View-Independent Behavior Analysis,” IEEE Transactions on Systems, Man, and Cybernetics, Part B; Vol. 39, Page(s):1028 – 1035, 2009.
[Veg03] I. R. Vega and S. Sarkar, “Statistical Motion Model Based on the Change of Feature Relationships: Human Gait-Based Recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Page(s):1323 - 1328, 2003.
[Nay09] S. Nayak, S. Sarkar, and B. Loeding, “Distribution-Based Dimensionality Reduction Applied to Articulated Motion Recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, Page(s):795 - 810, 2009.
[Alo09] J. Alon, V. Athitsos, Q. Yuan and S. Sclaroff, “A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, Page(s):1685 - 1699, 2009.
[Shu08] Q. Shu, T. Hattori, T. Izumi, H. Kitajima and T. Yamasaki, “Face Identification for People Image with General Background Using Vector Phase Field,” Proceedings of International Conference on Industrial Technology, in Chengdu, Page(s):1 – 5, 2008.
[Pha09] P. Bao, N. T. Binh, and T. D. Khoa, “A New Approach to Hand Tracking and Gesture Recognition by a New Feature Type and HMM,” Proceedings of Sixth International Conference on Fuzzy Systems and Knowledge Discovery, 2009, in Tianjin, Page(s):3 - 6, 2009.
[Kir05] T. Kirishima, K. Sato, and K. Chihara, “Real-time gesture recognition by learning and selective control of visual interest points,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, Page(s):351 - 364, 2005.
[Qin08] Q. Chen, N. D. Georganas, and E. M. Petriu, “Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar, ” IEEE Transactions on Instrumentation and Measurement, Vol. 57, Page(s):1562 - 1571, 2008.
[Oze05] I. B .Ozer, T. Lu, and W. Wolf,“ Design of a real-time gesture recognition system: high performance thithms and softrough algorware,” IEEE Transactions on Signal Processing Magazine, Vol. 22, Page(s):57 - 64, 2005.
[Tri01] J. Triesch, C. V. D. Malsburg, “A system for person-independent hand posture recognition against complex backgrounds,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, Page(s):1449 - 1453, 2001.
[Yan09] Y. Wang, G. Mori, “Human Action Recognition by Semilatent Topic Models,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31, Page(s):1762 - 1774, 2009.
[Oka02] K. Oka, Y. Sato, and H. Koike, “Real-time fingertip tracking and gesture recognition,” IEEE Transactions on Computer Graphics and Applications, Vol. 22, Page(s):64 - 71, 2002.