簡易檢索 / 詳目顯示

研究生: 唐唯傑
Tan, Wei-Chieh
論文名稱: 具頭動補償功能之頭戴式眼動儀系統
A System of Head Mounted Eye Tracker with Head Movement Compensation
指導教授: 黃奇武
Huang, Chi-Wu
學位類別: 碩士
Master
系所名稱: 電機工程學系
Department of Electrical Engineering
論文出版年: 2016
畢業學年度: 104
語文別: 中文
論文頁數: 94
中文關鍵詞: 眼動儀頭動補償
英文關鍵詞: eye tracker, head movement compensation
DOI URL: https://doi.org/10.6345/NTNU202204376
論文種類: 學術論文
相關次數: 點閱:164下載:36
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 眼動儀是一種藉由追蹤使用者眼球運動並推估使用者凝視點的裝置,主要的用途在於心理學上的研究和做為身障者的輔具。一般的眼動儀在進行完校正步驟後,若是使用者頭部有移動,預估出的凝視點誤差將會增加,除了使用一些裝置固定頭部外,為了追求使用時的自由度和方便性,如何在頭部能夠移動的情況下進行正確的凝視點預估是眼動儀研究中相當重要的一部分,一般將這個問題稱為頭動補償。
    在眼動儀的相關研究中,主要可以分為以二維映射函數預估凝視點、以光點相對位置預估凝視點及以三維眼球模型預估視軸三個大類,而根據不同的眼動儀架構有不同的頭動補償方法,也具有不同的優點和缺點。
    本論文針對頭動補償的問題提出一個頭動補償機制,並將此機制實作,建立一套具有頭動補償模式的眼動儀系統,主要硬體為一個具有兩台攝影機的頭戴式眼動儀,除了具有頭動補償的模式外,也具備基本的無頭動補償模式和實景模式。
    在頭動補償的機制部分,主要的方法是以實景攝影機偵測四張貼在螢幕上的圓形圖卡,計算螢幕的深度和三維位置;在校正時計算二維映射函數和校正平面,使用時利用映射函數和校正平面建立視軸,利用視軸和螢幕平面的資訊計算凝視點,結合三維座標和二維映射函數的概念進行頭動補償,減少因為頭部位移造成的誤差,從實驗結果來看,和文獻[35]相比,本論文系統中的頭動補償模式在使用者頭部移動下可以更減少0.5至1度的誤差。

    關鍵字:眼動儀,頭動補償

    Eye tracker is a device for measuring eye movements and estimating POG (Point of gaze). It is currently used in psychology field and also can be the assistive devices for disabled people. After calibration, if user’s head moves when using eye tracker, the error of POG will enlarge. An easy way to solving this problem is using some device to hold user’s head, but for pursue the freedom and comfort, how to estimate correct POG when head moving is one of important topics in eye tracker field. The topic is called head movement compensation.
    There are three major methods of estimating POG in the related research. First, estimating POG by using 2D mapping function, second, estimating POG according to the relative position between light points reflect on eye ball and pupil center, third, building the 3D eye ball module to estimate visual axis and optical axis. There are many different ways of head movement compensation for each method of estimating POG, and they also have different advantages and disadvantages.
    In this work, this paper presents an approach of head movement compensation and implement it. Build an eye tracker system has the ability of head movement compensation. In this system, the hardware this system using is a head mounted eye tracker has two cameras. Beside mode of head movement compensation, this system also has the basic modes like mode of no head movement and mode of real scene.
    In the section of the approach of head movement compensation, this system uses scene camera to detect circular patterns pasted on monitor and estimate monitor’s depth and 3D position. When calibrating, get the information of mapping function and calibration plane, when using eye tracker, estimate visual axis by them and calculate POG, reduces the error caused by head movement. Compare with [35], The experiment result shows this approach can reduce 0.5~1゜degree error when user has large head movement.

    Keywords:eye tracker, head movement compensation.

    中文摘要 i 英文摘要 iii 誌 謝 v 目 錄 vi 圖目錄 x 表目錄 xiv 第一章 緒論 1 1.1 眼動儀簡介 1 1.2 眼動儀的演進 3 1.3 眼動儀的操作流程 6 1.4 研究動機和目的 7 第二章 文獻探討 10 2.1 以二維映射函數進行凝視點預估 10 2.1.1 以光點位置進行頭動補償 11 2.1.2 使用projective mapping進行頭動補償 15 2.2 以光點位置交比(cross-ratio)關係進行凝視點預估 16 2.3 以三維眼球模型進行凝視點預估 20 2.3.1 以光點位置預估光軸和視軸(1) 21 2.3.2 以光點位置預估光軸和視軸(2) 23 2.4 眼動儀相關研究方法的比較 28 第三章 研究內容與方法 29 3.1 使用硬體及軟體架構 29 3.1.1 使用硬體 29 3.1.2 軟體架構 31 3.2 瞳孔偵測 31 3.2.1 影像二值化 32 3.2.2 輪廓追蹤 33 3.2.3 橢圓擬合 35 3.2.4 排除誤判區域 36 3.3 圖卡偵測及定位 38 3.3.1 轉換色彩空間進行二值化 38 3.3.2 區塊標籤 40 3.3.3 動差不變量(moment invariants)計算和加強辨識 44 3.3.4 圖卡定位和推估螢幕位置 49 3.4 校正模組 50 3.4.1 映射函數校正 50 3.4.2 校正平面 51 3.5 頭動補償 52 3.5.1 視軸預估 52 3.5.2 預估螢幕平面及求取凝視點 54 3.5.3 顯示凝視點 56 3.6 以代數方式舉例說明頭動補償演算法 63 3.6.1 事前準備工作 64 3.6.2 校正 64 3.6.3 凝視點預估 65 3.7 眼動儀操作流程及操作介面說明 69 第四章 實驗結果 75 4.1 凝視點精準度實驗 75 4.1.1前後左右頭動實驗 76 4.1.2 大幅向後頭動實驗 82 4.1.3 大幅向前頭動實驗 83 4.2 實驗結果分析 85 4.3 本研究和文獻[35]的各項比較 87 第五章 結論和未來展望 88 參考文獻和資料 90 自 傳 94

    [1] http://www.open.ac.uk/about/campus/jennie-lee-research-labs-our-services/eye-tracker-services
    [2] Junghoon Park, Taeyoung Jung, Kangbin Yim, "Implementation of an EyeGaze Tracking System for the Disabled People.", 2015 IEEE 29th International Conference on Advanced Information Networking and Applications, March 2015.
    [3] Satoshi Handa, Yoshinobu Ebisawa, "Development of head-mounted display with eye-gaze detection function for the severely disabled.", 2008 IEEE Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems, July 2008.
    [4] http://www.vision-systems.com/articles/print/volume-18/issue-5/departments/snapshots/disabled-users-navigate-daily-routines-with-eye-tracker.html
    [5] Huey Edmund, The Psychology and Pedagogy of Reading(Reprint). MIT Press 1968(originally published 1908)
    [6] Guy Thomas Buswell, How people look at pictures. A study of the psychology of perception in art. The University of Chicago Press, 1935
    [7] H. HARTRIDGE and L. C. THOMSON, "METHODS OF INVESTIGATING EYE MOVEMENTS.", Br J Ophthalmol. 1948 Sep; 32(9): 581–591.
    [8] Crane,H.D., Steele, C.M. (1985). "Generation-V dual-Purkinje-image eyetracker.", Applied Optics 24 (4): 527–537.
    [9] http://ppw.kuleuven.be/home/english/research/lep/resources/purkinje
    [10] http://www.biopac.com/curriculum/l10-electrooculogram-i/
    [11] http://www.tobiipro.com/
    [12] http://news.gpwb.gov.tw/mobile/news.aspx?ydn=026dTHGgTRNpmRFEgxcbfXeut3OMJo83bj7NmgTAG00AlkzL4T0uTu6lbNP6gA5vEt9TjkS3bTQAzJZMETETFsVmzZshVk6QlgLvun%2BFJNo%3D
    [13] Zhiwei Zhu and Qiang Ji, "Eye Gaze Tracking Under Natural Head Movements",2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), June 2005
    [14] Chi-Wu Huang, Shih-Chen Tseng, Zong-Sian Jiang, Chun-Wei Hu, "Projective mapping compensation for the head movement during eye tracking", Consumer Electronics - Taiwan (ICCE-TW), 2014 IEEE International Conference on, 2014 MAY
    [15] Kai Han, Xuan Wang, Zili Zhang, Hainan Zhao, "A Novel Remote Eye Gaze Tracking Approach with Dynamic Calibration", Multimedia Signal Processing (MMSP), 2013 IEEE 15th International Workshop on, 2013
    [16] D. H. Yoo and M. J. Chung, "A novel non-intrusive eye gaze estimation using cross-ratio under large head motion," Computer Vision and Image Understanding, vol. 98, pp. 25-51, Apr. 2005.
    [17] F. L. Coutinho and C. H. Morimoto, "Augmenting the robustness of cross-ratio gaze tracking methods to head movement", in Proc. 2012 Symposium on Eye-Tracking Research and Applications (ETRA'12), Santa Barbara, CA, USA, Mar. 2012, pp. 59-66.
    [18] Zhiwei Zhu and Qiang Ji, "Novel Eye Gaze Tracking Techniques Under Natural Head Movement", IEEE Transactions on Biomedical Engineering (Volume:54,Issue: 12), 2007.
    [19] E. D. Guestrin, M. Eizenman, "General Theory of Remote Gaze Estimation Using the Pupil Center and Corneal Reflections", IEEE Transactions on Biomedical Engineering, 2006
    [20] https://www.qt.io/developers/
    [21] http://opencv.org/
    [22] Nobuyuki Otsu. "A threshold selection method from gray-level histograms.", IEEE Trans. Sys., Man., Cyber. 1979
    [23] Suzuki, S. and Abe, K., "Topological Structural Analysis of Digitized Binary Images by Border Following.", CVGIP 30 1, pp 32-46, 1985.
    [24] http://user.engineering.uiowa.edu/~dip/LECTURE/Segmentation2.html
    [25] http://docs.opencv.org/trunk/de/dc7/fitellipse_8cpp-example.html#gsc.tab=0
    [26] Andrew W. Fitzgibbon, Maurizio Pilu, Robert B. Fisher. "Direct Least Squares Fitting of Ellipses.", Pattern Recognition, Proceedings of the 13th International Conference . 1996
    [27] https://en.wikipedia.org/wiki/HSL_and_HSV
    [28] https://en.wikipedia.org/wiki/YCbCr
    [29] Kenji Suzuki, Isao Horiba, Noboru Sugie, "Linear-time connected-component labeling based on sequential local operations.", Computer Vision and Image Understanding, Volume 89, Issue 1, January 2003
    [30] M. K. Hu, "Visual Pattern Recognition by Moment Invariants", IRE Trans. Info. Theory, vol. IT-8, pp.179–187, 1962
    [31] J. Flusser, "On the Independence of Rotation Moment Invariants", Pattern Recognition, vol. 33, pp. 1405–1410, 2000
    [32] J. Flusser and T. Suk, "Rotation Moment Invariants for Recognition of Symmetric Objects", IEEE Trans. Image Proc., vol. 15, pp. 3784–3790, 2006
    [33] http://wenku.baidu.com/view/820e414d852458fb770b56db
    [34] Paul S. Heckbert, "Projective mappings for image warping.", Image-Based Modeling and Rendering(1999).
    [35] 曾士誠,低成本頭戴式眼動儀頭動補償探討,國立臺灣師範大學電機工程研究所,碩士論文,2014.12
    [36] 江宗憲,低成本高速眼動儀之建構。國立台灣師範大學應用電子研究所,碩士論文,2013
    [37] http://dsynflo.blogspot.tw/2014/08/openar-opencv-augmented-reality-program.html
    [38] Chi-Wu Huang, Wei-Chieh Tan, "An Approach of Head Movement Compensation when using a head mounted eye tracker", Consumer Electronics - Taiwan (ICCE-TW), IEEE, May 2016

    下載圖示
    QR CODE