針對影片上的人臉辨識問題，本論文提出一個機率圖模型來解決並將其公式化。首先，我們將此問題分成兩個部份來探討，分別為相似度之計算與遞移機率，其中相似度之計算可被視作為傳統的單張影像之人臉辨識的結果，在此篇論文中，我們採用二維線性鑑別分析法(2DLDA)摘取特徵，再藉由高斯分佈來估算相似度。而遞移機率則是計算先前時間點的狀態轉移到此時間點的狀態之機率，我們可將遞移機率分成兩個部份來估算，其一為人與人的遞移機率，另一個則為姿勢轉換的遞移機率，希望藉由相鄰影像的時間關係修正錯誤的辨識結果與提升準確率。在本論文的實驗中，我們使用在國際上常採用的 Honda/UCSD 資料庫以及本實驗室自行建立的VIPlab資料庫。實驗證明本研究提出之方法可適用於不同的資料庫，且實驗結果也有90%以上的正確率。

We present a probabilistic graphical model to formulate and deal with video-based face recognition. Our formulation divides the problem into two parts: one for likelihood measure and the other for transition measure. The likelihood measure can be regarded as a traditional task of face recognition within a single image, i.e., to estimate how similar to a specified person this observing face image is. In our work, two-dimensional linear discriminant analysis (2DLDA) is employed for feature extraction, and then we use a Gaussian distribution to assess the likelihood measure. The transition measure is estimated via two terms, person transition and pose transition. The transition terms could fix some incorrect recognition results because of considering the information between adjacent frames. In the face recognition experiments, we adopt two datasets, Honda/UCSD dataset and VIPlab dataset. Finally, it is demonstrated that our proposed approach is robust in different datasets and produces good recognition accuracy which is more than 90%.

[1] A.F. Abate, M. Nappi, D. Riccio, and G. Sabatino,"2D and 3D face recognition: A survey.", Pattern Recognition Letters, vol.28, no.14, pp.1885-1906, Jan. 2007.
[2] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman,
"Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection.", IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.19, no.7, pp.711-720, Jul. 1997.
[3] M.S. Bartlett, H.M. Lades, and T.J. Sejnowski, "Independent component representation for face
recognition.", In Proceedings of the SPIE Symposium on Electronic Imaging: Science and Technology; Conference on Human Vision and Electronic Imaging II, pp.528-539, Jan. 1998.
[4] M.E. Brand,"Incremental singular value decomposition of uncertain data with missing values.", In Proceedings of the Seventh European Conference on Computer Vision,
vol.2350, pp.707-720, May 2002.
[5] S. Chen, H. Zhao, M. Kong, and B. Luo,"2D-LPP:A two-dimensional extension of locality preserving projections.", Neurocomputing, vol.70, pp.912—921, Jan. 2006.
[6] B.A. Draper, K Baek, M.S. Bartlett, and J.R. Beveridge,"Recognizing Faces with PCA and ICA.", Computer Vision and Image Understanding, vol.91, pp.115-137, Feb. 2003.
[7] G. Edwards, C. J. Taylor, and T. F. Cootes,"Interpreting face images using active appearance models.", In Proceedings of the Three International Conference on Automatic Face and Gesture Recognition, pp.300-305, Apr. 1998.
[8] Z. Ghahramani,"An Introduction to Hidden Markov Models and Bayesian Networks.", International Journal of Pattern Recognition and Artificial Intelligence, vol.15, no.1, pp.9-42, 2001.
[9] A. J. Howell, and H. Buxton,"Towards unconstrained face recognition from image sequences.", In Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, pp.224-229, Oct. 1996.
[10] B. Heisele, P. Ho, and T. Poggio,"Face recognition with support vector machines: Global versus component-based approach.", In Proceedings of the Eighth International Conference on Computer Vision, vol.2, pp.688-694, 2001.
[11] X. He, and P. Niyogi,"Locality Preserving Projections.", In Proceedings of the Conference on Advances in Neural Information Processing System, 2003.
[12] Y. Hu, D. Jiang, S. Yan, L. Zhang, and H. Zhang,"Automatic 3D reconstruction for face recognition.", In Proceedings of the Sixth International Conference on Automatic Face and Gesture Recognition, pp.843-848, May. 2004.
[13] P. Hall, D. Marshall, and R. Martin,"Incremental Eigenanalysis for Classification.", In Proceedings on British Machine Vision Conference, vol.1, pp.286-295, Sep. 1998.
[14] P.M Hall, D.R. Marshall, and R.R. Martin,"Merging and splitting eigenspace models.", IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.22, no.9, pp.1042-1049, Sep. 2000.
[15] A. Hadid, and M. Pietikainen,"From Still Image to Video-Based Face Recognition:An Experimental Analysis.", In Proceedings of the Sixth International Conference on Automatic Face and Gesture Recognition,
pp.813-818, May 2004.
[16] F.B. ter Haar, and R.C. Veltkamp,"3D Face Model Fitting for Recognition.",In Proceedings of the Tenth European Conference on Computer Vision, vol.5305, pp.652-664, Oct. 2008.
[17] M. Kim, S. Kumar, V. Pavlovic, and H. Rowley,"Face Tracking and Recognition with Visual Constraints in Real-World Videos.", IEEE Conference on Computer Vision and Pattern Recognition, pp.1-8, Jun. 2008.
[18] C. Liu, and H. Wechsler,"A shape- and texture-based enhanced fisher classifier for face recognition.", IEEE Trans. on Image Processing, vol.10, no.4, pp.598-608, Apr. 2001.
[19] Y. Li, S. Gong, and H. Liddell,"Constructing facial identity surface in a nonlinear discriminating space.", IEEE Conference on Computer Vision and Pattern Recognition, vol.2, pp.258-263, Dec. 2001.
[20] X. Liu and T. Cheng,"Video-based face recognition using adaptive hidden Markov models.", IEEE Conference on Computer Vision and Pattern Recognition, vol.1, pp.340-345, Jun. 2003.
[21] K.C. Lee, J. Ho, M.H. Yang, and D. Kriegman,"Video-Based Face Recognition Using Probabilistic Appearance Manifolds.", IEEE Conference on Computer Vision and Pattern Recognition, vol.1, pp.313-320, Jun. 2003.
[22] K.C. Lee, J. Ho, M.H. Yang, and D. Kriegman,"Visual tracking and recognition using probabilistic appearance manifolds.", Computer Vision and Image Understanding, vol.99, pp.303-331, 2005.
[23] K.C. Lee, and D. Kriegman,"Online Learning of Probabilistic Appearance Manifolds for Video-based Recognition and Tracking.", IEEE Conference on Computer Vision and Pattern Recognition, vol.1, pp.852-859, Jun. 2005.
[24] A.M. Martínez, and A.C. Kak,"PCA versus LDA.", IEEE Trans.on Pattern Analysis and Machine Intelligence, vol.23, no.2, pp.228-233, Feb. 2001.
[25] K. Murphy, Dynamic Bayesian Networks: Representation, Inference and Learning, PhD thesis, University of California at Berkeley, Computer Science Division, 2002.
[26] P.J. Phillips,"Support vector machines applied to face recognition.", In Proceedings of the Conference on Advances in Neural Information Processing Systems, vol.11, pp.803-809, 1998.
[27] G. Shakhnarovich, J.W. Fisher, and T. Darrell,"Face recognition from long-term observations.", In Proceedings of the Seventh European Conference on Computer Vision, vol.3, pp.851-865, May 2002.
[28] A.S. Tolba, A.H. El-Baz, and A.A. El-Harby,"Face Recognition: A Literature Review.", International Journal of Signal Processing, vol.2, no.2, pp.88-103, 2006.
[29] M. Turk, and A. Pentland,"Eigenfaces for recognition.", Journal of Cognitive Neuroscience, vol.3, no.1, pp.72-86, 1991.
[30] J. Yang, and D. Zhang,"Two-dimensional PCA: a new approach to appearance-based face representation and recognition.", IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.26, no.1, pp.131-137, Jan. 2004.
[31] J. Yang, D. Zhang X. Yong, and J. Yang, "Two-dimensional Discriminant Transform for Face Recognition.", Pattern R
ecognition, vol.38, no.7, pp.1125-1129, Feb. 2005.
[32] J. Yang, J. Yang, A.F. Frangi, and D. Zhang, "Uncorrelated projection discriminant analysis and its application to face image feature extraction.", International Journal of Pattern Recognition and Artificial Intelligence, vol.17, no.8, pp.1325-1347, 2003.
[33] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld,"Face recognition: a literature survey.", ACM Computing Surveys, vol.35, no.4, pp.399-458, Dec. 2003.
[34] W.Y. Zhao, and R. Chellappa,"Symmetric shape-from shading using self-ratio image.", International Journal of Computer Vision, vol.45, no.1, pp.55-75, Oct. 2001.
[35] S. Zhou and R. Chellappa,"Probabilistic human recognition from video.", In Proceedings of the Seventh European Conference on Computer Vision, vol.3, pp.681-697, May 2002.
[36] The Honda/UCSD Video Database, http://vision.ucsd.edu/~leekc/HondaUCSDVideoDatabase/HondaUCSD.html.