融合多張不同曝光的畫面可呈現具高動態範圍的情境，本論文提出一個影像融合方法，藉由融合兩張連續但不同曝光的視訊畫面，提升畫面的動態範圍，使得在融合畫面中比在典型曝光畫面中更容易找尋移動物件與偵測人臉，提出的方法已實現在具強健硬體平台與軟體平台的消費型數位相機中，由實驗結果顯示影像融合的速度接近每秒四個畫面。
融合多張不同曝光倍率的影像對於在高動態範圍的情境下拍攝靜態影像是十分有用的，然而在實際相機應用面上，由於拍攝者造成相機輕微晃動或是情境中被拍攝者輕微移動皆會使得情境改變，此種情境改變必須進行補償。本論文提出一個完整的影像融合系統，藉由融合三張不同曝光的影像，以達到延展影像動態範圍的目標。不像大部分影像融合演算法均針對被處理過的影像進行融合，且嘗試去還原拍攝系統的轉換函數，我們提出的演算法直接針對還未經過任何影像處理的原始影像資料進行融合。此影像融合系統中亦包含整體性與局部性抖動補償演算法，能有效補償晃動的問題並且得到穩定的融合結果。

Fusing multiple frames with different exposure time can accommodate the scenes with high dynamic range. In this thesis, we propose an approach that is to fuse two consecutive video frames with different exposure time. Finding moving objects and human faces in such a higher dynamic range fused image is much easier than the typical exposed frame. The proposed approach has been implemented on a commercial digital camera with robust hardware and software platform and the experimental result shows that the fusion speed is around 4 frames/seconds.
Fusing several differently exposed images is particular useful for taking pictures in high dynamic range scenes. However, the scene changes resulted from moving objects and vibrations caused by photographers must be compensated adaptively in practical camera applications. In this thesis, we propose a complete image fusion system aiming at extending dynamic range of a picture by fusing three differently exposed images. Unlike most of fusion algorithms operate on processed images and try to recovery the transfer functions of imaging systems, the proposed image fusion algorithm directly works on raw image data before performing any color image processing. The proposed global and local stabilization algorithms efficiently remedy the vibration problems and achieve a quite stable image fusion result.

[1] H. C. Lee, Introduction to Color Imaging Science, Cambridge University Press, 2005.
[2] R. C. Gonzalez and R. E. Woods, Digital Image Processing, 2/E, New Jersey, 2002.
[3] M.Aggarwal, N.Ahuja, “Split aperture imaging for high dynamic range,” in Proc. IEEE International Conference on Computer Vision, 2001, vol. 2, pp. 10-17.
[4] S. Battiato, A. Castorina, and M. Mancuso, “High dynamic range imaging for digital still camera: an overview,“ Journal of Electronic Imaging, vol. 12(3), pp. 459-469, July 2003.
[5] P. Debevec and J. Malik, "Recovering high dynamic range radiance maps from photographs," in Proc. 24th Annual Conference on Computer Graphics and Interactive Techniques, 1997, pp. 369-378.
[6] L. Bogoni, M. Hansen, and P. Burt, “Image enhancement using pattern-selective color image fusion,” in Proc. Int. Conf. on Image Analysis and Processing, Sept. 1999, pp. 44-49.
[7] B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, “Multi-frame information fusion for gray-scale and spatial enhancement of images,” in Proc. IEEE International Conference on Image Processing (ICIP), Sept. 2003, vol. 2, pp. 14-17.
[8] G. Piella, “A general framework for multiresolution image fusion: from pixels to regions,” Information Fusion, vol. 4, no. 4, pp. 259-280, 2003.
[9] V. S. Petrovic and C. S. Xydeas, “Gradient based multiresolution image fusion,” IEEE Trans. Image Processing, vol. 13, no. 2, Feb. 2004.
[10] G. Liu, Z. Jing, and S. Sun, “Image fusion based on an expectation maximization algorithm,” Proc. SPIE., vol. 44, pp. 1-11, July 2005.
[11] R. Raskar, A. Ilie, and J. Yu, “Image fusion for context enhancement and video surrealism,” in Proc. International Symposium on Non-photorealistic Animation and Rendering, June 2004, pp. 85-152.
[12] A. Castorina, A. Capra, S. Curti, E. Ardizzone, and V. L. Verde, “Improved multi-resolution image fusion,” in Proc. IEEE International Conference on Consumer Electronics (ICCE), Jan. 2005, pp. 131-132.
[13] M. D. Jasiunas, D. A. Kearney, J. Hopf, and G. B. Wigley, “Image fusion for uninhabited airborne vehicles,” in Proc. IEEE International Conference on Field-Programmable Technology (ICFPT), Dec. 2002, pp. 348-351.
[14] M. A. Robertson, S. Borman, and R. L. Stevenson, “Dynamic range improvement through multiple exposure,” in Proc. IEEE International Conference on Image Processing, Oct. 1999, vol. 3, pp. 159-163.
[15] K. Yamada, T. Nakano, and S. Yamamoto, “Wide dynamic range vision sensor for vehicles,” in Proc. IEEE International Conference on Vehicle Navigation and Information Systems, Aug. 1994, pp. 405-408.
[16] C. Heng, L. Jie, and Z. Wei-le, “Image fusion scheme based on local gradient,” in Proc. IEEE International Conference on Circuits and Systems, May 2005, vol. 1, pp. 528-532.
[17] S. Mann and R. W. Picard, “On being ‘undigital’ with digital cameras: extending dynamic range by combining differently exposed pictures,” in IS&T’s 48th Annual Conference, May 1995, pp. 422-428.
[18] Z. G. Jiang, D. B. Han, J. Chen, and X. K. Zhou, “A wavelet based algorithm for multi-focus micro-image fusion,” in Proc. IEEE International Conference on Image and Graphics, 2004
[19] M. Li, Y. Wu, and S. Wu, “A new pixel-level multi-focus image fusion algorithm based on evolutionary strategy,” in Proc. IEEE International Conference on Control, Automation, Robotics and Vision Kunming, China, Dec. 2004, pp. 810-814.
[20] A. Pardo and G. Sapiro, “Visualization of high dynamic range images,” IEEE Trans. Image Processing, pp. 639-647, vol. 12, no. 6, June 2003.
[21] Wen-Chung Kao, Chih-Chung Kao, Shou-Hung Chen, Yen-Wei Hung. “The embedded software architecture for real-time video and audio recording,” in Proc. CVGIP 05, Taiwan, ROC, 2005, pp. 1462-1467.
[22] Wen-Chung Kao, Sheng-Hong Wang, Ying-Ju Chen, Chien-Chih Hsu, and Chi-Wu Huang, “Toward ideal color image processing pipeline,” in Proc. CVGIP 05, Taiwan, ROC, 2005, pp. 1621-1628.
[23] Wen-Chung Kao, Lien-Yang Chen, and Sheng-Hong Wang, “Tone reproduction in color imaging systems by histogram equalization of macro edges,” IEEE Trans. Consumer Electronics, pp. 682-688, vol. 52, no. 2, May 2006.
[24] Wen-Chung Kao and Ying-Ju Chen, “Multistage bilateral noise filtering and edge detection for color image enhancement,” IEEE Trans. Consumer Electronics, pp. 1346-1350, vol. 51, no. 4, Nov. 2005.
[25] Wen-Chung Kao, Chih-Chung Kao, Ching-Kai Lin, Tai-Hua Sun, and Sheng-Yuan Lin, “Reusable embedded software platform for versatile camera systems,” IEEE Trans. Consumer Electronics, pp. 1379-1385, vol. 51, no. 4, Nov. 2005.
[26] Wen-Chung Kao, Chin-Ming Hong, and Sheng-Yuan Lin, “Automatic sensor and mechanical shutter calibration for digital still cameras,” IEEE Trans. Consumer Electronics, pp. 1060-1066, vol. 51, no. 4, Nov. 2005.