簡易檢索 / 詳目顯示

研究生: 黃湘婷
Xiang-Ting Huang
論文名稱: 影像錄製系統之即時色調重現
Real-Time Tone Reproduction for Video Recording
指導教授: 高文忠
Kao, Wen-Chung
學位類別: 碩士
Master
系所名稱: 電機工程學系
Department of Electrical Engineering
論文出版年: 2012
畢業學年度: 100
語文別: 中文
論文頁數: 131
中文關鍵詞: 高動態範圍色調重現嵌入式系統
英文關鍵詞: high dynamic range, tone reproduction, embedded system
論文種類: 學術論文
相關次數: 點閱:147下載:18
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 這篇論文提出一個適用於拍攝高動範圍情境之即時色調重現演算法,並提出嵌入式系統實作技術,達到即時影像處理的目標。本演算法中,首先使用影像濾波器將輸入影像分成高頻與低頻兩個圖層,針對低頻圖層進行多次色調重現處理,以壓縮低頻圖層資訊的動態範圍,再加上高頻圖層的資訊,以達到保留高頻影像細節的目標,並有效提升暗處區域的可見度與影像細節之對比度。此外,為了減少影像處理時間以及保持畫面亮度的穩定性,視訊中的前後連續畫面分享同樣的色調曲線,使畫面不閃爍。本論文並提出多項實作本演算法於嵌入式系統的實務技術,利用系統晶片平台所內建之影像計算加速器,達成處理VGA (640 x 480 pixels) 畫面的條件下,可達每秒30個畫面(frames/s)以上的高效能表現。

    This thesis presents a practical tone reproduction approach to taking videos in high dynamic range scenes and several schemes of embedded software implementation have proposed meet the real-time requirement. The algorithm first adopts a signal filter to separate high and low frequency image planes. Multiple cycles of tone mapping are then performed for the low frequency image plane to reduce its dynamic range. The algorithm boosts the visibility of image details in darker regions by attenuating the dynamic range of the low frequency plane. The image details are maintained since the high frequency plane runs only one cycle of tone mapping. The successive frames share the same set of tone curves for the reduction of the execution time as well as the consistency of brightness among frames. The proposed high dynamic range video processing system has been implemented on an embedded system. Several practical techniques that fully utilize the available hardware accelerators in a system-on-a-chip (SoC) are also proposed. The proposed system reaches the performance of processing 30 frames/s with VGA (640 x 480) resolution when the algorithm is running on the SoC platform.

    中文摘要........................………………………………………ii 英文摘要…………………………………………………………..……………iii 誌  謝…………………………………………………………….....………iv 目  錄……………………………………………………………………..……v 圖 目 錄…………………………………………….……………………………vii 表 目 錄……………………………………………………….…………………ix 第一章  緒論…………………………………………….………………………1 1.1 研究背景與動機……………..…………….…………………………1 1.2 高動態範圍相關研究.......………….……………………..……2 1.3 提出的方法.........................................4 1.4 論文架構..................…..………………………………5 第二章  相關背景與研究....……………………………………………..…6 2.1 影像動態範圍....……………………………………………………6 2.2 色彩空間....…………………………………………………………7 2.3 相關研究..........…………………………………………………9 2.3.1 直方圖等化.………………………………….......9 2.3.2 攝影色調重現......………………….………….11 2.3.3 感光色調重現......………………….………….14 2.3.4 頻率領域的色調重現..………………….………..16 2.3.5 多重曝光影像合成………………………….………17 第三章  色調重現演算法設計.…………………………………………..…20 3.1 問題描述....................……………………………..20 3.2 演算法流程..................………………………….…..21 3.3 影像頻率分割................………………………….…..23 3.4 色調映射流程................………………………….…..25 3.4.1 參數計算…………………………………………....25 3.4.2 中間灰階映射…………………………………………26 3.4.3 白點映射………………………………………………28 3.4.4 正規化…………………………………………………28 3.5 影像頻率合併………….......……………………………….…29 3.6 多重色調映射…….........…………………………………..31 第四章  嵌入式系統架構…………………………………………………….32 4.1 系統晶片平台規格…........…………………………………..32 4.1.1 硬體規格.............................33 4.1.2 軟體規格..............................33 4.2 嵌入式軟體設計..........……………………………………..35 4.2.1 記憶體配置............................35 4.2.2 嵌入式軟體架..........................36 第五章  實驗結果……………………............................43 5.1 影像品質…………….....………………………………………..43 5.2 與直方圖等化比較..………………………………………………49 5.3 與攝影色調重現比較..……..………………...……………….54 5.4 與區域對比增強及攝影色調重現比較...…………….………….59 5.5 色調映射處理次數的討論……………………...……………….66 5.6 非BMP檔案的HDR影像處理結果………………...……………….67 5.7 執行效能………………………………………………………………71 第六章  結論……………………………………………...…………......75 參考文獻………………………………………………………………………….76 附 錄 A 多張BMP影像處理結果…………………………….………………79 附 錄 B 多張HDR影像處理結果….....…….…………………………….94 附 錄 C 實作程式碼解說…………..........………….……………….108 附 錄 D 嵌入式系統環境建置……………………………………………….129

    [1] E. Reinhard, G. Ward, S. Pattanaik, and P. Debevec, High dynamic range imaging: acquisition, display and image-based lighting. San Francisco: Elsevier/Morgan Kaufmann, 2006.
    [2] C. Schlick. “Quantization techniques for the visualization of high dynamic range pictures,” in P. Shirley, G. Sakas, and S. Müller (eds.), Photorealistic Rendering Techniques, pp. 7-20. New York: Springer-Verlag, 1994.
    [3] J. E. Dowling. The Retina: An Approachable Part of the Brain. Cambridge, MA:Belknap Press, 1987.
    [4] Chih-Ming Chen; Chin-Ming Hong; Han-Chun Chuang, “Efficient auto-focus algorithm utilizing discrete difference equation prediction model for digital still cameras,” IEEE Trans. on Consumer Electronics, vol. 52, no.4, pp. 1135-1143, Nov. 2006.
    [5] Wen-Chung Kao, Shou-Hung Chen, Tai-Hua Sun, Tai-Yi Chiang, Sheng-Yuan Lin, “An integrated software architecture for real-time video and audio recording systems,” IEEE Trans. on Consumer Electronics, vol. 51, no. 3, pp. 879-884, Aug. 2005.
    [6] Toh K.K.V., Isa N.A.M., “Cluster-based adaptive fuzzy switching median filter for universal impulse noise reduction,” IEEE Trans. on Consumer Electronics, vol. 56, no. 4, pp. 2560-2568, Nov. 2010.
    [7] Siddiqui H., Bouman C.A., “Hierarchical color correction for camera cell phone images,” IEEE Trans. on Image Processing, vol. 17, no. 11, pp. 2138-2155, Nov. 2008.
    [8] G. W. Larson, H. Rushmeier, and C. Piatko, “A visibility matching tone reproduction operator for high dynamic range scenes,” IEEE Trans. on Visualization and Computer Graphics, vol. 3, no. 4, pp. 291-306, Oct.-Dec. 1997.
    [9] B. R. Lim, R. H. Park, and S. Kim, “High dynamic range for contrast enhancement,” IEEE Trans. on Consumer Electronics, vol. 52, no. 4, pp. 1454-1462 Nov. 2006,.
    [10] L. Meylan and S. Süsstrunk, “High dynamic range image rendering with a retinex-base adaptive filter,” IEEE Trans. on Image Processing, vol. 15, no. 9, pp. 2820-2830, Sep. 2006.
    [11] D. Menotti, L. Najman, J. Facon, and A. de A. Araujo, “Multi-histogram equalization methods for contrast enhancement and brightness preserving,” IEEE Trans. on Consumer Electronics, vol. 53, no. 3, pp. 1186-1194, Aug. 2007.
    [12] Q. Wang, and R. K. Ward, “Fast image/video contrast enhancement based on weighted thresholded histogram equalization,” IEEE Trans. on Consumer Electronics, vol. 53, no. 2, pp. 757-764, May 2007.
    [13] Kim, M.; Min Chung, “Recursively separated and weighted histogram equalization for brightness preservation and contrast enhancement,” IEEE Trans. on Consumer Electronics, vol.54, no.3, pp. 1389-1397, Aug. 2008.
    [14] Sengee N., Sengee A., Heung-Kook Choi, “Image contrast enhancement using bi-histogram equalization with neighborhood metrics,” IEEE Trans. on Consumer Electronics, vol. 56 ,no. 4 ,pp. 2727-2734, Nov. 2010.
    [15] E. Reinhard, “Parameter estimation for photographic tone reproduction,” Journal of Graphics Tools, vol. 7, no. 1, pp. 45-52, Nov. 2002.
    [16] E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, “Photographic tone reproduction for digital images,” ACM Trans. on Graphics, vol. 21, no. 3, pp. 267-276, July 2002.
    [17] W. C. Kao, L. Y. Chen, and S. H. Wang, “Tone reproduction in color imaging systems by histogram equalization of macro edges,” IEEE Trans. on Consumer Electronics, vol. 52, no. 2, pp. 682-688, May 2006.
    [18] Joohyun Lee, Gwanggil Jeon, Jechang Jeong, “Piecewise tone reproduction for high dynamic range imaging,” IEEE Trans. on Consumer Electronics, vol. 55 ,no. 2 , pp. 911-918, May 2009.
    [19] Reinhard, E. Sch. of Comput. Sci., Univ. of Central Florida, Orlando, FL, USA, “Dynamic range reduction inspired by photoreceptor physiology,” IEEE Trans. on Visualization and Computer Graphics, vol .11, no. 1 ,pp. 13-24, Jan.-Feb. 2005.
    [20] G. Liu, Z. Jing, and S. Sun, “Image fusion based on an expectation maximization algorithm,” SPIE Optical Engineering, vol. 44, no. 7, pp. 1-11, July 2005.
    [21] W. C. Kao, C. C. Hsu, L. Y. Chen, C. C. Kao, and S. H. Chen, “Integrating image fusion and motion stabilization for capturing still images in high dynamic range scenes,” IEEE Trans. on Consumer Electronics, vol. 52, no. 3, pp. 735-741, Aug. 2006.
    [22] W. C. Kao, “High dynamic range imaging by fusing multiple raw images and tone reproduction,” IEEE Trans. on Consumer Electronics, vol. 54, no. 1, pp. 10-15, Feb. 2008
    [23] E. Reinhard, K. Devlin., “Dynamic range reduction inspired by photoreceptor physiology,” IEEE Trans. on Visualization and Computer Graphics, vol. 11, no. 1, pp. 13-24, Jan.-Feb. 2005.
    [24] A. V. Oppenheim, R. Schafer, and T. Stockham., “Nonlinear filtering of multiplied and convolved signals,” IEEE Transactions on Audio and Electroacoustics, vol. 16, no. 3, pp. 437-466, Sep. 1968.
    [25] F. Durand and J. Dorsey. “Fast bilateral filtering for the display of high-dynamic-range images,” ACM Transactions on Graphics, vol. 21, no. 3, pp. 257-266, July 2002.
    [26] Lin Pan, Ting Zhou, Bingkun Zheng, Lun Yu, “Application of edge confidence detection in the auto-focus under fundus camera,” Second WRI Global Congress on Intelligent Systems(GCIS), Wuhan, China, Dec. 2010, pp. 399-402.
    [27] Wonwoo Jang, Kyoungsoo Son, Joohyun Kim, Bongsoon Kang, “Auto white balance system using adaptive color samples for mobile devices,” IEEE Asia Pacific Conf. on Circuits and Systems, Macao, China, Dec. 2008, pp. 1462-1465.
    [28] Oka N., Misu K., Yoneda S., Saito S., Nitta S., “A common mode noise filter for high speed and wide band differential mode signal transmission,” International Symp. on EMC Europe, York, England, Sept. 2011, pp. 732-736.
    [29] Wen-Chung Kao, Sheng-Hong Wang, Chih-Chung Kao, Chi-Wu Huang, Sheng-Yuan Lin, “Color reproduction for digital imaging systems,” IEEE Int. Symp. on Circuits and Systems, Island of Kos, Greece, 21-24 May 2006, pp. 4599-4602.
    [30] L. Bogoni, M. Hansen, and P. Burt, “Image enhancement using pattern-selective color image fusion,” in Proc. IEEE Int. Conf. Image Analysis and Processing, Venice, Italy, Sep. 1999, pp. 44-49.
    [31] B. K. Gunturk, Y. Altunbasak, and R. M. Mersereau, “Multi-frame information fusion for gray-scale and spatial enhancement of images,” in Proc. IEEE Int. Conf. Image Processing, vol. 2, Catalonia, Spain, Sep. 2003, pp. II-319-II-322.
    [32] S. N. Pattanaik, J. Tumblin, H. Yee, and D. P. Greenberg., “Time-dependent visual adaptation for fast realistic display,” in Proceedings of the 27th annual conference on Computer graphics and interactive techniques (ACM SIGGRAPH),Louisiana USA, July 2000, pp. 47-54.
    [33] P. Choudhury and J. Tumblin. “The trilateral filter for high contrast images and meshes,” in Proceedings of the Eurographics Symposium on Rendering, Leuven, Belgium, Jun. 2003, pp. 186–196.
    [34] Renesas SH77650 Image Recognition Library API Specification
    [35] RGB色彩空間圖,http://en.wikipedia.org/wiki/File:RGB_color_solid_cube.png

    下載圖示
    QR CODE