簡易檢索 / 詳目顯示

研究生: 楊松儒
Yang, Sung-Ju
論文名稱: 以深度學習為基礎之路面破損與閥栓檢測系統
Road-crack and Manhole-cover Inspection System Based on Deep Learning
指導教授: 吳順德
Wu, Shuen-De
學位類別: 碩士
Master
系所名稱: 機電工程學系
Department of Mechatronic Engineering
論文出版年: 2019
畢業學年度: 107
語文別: 中文
論文頁數: 53
中文關鍵詞: 目標檢測深度學習YOLO神經網路
英文關鍵詞: object detection, deep learning, YOLO neural network
DOI URL: http://doi.org/10.6345/NTNU201901097
論文種類: 學術論文
相關次數: 點閱:146下載:10
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近年來台灣道路平整度議題經常被提出來討論,其中一項就是孔蓋的正常與否。每年都需要花費大量的人力在孔蓋巡檢上。為保證巡檢品質與第二年作業需求,需要檢查作業人員拍攝回來之照片,其中包含著門牌以及閥栓近遠照等照片。路面平整度的另一個議題是路面破損,而目前路面破損之檢測如同閥栓巡檢一般依靠了大量的人力。為了減少大量人力需求,本研究將設計一快速且準確之閥栓分辨系統以及一道路破損辨識系統。

    本研究中以YOLOv3-tiny及作為基礎,建置一快速分辨閥栓以及門牌之系統。在實驗結果中,本研究在近照之閥栓分辨結果中,達到了Precision 99.33%、Recall 98.89%之高精度。在門牌與街牌辨識的部分,也達到了Precision 95.96%、Recall 93.45%之精度。

    道路破損辨識的部分,本研究使用YOLOv3類神經網路進行訓練,並使用一簡單之分割操作,提升了辨識準確率。並希望在未來使用其餘類神經網路以及各種技術,改善此一辨識率。

    Road flatness plays a key role in traffic safety, the manhole covers placed on roads often reduce the flatness and cause traffic accident. In order to guarantee the traffic safety, it is necessary for government to do manhole-cover inspection every year. A lot of pictures, including doorplates, street signs, and manhole cover of valves and hydrants, will be reproduced in manhole-cover inspection, and it takes a large amount of time to check these pictures manually. Another important issue of traffic safety is road crack, and the inspection of this problem is also labor-intensive work. The objective of this study is to design an automatic inspection system of manhole-cover and road crack to reduce the workload.

    The manhole-cover inspection system proposed in this study is based on YOLOv3-tiny network. Experimental results show that the system has high efficiency with precision of 99.33%, and recall of 98.89%. In terms of road-crack detection, this study applies YOLOv3 network to road-crack detection system, and uses simple image segmentation to detect the pictures, which increases system recall. In the future, we hope to improve the performance of detection by using other networks and operations.

    摘要 i Abstract ii 誌謝 iii 目錄 v 表目錄 viii 圖目錄 ix 第一章 緒論 1 1.1 前言 1 1.2 研究動機與目的 2 1.3 系統架構 3 1.4 論文架構 4 第二章 文獻回顧與資料收集 5 2.1 目標檢測文獻探討 5 2.1.1 二階段偵測(Two-Stage Detection) 6 2.1.2 一階段偵測(One-Stage Detection) 7 2.2 路面檢測文獻探討 8 2.2.1 影像處理法(Image Processing Techniques) 8 2.2.2 類神經網路法(Neural Network) 9 2.3 圖像資料 11 2.3.1 制水閥手孔蓋 11 2.3.2 地下式消防栓箱 11 2.3.3 地上式消防栓外觀 11 2.3.4 門牌 11 2.3.5 街牌 11 2.3.6 路面破損 12 2.4 影像標籤 13 第三章 類神經網路架構 14 3.1 卷積神經網路 14 3.1.1卷積層 14 3.1.2池化層 16 3.1.3 Flatten 17 3.1.4 全連接層 17 3.2 Grid Cell與輸出 17 3.3 Anchor Box 19 3.4 Loss Function 19 3.5 Feature Pyramid Network 21 3.6 Residual Network 22 3.7 YOLOv3-tiny與YOLOv3網路架構 23 第四章 實驗流程與結果討論 26 4.1閥栓巡檢 26 4.1.1 實驗流程 26 4.1.2 實驗結果與討論 27 4.2 道路破損檢測 41 4.2.1 實驗流程 41 4.2.2 實驗結果與討論 43 第五章 結論與未來展望 49 5.1 結論 49 5.2 未來展望 50 參考文獻 51

    萬國法律事務所,交通部公路總局-「道路工程引發國家賠償案件之研究分析」研究報告,https://www.aac.moj.gov.tw/ct.asp?xItem=442841&ctNode=44532&mp=289
    C. Mertz, “Continuous road damage detection using regular service vehicles,” Proceedings of the ITS world congress, pp. 5-8, 2011.
    A. Mednis, G. Strazdins, R. Zviedris, G. Kanonirs, and L. Selavo, “Real time pothole detection using android smartphones with accelerometers,” 2011 International conference on distributed computing in sensor systems and workshops (DCOSS), IEEE, pp. 1-6, Jun. 2011.
    I. Abdel-Qader, O. Abudayyeh, and M. E. Kelly, “Analysis of edge-detection techniques for crack identification in bridges,” Journal of Computing in Civil Engineering, vol. 17, no. 4, pp. 255-263, Oct. 2003.
    Y. Shi, L. Cui, Z. Qi, F. Meng, and Z. Chen, ‘‘Automatic road crack detection using random structured forests,’’ IEEE Transactions on Intelligent Transportation Systems, vol. 17, no. 12, pp. 3434–3445, Dec. 2016.
    H. Oliveira and P. L. Correia, ‘‘Automatic road crack detection and characterization,’’ IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 1, pp. 155–168, Mar. 2013.
    L. Zhang, F. Yang, Y. D. Zhang, and Y. J. Zhu, ‘‘Road crack detection using deep convolutional neural network,’’ 2016 IEEE international conference on image processing (ICIP), IEEE, pp. 3708-3712, Sep. 2016.
    Y.-J. Cha, W. Choi, and O. Buy¨ uk¨ ozt ¨ urk, “Deep learning-based crack ¨ damage detection using convolutional neural networks,” Computer‐Aided Civil and Infrastructure Engineering, vol. 32, no. 5, pp. 361–378, Mar. 2017.
    新北市路平報馬仔,https://rdm.ntpc.gov.tw/Road/NewCase.aspx
    labelImg https://github.com/tzutalin/labelImg
    J. Redmon, "Darknet: Open Source Neural Networks in C," http://pjreddie.com/darknet/, 2013~2016.
    R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich feature hierarchies for accurate object detection and semantic segmentation,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580-587, Jun. 2014.
    K. He, X. Zhang, S. Ren, and J. Sun, “Spatial pyramid pooling in deep convolutional networks for visual recognition,” IEEE transactions on pattern analysis and machine intelligence, vol. 37, no. 9, pp. 1904–1916, Sep. 2015.
    R. Girshick, “Fast r-cnn,” Proceedings of the IEEE international conference on computer vision, pp. 1440-1448, 2015.
    S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, pp. 91-99, 2015.
    J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788, 2016.
    J. Redmon and A. Farhadi, “YOLO9000: better, faster, stronger,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263-7271, 2017.
    J. Redmon and A. Farhadi, “Yolov3: An incremental improvement,” 2018, arXiv:1804.02767.
    W. Liu, D. Anguelov, D. Erhan, C. Szegedy, and S. Reed, “SSD: Single shot multibox detector,” arXiv:1512.02325, 2015.
    H. Oliveira and P. L. Correia, ‘‘Automatic road crack segmentation using entropy and image dynamic thresholding,’’ 2009 17th European Signal Processing Conference, IEEE, pp. 622-626, Aug. 2009.
    H. Ma, N. Lu, L. Ge, Q. Li, X. You, and X. Li, “Automatic road damage detection using high-resolution satellite images and road maps,” Geoscience and Remote Sensing Symposium (IGARSS), 2013 IEEE International, pp. 3718–3721, 2013.
    F.-C. Chen and M. R. Jahanshahi, "NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion," IEEE Transactions on Industrial Electronics, vol. 65, no. 5, pp. 4392-4400, 2018.
    H. Maeda, Y. Sekimoto, T. Seto, T. Kashiyama, and H. Omata, “Road damage detection and classification using deep neural networks with smartphone images,” Computer‐Aided Civil and Infrastructure Engineering , vol. 33, no. 12, pp. 1127-1141, 2018.
    T.-Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie, “Feature pyramid networks for object detection,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2117-2125, 2017.
    K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778, 2016.
    H. Law and J. Deng, “Cornernet: Detecting objects as paired keypoints,” Proceedings of the European Conference on Computer Vision (ECCV), pp. 734-750, 2018.
    Y. Chen, H. Fang, B. Xu, Z. Yan, Y. Kalantidis et al., “Drop an octave: Reducing spatial redundancy in convolutional neural networks with octave convolution,” arXiv:1904.05049, 2019.

    下載圖示
    QR CODE