研究生: |
呂政儒 Lu, Cheng-Ju |
---|---|
論文名稱: |
以改良式粒子群演算法進行分類問題之特徵選擇 An Improved Particle Swarm Optimization Algorithm for Feature Selection in Classification |
指導教授: |
蔣宗哲
Chiang, Tsung-Che |
口試委員: |
温育瑋
Wen, Yu-Wei 鄒慶士 Tsou, Ching-Shih 蔣宗哲 Chiang, Tsung-Che |
口試日期: | 2023/01/31 |
學位類別: |
碩士 Master |
系所名稱: |
資訊工程學系 Department of Computer Science and Information Engineering |
論文出版年: | 2023 |
畢業學年度: | 111 |
語文別: | 中文 |
論文頁數: | 41 |
中文關鍵詞: | 演化演算法 、粒子群演算法 、特徵選擇 |
研究方法: | 實驗設計法 |
DOI URL: | http://doi.org/10.6345/NTNU202300219 |
論文種類: | 學術論文 |
相關次數: | 點閱:119 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
特徵選擇是分類問題中降低問題維度的一種重要前處理技術,能消除冗餘和不相關的特徵,留下有用的特徵進行分類,提高分類準確率。隨著資料集維度增加,搜尋空間將急遽加大,這對各種最佳化演算法來說是一個挑戰。本研究希望能提出演算法,以小量計算資源找到一組少量且具有良好分類效果的特徵子集。研究基於當今主流的粒子群演算法,加入搜尋空間調整相關設計、參考相對優秀粒子的較差粒子調整策略,以及一個具方向性的新粒子群產生策略,該策略使用外部族群更新與紀錄演化過程中找到的多組特徵子集,並將其作為產生新粒子群的參考點。實驗結果與文獻演算法比較後,顯示所提出之演算法機制與設計具有良好的分類效能與較少的特徵數。
[1] J. Kennedy and R. Eberhart, “Particle swarm optimization,” Proceedings of ICNN’95 - International Conference on Neural Networks, vol. 4, pp. 1942–1948, 1995.
[2] A. D. Li, B. Xue, and M. Zhang, “A forward search inspired particle swarm optimization algorithm for feature selection in classification,” Proceedings of IEEE Congress on Evolutionary Computation, pp. 786–793, 2021.
[3] Y. Tian, R. Liu, X. Zhang, H. Ma, K. C. Tan, and Y. Jin, “A multipopulation evolutionary algorithm for solving large-scale multi-modal multi-objective optimization problems,”IEEE Trans. Evol. Comput. vol. 25, no. 3, pp. 405–418, 2020.
[4] J. Kennedy and R. C. Eberhart, “A discrete binary version of the particle swarm algorithm,” Proceedings of 1997 Conference Systems Man and Cybernetics, pp. 4104–4108, 1997.
[5] S. W. Lin, K. C. Ying, S. C. Chen, and Z. J. Lee, “Particle swarm optimization for parameter determination and feature selection of support vector machines,” Expert Syst. Appl. vol. 35, no. 4, pp. 1817–1824, 2008.
[6] B. Tran, B. Xue, and M. Zhang, “A new representation in PSO for discretization-based feature selection,” IEEE Trans. Cybern. vol. 48, no. 6, pp. 1733–1746, 2018.
[7] B. Xue, L. Cervante, L. Shang, W.N. Browne, and M. Zhang, “A multi-objective particle swarm optimization for filter-based feature selection in classification problems”, Connect. Sci. vol. 24, no. 2–3, pp. 91–116, 2012.
[8] H.Wang, R. Ke, J. Li, Y. An, K.Wang, and L. Yu, “A correlation-based binary particle swarm optimization method for feature selection in human activity recognition”, Int. J. Distributed Sens. Netw. vol. 14, no. 4, 2018.
[9] B. Tran, B. Xue, and M. Zhang, “Variable-length particle swarm optimization for feature selection on high-dimensional classification,” IEEE Trans. Evol. Comput. vol. 24, no. 5, pp. 882–895, 2018.
[10] B. P. Flannery, W. H. Press, S. A. Teukolsky, and W. Vetterling, “Numerical Recipes in C,” vol. 24, Press Syndicate of the University of Cambridge, New York, pp. 78, 1992.
[11] F. Hafiz, A. Swain, N. Patel, and C. Naik. “A two-dimensional (2-D) learning framework for Particle Swarm based feature selection,” Pattern Recognition. vol. 76, pp. 416–433, 2018.
[12] J. Kennedy, “Bare bones particle swarms,” Proceedings of the 2003 IEEE Swarm Intelligence Symposium, pp. 80–87, 2003.
[13] Y. Zhang, D. W. Gong, Y. Hu, and W. Zhang, “Feature selection algorithm based on bare bones particle swarm optimization,” Neurocomputing. vol.148, pp. 150–157, 2015.
[14] F. Wang and J. Liang, “An efficient feature selection algorithm for hybrid data,” Neurocomputing. vol. 193, pp. 33–41, 2016.
[15] H. B. Nguyen, B. Xue, I. Liu, and M. Zhang, “Filter based backward elimination in wrapper based PSO for feature selection in classification,” Proceedings of IEEE Congress on Evolutionary Computation, pp. 3111–3118, 2014.
[16] A. D. Li, B. Xue, and M. Zhang, “Improved binary particle swarm optimization for feature selection with new initialization and search space reduction strategies,” Appl. Soft Comput. vol. 106, Article 107302, 2021.
[17] H. B. Nguyen, B. Xue, P. Andreae, and M. Zhang, “Particle swarm optimization with genetic operators for feature selection,” Proceedings of IEEE Congress on Evolutionary Computation, pp. 286–293, 2017.
[18] L. Y. Chuang, H. W. Chang, C. J. Tu, and C. H. Yang, “Improved binary PSO for feature selection using gene expression data,” Comput. Biol. Chem. vol. 32, no. 1, pp. 29–38, 2008.
[19] Y. Zhang, D. W. Gong, and J. Cheng, “Multi-objective particle swarm optimization approach for cost-based feature selection in classification,” IEEE ACM Trans. Comput. Biol. Bioinf. vol. 14, no. 1, pp. 64–75, 2017.
[20] K. Mistry, L. Zhang, S. C. Neoh, C. P. Lim, and B. Fielding, “Amicro-GA embedded PSO feature selection approach to intelligent facial emotion recognition,” IEEE Trans. Cybern. vol. 47, no. 6, pp.1496–1509, 2017.
[21] S. Gu, R. Cheng, and Y. Jin, “Feature selection for high-dimensional classification using a competitive swarm optimizer,” Soft Comput. vol. 22, pp. 811–822, 2018.
[22] R. Cheng and Y. Jin, “A competitive swarm optimizer for large scale optimization,” IEEE Trans. Cybern. vol. 45, no. 2, pp. 191–204, 2015.
[23] K. Chen, B. Xue, M. Zhang, and F. Zhou, “Correlation-guided updating strategy for feature selection in classification with surrogate-assisted particle swarm optimization,” IEEE Trans. Evol. Comput. vol. 26, no. 5, pp. 1015–1029, 2021.
[24] B. Tran, B. Xue, and M. Zhang, “Improved PSO for feature selection on high-dimensional datasets,” Proceedings of Simulated Evolution and Learning, Springer, pp. 503–515, 2014.
[25] B. Tran, M. Zhang, and B. Xue, “A PSO based hybrid feature selection algorithm for high-dimensional classification,” Proceedings of IEEE Congress on Evolutionary Computation, pp. 3801–3808, 2016.
[26] H. B. Nguyen, B. Xue, and P. Andreae, “Surrogate-model based particle swarm optimization with local search for feature selection in classification,” Proceedings of Applications of Evolutionary Computation, Lecture Notes in Computer Science, Springer International Publishing, pp. 487–505, 2017.
[27] H. B. Nguyen, B. Xue, and P. Andreae, “PSO with surrogate models for feature selection: static and dynamic clustering-based methods,” Memet. Comput. vol. 10, pp. 291–300, 2018.
[28] T. Butler-Yeoman, B. Xue, and M. Zhang, “Particle swarm optimisation for feature selection: a hybrid filter-wrapper approach,” Proceedings of IEEE Congress on Evolutionary Computation, pp. 2428–2435, 2015.
[29] X. M. Hu, S. R. Zhang, M. Li, and J. D. Deng, “Multimodal particle swarm optimization for feature selection,” Appl. Soft Comput. vol. 113, Article 107887, 2021.
[30] UCI machine learning repository, url: http://archive.ics.uci.edu/ml
[31] Y. Xue , B. Xue, and M. Zhang. “Self-adaptive particle swarm optimization for large-scale feature selection in classification,” ACM Trans. Knowl. Discov. vol 13, no. 5, pp. 1–27, 2019.