CISUC

Particle Swarm Based Data Mining Algorithms for Classification Tasks

Authors

Tiago Sousa
Ana Paula Neves F. da Silva
Arlindo Silva
Ernesto Costa

Abstract

Particle Swarm Optimisers are inherently distributed algorithms where the solution for a problem emerges from the interactions between many simple individual agents called particles. This article proposes the use of the Particle Swarm Optimiser as a new tool for Data Mining. In the first phase of our research, three different Particle Swarm Data Mining Algorithms were implemented and tested against a Genetic Algorithm and a Tree Induction Algorithm (J48). From the obtained results, Particle Swarm Optimisers proved to be a suitable candidate for classification tasks. The second phase was dedicated to improving one of the Particle Swarm optimiser variants in terms of attribute type support and temporal complexity. The data sources here used for experimental testing are commonly used and considered
as a de facto standard for rule discovery algorithms reliability ranking. The results obtained in these domains seem to indicate that Particle Swarm Data Mining Algorithms are competitive, not only with other evolutionary techniques, but also with industry standard algorithms such as the J48 algorithm, and can be successfully applied to more demanding problem domains.

Subject

Particle Swarm Optimization

Journal

Parallel Computing, #30, pp. 767-783, Elsevier B. V., January 2004

Cited by

Year 2010 : 3 citations

 Hongbo Liu, Ajith Abraham and Benxian Yue (2010). Nature Inspired Multi-Swarm Heuristics for Multi-Knowledge Extraction. Advances in Machine Learning II, Studies in Computational Intelligence, Volume 263, pp. 445-466, Springer 2010.

 Suraj Pandey, Linlin Wu, Siddeswara Guru, and Rajkumar Buyya (2010). A Particle Swarm Optimization (PSO)-based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments, Proceedings of the 24th IEEE International Conference on Advanced Information Networking and Applications (AINA 2010), Perth, Australia, April 20-23, 2010

 Adham Atyabi, Somnuk Phon-Amnuaisuk, Chin Kuan Ho (2010). Applying Area Extension PSO in Robotic Swarm. Journal of Intelligent & Robotic Systems, Volume 58, Numbers 3-4, pp. 253-285, Springer 2010.

Year 2009 : 27 citations

 A. B. S. Serapião and J. R. P. Mendes (2009). Classification of Petroleum Well Drilling Operations with a Hybrid Particle Swarm/Ant Colony Algorithm. Next-Generation Applied Intelligence, Lecture Notes in Computer Science, 5579, pp. 301-310, Springer 2009.

 A. Cervantes, I. M. Galván, P. Isasi (2009).AMPSO: A new Particle Swarm Method for Nearest Neighborhood Classification. IEEE Transactions on Systems, Man, and Cybernetics: Part B, vol. 39, n. 5, Oct. 2009, p. 1082 - 1091, IEEE Press, 2009.

 A. Serapião (2009). Fundamentos de otimização por inteligência de enxames: uma visão geral, Sba: Controle & Automação Sociedade Brasileira de Automatica, vol.20 n.3, Scielo, 2009.

 Adham Atyabi, Somnuk Phon-Amnuaisuk, Chin Kuan Ho (2009). Applying Area Extension PSO in Robotic Swarm. Journal of Intelligent and Robotic Systems , pp. 1-33, Springer Netherlands, 2009.

 Ajith Abraham and Hongbo Liu (2009). Turbulent Particle Swarm Optimization Using Fuzzy Parameter Tuning. Foundations of Computational Intelligence, Studies in Computational Intelligence, Volume 3, pp. 291-312, Springer 2009.

 Alejandro Cervantes, Inés Galván and Pedro Isasi (2009). Michigan Particle Swarm Optimization for Prototype Reduction in Classification Problems. New Generation Computing, Vol 27, Num 3, pp. 239-257, Springer 2009.

 Augusto de Almeida Prado G. Torácio (2009). Multiobjective Particle Swarm Optimization in Classification-Rule Learning. Swarm Intelligence for Multi-objective Problems in Data Mining, Studies in Computational Intelligence, Volume 242, pp. 37-64, Springer, 2009.

 Bashir Mohammed Ghandi (2009). Classification of Facial Emotions using Guided Particle Swarm Optimization I. International Journal on Computer and Communication Technology , Vol. 1, No. 1, 2009.

 Bilal Alatas and Erhan Akina(2009). Multi-objective rule mining using a chaotic particle swarm optimization algorithm. Knowledge-Based Systems Volume 22, Issue 6, August 2009, Pages 455-460, Elsevier 2009.

 Chih-Chuan Chen, Chao-Chin Hsu, Yi-Chung Cheng, Sheng-Tun Li (2009). Knowledge Discovery on In Vitro Fertilization Clinical Data Using Particle Swarm Optimization. 2009 Ninth IEEE International Conference on Bioinformatics and Bioengineering, pp.278-283, 2009.

 Chih-Chuan Chen, Chao-Chin Hsu, Yi-Chung Cheng, Sheng-Tun Li and Ying-Fang Chan (2009).Comprehensible Knowledge Discovery Using Particle Swarm Optimization with Monotonicity Constraints. Opportunities and Challenges for Next-Generation Applied Intelligence, Studies in Computational Intelligence, Volume 214/2009, pp. 323-328, Springer 2009.

 H Liu, A Abraham (2009). Chaos and Swarm, Intelligent Computing Based on Chaos, Springer, 2009.

 Hongbo Liu and Ajith Abraham6 (2009). Chaos and Swarm Intelligence. Intelligent Computing Based on Chaos, Studies in Computational Intelligence, Volume 184/2009, pp. 197-212, Springer 2009.

 Hongbo Liu, Ajith Abraham and Yanheng Li (2009). Nature Inspired Population-Based Heuristics for Rough Set Reduction. Rough Set Theory: A True Landmark in Data Analysis, Studies in Computational Intelligence, Volume 174, 261-278, Springer 2009.

 Mingyan Zhao, Hongbo Liu, Ajith Abraham, Emilio Corchado (2009). A Swarm-Based Rough Set Approach for Group Decision Support Systems. 2009 Ninth International Conference on Hybrid Intelligent Systems, vol. 3, pp.365-369, 2009.

 S. Dehuri, S.Ghosh and C. A. Coello Coello (2009). An Introduction to Swarm Intelligence for Multi-objective Problems. Swarm Intelligence for Multi-objective Problems in Data Mining, Studies in Computational Intelligence, Volume 242, pp. 1-17, Springer 2009.

 Seyed-Hamid Zahiri, Seyed-Alireza Seyedin (2009). Using Multi-Objective Particle Swarm Optimization for Designing Novel Classifiers. Swarm Intelligence for Multi-objective Problems in Data Mining, Book Series Studies in Computational Intelligence, Volume 242, pp. 65-92, Springer 2009.

 Shao-Rong Huang (2009). Survey of particle swarm optimization algorithm. Computer Engineering and Design. Vol. 30, no. 8, pp. 1977-1980. 2009.

 Shelly Bansal, Daya Gupta, V. K. Panchal and Shashi Kumar (2009). Swarm Intelligence Inspired Classifiers in Comparison with Fuzzy and Rough Classifiers: A Remote Sensing Approach. Contemporary Computing, Communications in Computer and Information Science, Volume 40, pp. 284-294, Springer 2009.

 Suraj Pandey, Linlin Wu, Siddeswara Guru, Rajkumar Buyya (2009). A Particle Swarm Optimization (PSO)-based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments. NET-based Cloud Computing, Technical Report, CLOUDS-TR-2009.

 TH Sun (2009). Applying particle swarm optimization algorithm to roundness measurement, Expert Systems With Applications, Elsevier, 2009.

 WC Yeh (2009). A two-stage discrete particle swarm optimization for the problem of multiple multi-level redundancy allocation in series systems, Expert Systems with Applications, Elsevier, 2009.

 WC Yeh, WW Chang, YY Chung (2009). A new hybrid approach for mining breast cancer pattern using discrete particle particle swarm optimization and statistical methods. Expert Systems with Applications, Elsevier, 2009.

 Leandro dos Santos Coelho (2009), Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems, Expert Systems with Applications, Volume 37, Issue 2, March 2010, Pages 1676-1683, ISSN 0957-4174, DOI: 10.1016/j.eswa.2009.06.044.

 C. Dalian (2009). Nature Inspired Population-Based Heuristics for Rough Set Reduction. Rough Set Theory: A True Landmark in Data Analysis, 2009.

 Haijun Su, Yupu Yang, Liang Zhao, Classification rule discovery with DE/QDE algorithm, Expert Systems with Applications, Volume 37, Issue 2, March 2010, Pages 1216-1222, Elsevier, 2009.

 C Nalini, PB Balasubramanie (2009). Performance Analysis of Cooperative PSO Algorithm with ACO and Tabu Search, International Journal of Computational Intelligence, Volume 5, Number 2 (2009).

Year 2008 : 8 citations

 Y Zheng, Y Meng (2008), OBJECT DETECTION AND TRACKING USING BAYES-CONSTRAINED PARTICLE SWARM OPTIMIZATION, Computer Vision Research Progress, 2008 - Nova Science Publishers

 N. O. S. Ba-Karait, S. Mariyam Shamsuddin (2008). Handwritten Digits Recognition Using Particle Swarm Optimization . Second Asia International Conference on Modelling & Simulation, pp. 615-619, IEEE.

 A. Toracio (2008). Aprendizado de regras de classificação com otimização por nuvem de particulas multiobjetivo . Master Thesis, 2008.

 Abraham, A. Hongbo Liu (2008). Swarm intelligence based rough set reduction scheme for support vector machines. Proceedings of the IEEE International Conference on Intelligence and Security Informatics, pp. 200-202, IEEE Press, 2008.

 Nicholas Holden and Alex A. Freitas (2008). A Hybrid PSO/ACO Algorithm for Discovering Classification Rules in Data Mining. Journal of Artificial Evolution and Applications, Volume 2008, Hindawi Publishing , 2008.

 Neveen Ibrahim Ghali, Nahed Eldesouky, Mervat A. Nabyand Lamiaa Bakrawy (2008). IMPROVEMENT OF DATA CLUSTERING USING PARTICLE SWARM OPTIMIZATION, Far East Journal of Electronics and Communications, Volume 2, Issue 2, Pages 121 - 132, 2008.

 Yanchao Yin, Linfu Sun, Min Han (2008). A High-Accuracy Parameter Estimation PSO Algorithm. International Conference on Embedded Software and Systems Symposia, pp. 7-12, IEEE Press, 2008.

 Wei-Chang Yeh, and Sin-Long Liu (2008). A discrete particle swarm optimization for evaluating the multiple multi-level redundancy allocation problem. 5th International Conference on Information Technology and Applications, ICITA 2008, pp. 408-413, 2008.

Year 2007 : 12 citations

 De Falco, A Della Cioppa, E Tarantino - Facing classification problems with Particle Swarm Optimization. Applied Soft Computing, 2007 ¨C Elsevier.

 H Liu, A Abraham, M Clerc - Chaotic dynamic characteristics in swarm intelligence. Applied Soft Computing, 2007 ¨C Elsevier.

 Nicholas Paul Holden, Alex A. Freitas. A hybrid PSO/ACO algorithm for classification. Proceedings of the 2007 GECCO conference companion on Genetic and evolutionary computation, London, United Kingdom. WORKSHOP SESSION: Particle swarms the second decade, pp. 2745-2750, ISBN:978-1-59593-698-1, ACM Press 2007.

 H Liu, A Abraham, W Zhang, A fuzzy adaptive turbulent particle swarm optimization, International Journal of Innovative Computing and Applications, Volume 1, Number 1, pp. 39 ¨C 47, 2007.

 Benxian Yue, Weihong Yao , Ajith Abraham, Hongbo Liu1 (2007): A New Rough Set Reduct Algorithm Based on Particle Swarm Optimization. Bio-inspired Modeling of Cognitive Tasks, LNCS 4527, pp. 397-406, Springer, 2007.

 Cui Zhi-hua, Zeng Jian-chao, Sun Guo-ji (2007): Adaptive Integral-controller Particle Swarm Optimization Using Accelerator Feedback. Journal of Chinese Computer Systems, vol.28, No.5, pp. 855-860, 2007.

 Eduardo P. Costa , Ana C. Lorena , André C. P. L. F. Carvalho , Alex A. Freitas and Nicholas Holden (2007): Comparing Several Approaches for Hierarchical Classification of Proteins with Decision Trees. Advances in Bioinformatics and Computational Biology, LNCS 4643, pp.126-137, Springer, 2007.

 Inthachot, Montri Supratid, Siriporn (2007): A Multi-Subpopulation Particle Swarm Optimization: A Hybrid Intelligent Computing for Function Optimization.
In Natural Computation, 2007, vol 5, pp. 679-684, IEEE Press.

 Lei, Wang; Qi, Kang; Hui, Xiao; Qidi, Wu, Traffic Intelligent Optimization and Local Traffic-Flow Control Inside Shanghai-EXPO-Area, Networking, Sensing and Control, 2007 IEEE International Conference on. Volume , Issue , 15-17 April 2007 Page(s):856 " 861

 Cervantes, A.; Galvan, I.; Isasi, P., Building Nearest Prototype Classifiers Using a Michigan Approach PSO, Swarm Intelligence Symposium, 2007. SIS 2007. IEEE. Volume , Issue , 1-5 April 2007 Page(s):135 - 140

 A de Almeida, PG Toracio, A Trinicad Ramirez Pozo (2007), Multiple objective particle swarm for classification-rule discovery, Evolutionary Computation, 2007. CEC 2007. IEEE Congress on, 2007.

 Liang-Chi Wang (2007). Classification Rule Discovery with Particle Swarm Optimization. Master Thesis, 2007.

Year 2006 : 8 citations

 N Holden, AA Freitas, Hierarchical Classification of G-Protein-Coupled Receptors with a PSO/ACO Algorithm, Proc. IEEE Swarm Intelligence Symposium (SIS-2006), pp. 77-84.

 Crina Grosan, Ajith Abraham and Monica Chis: Swarm Intelligence in Data Mining, Studies in Computational Intelligence (SCI) 34, 1"20 (2006).

 De Falco, I. Cioppa, A. D. Tarantino, E., Evaluation of Particle Swarm Optimization Effectiveness in Classification, Lecture Notes in Computer Science, 2006, Vol. 3849, pages 164-171., Springer-Verlag.

 Cui, Z. Cai, X. Zeng, J. Sun, G., Predicted-Velocity Particle Swarm Optimization Using Game-Theoretic Approach, Lecture Notes in Computer Science, 2006, Vol. 4115, pages 145-154, Springer-Verlag.

 Qi Kang, Lei Wang, Qi-di Wu, Research on Fuzzy Adaptive Optimization Strategy of Particle Swarm Algorithm, International Journal of Information Technology, Vol.12, No.3, 2006.

 Wang Lei　 Kang Qi　 Wu Qi-Di, Multi-optimum Fuzzy Programming Based Particle Swarm Optimization, Control And Decision, 2006 Vol.21 No.6 P.680-684

 Liu Hong-Bo　 Wang Xiu-Kun　 Tan Guo-Zhen,　Convergence Analysis of Particle Swarm Optimization and Its Improved Algorithm Based on Chaos, Control And Decision, 2006 Vol.21 No.6 P.636-640,645

 A. Abraham, He Guo, and Hongbo Liu, "Swarm Intelligence: Foundations, Perspectives and Applications", in Swarm Intelligence in Data Mining, A. Abraham, C. Grosan, V. Ramos (Eds.), Studies in Computational Intelligence (series), approx. 300 pages (hardcover), Springer, Germany, 2006.

Year 2005 : 5 citations

 Nicholas Holden, Alex A. Freitas, A Hybrid Particle Swarm/Ant Colony Algorithm for the Classification of Hierarchical Biological Data, 2005 IEEE Swarm Intelligence Symposium, 8-10 June, Pasadena, California, USA.

 Wang Lei, Kang Qi, Xiao Hui, Wu Qidi, "A Modified Adaptive Particle Swarm Optimization Algorithm?, ICIT 2005. IEEE International Conference on Industrial Technology, 14-17 Dec. 2005.

 Cervantes, A. Galvan, I. Isasi, P., "A Comparison between the Pittsburgh and Michigan Approaches for the Binary PSO Algorithm?, the 2005 IEEE Congress on Evolutionary Computation, 02-05 Sept. 2005.

 Andries P. Engelbrecht, Fundamentals of Computational Swarm Intelligence, ISBN: 0-470-09191-6, November 2005, John Wiley & Sons, Ltd.

 KANG Qi, WANG Lei, WU Qi-di, "Fuzzy Adaptive Programming Algorithm Based on Particle Swarm Multi-optimum Information?, INFORMATION AND CONTROL, 2005 Vol.34 No.4 P.439-443,450