A Review of Metaheuristic Optimization Techniques in Text Classification

Authors

  • Cem Kaya
  • Zeynep Hilal Kilimci Kocaeli University
  • Mitat Uysal
  • Murat Kaya

DOI:

https://doi.org/10.22399/ijcesen.295

Keywords:

Metaheuristic optimization, Text classification, Feature selection

Abstract

Metaheuristic algorithms, inspired by natural phenomena and human-based strategies, offer versatile approaches to navigate diverse search spaces and adapt to dynamic environments. These algorithms, including evolutionary algorithms, swarm intelligence, bio-inspired methods, human-based approaches, and plant-inspired techniques, have found applications across diverse domains such as engineering, finance, healthcare, logistics, and telecommunications. In the text classification domain, metaheuristic techniques have emerged as powerful tools to enhance the accuracy, efficiency, and robustness of classification systems. By optimizing feature subsets, fine-tuning model parameters, and addressing challenges such as feature selection, dimensionality reduction, class imbalance, and noisy data, metaheuristic algorithms provide flexible solutions that adapt to various text datasets and tasks. This review paper comprehensively explores recent advancements in metaheuristic applications in text classification across six categories. From evolutionary-based methods to swarm-based approaches, bio-inspired techniques to physics/chemistry-based strategies, human-based methods to plant-based algorithms, researchers have leveraged diverse metaheuristic techniques to push the boundaries of text classification. Through a systematic analysis of recent research studies, this review provides insights into the strengths, limitations, and future directions of metaheuristic optimization in the context of text classification. 

References

Abdel-Basset, M., Mohamed, R., Jameel, M., & Abouhawwash, M. (2023). Nutcracker optimizer: A novel nature-inspired metaheuristic algorithm for global optimization and engineering design problems. Knowledge-Based Systems, 262, 110248. DOI: https://doi.org/10.1016/j.knosys.2022.110248

Mousapour Mamoudan, M., Ostadi, A., Pourkhodabakhsh, N., Fathollahi-Fard, A. M., & Soleimani, F. (2023). Hybrid neural network-based metaheuristics for prediction of financial markets: a case study on global gold market. Journal of Computational Design and Engineering, 10(3), 1110-1125. DOI: https://doi.org/10.1093/jcde/qwad039

Savanović, N., Toskovic, A., Petrovic, A., Zivkovic, M., Damaševičius, R., Jovanovic, L., ... & Nikolic, B. (2023). Intrusion detection in healthcare 4.0 internet of things systems via metaheuristics optimized machine learning. Sustainability, 15(16), 12563. DOI: https://doi.org/10.3390/su151612563

Abed, A. M., Seddek, L. F., & AlArjani, A. (2023). Enhancing Two-Phase Supply Chain Network Distribution via Three Meta-Heuristic Optimization Algorithms Subsidized by Mathematical Procedures. Journal of Advanced Manufacturing Systems, 22(03), 445-476. DOI: https://doi.org/10.1142/S0219686723500221

Alkanhel, R., El-kenawy, E. S. M., Elsheweikh, D. L., Abdelhamid, A. A., Ibrahim, A., & Khafaga, D. S. (2023). Metaheuristic Optimization of Time Series Models for Predicting Networks Traffic. CMC-COMPUTERS MATERIALS & CONTINUA, 75(1), 427-442. DOI: https://doi.org/10.32604/cmc.2023.032885

Alsaleh, D., & Larabi-Marie-Sainte, S. (2021). Arabic Text Classification Using Convolutional Neural Network and Genetic Algorithms. *IEEE Access, 9*, 91670-91685. DOI: https://doi.org/10.1109/ACCESS.2021.3091376

Labani, M., Moradi, P., & Jalili, M. (2020). A multi-objective genetic algorithm for text feature selection using the relative discriminative criterion. *Expert Systems with Applications, 149*, 113276. DOI: https://doi.org/10.1016/j.eswa.2020.113276

Dwarakanath, L., Kamsin, A., & Shuib, L. (2023). A Genetic Algorithm based Domain Adaptation Framework for Classification of Disaster Topic Text Tweets. Int. Arab J. Inf. Technol., 20(1), 57-65. DOI: https://doi.org/10.34028/iajit/20/1/7

Jin, Q. (2023). Genetic algorithm and support vector machine application in English text classification for intelligent teaching. *Soft Computing*. Advance online publication. DOI: https://doi.org/10.1007/s00500-023-09084-x

Mohana, R. S., Rajathi, K., Kousalya, K., & Yuvaraja, T. (2022). Text sentiment analysis on E-shopping product reviews using chaotic coyote optimized deep belief network approach. *Concurrency and Computation: Practice and Experience, 34*(19), e7039. DOI: https://doi.org/10.1002/cpe.7039

Parlar, T., & Sarac, E. (2019). IWD based feature selection algorithm for sentiment analysis. Elektronika ir Elektrotechnika, 25(1), 54-58. DOI: https://doi.org/10.5755/j01.eie.25.1.22736

Alhaj, Y. A., Dahou, A., Al-qaness, M. A. A., Abualigah, L., Abbasi, A. A., Almaweri, N. A. O., Elaziz, M. A., & Damaševičius, R. (2022). A novel text classification technique using improved particle swarm optimization: A case study of Arabic language. *Future Internet, 14*(7), 194. DOI: https://doi.org/10.3390/fi14070194

Vaissnave, V., & Deepalakshmi, P. (2023). Modeling of automated glowworm swarm optimization based deep learning model for legal text summarization. *Multimedia Tools and Applications, 82*(17), 17175–17194. DOI: https://doi.org/10.1007/s11042-022-14171-6

Hosseinzadeh Aghdam, M., Ghasem-Aghaee, N., & Basiri, M. E. (2009). Text feature selection using ant colony optimization. *Expert Systems with Applications, 36*(3, Part 2), 6843–6853. DOI: https://doi.org/10.1016/j.eswa.2008.08.022

Al-Anzi, F. S., & Sarath, S. (2023). Social Spider Optimization for Text Classification Enhancement. In C. Kahraman, I. U. Sari, B. Oztaysi, S. Cebi, S. Cevik Onar, & A. Ç. Tolga (Eds.), *Intelligent and Fuzzy Systems* (pp. xxx-xxx). Springer. DOI: https://doi.org/10.1007/978-3-031-39774-5_59

Chantar, H., Mafarja, M., Alsawalqah, H., et al. (2020). Feature selection using binary grey wolf optimizer with elite-based crossover for Arabic text classification. *Neural Computing & Applications, 32*(21), 12201–12220. DOI: https://doi.org/10.1007/s00521-019-04368-6

Shekhawat, S. S., Shringi, S., & Sharma, H. (2021). Twitter sentiment analysis using hybrid Spider Monkey optimization method. *Evolutionary Intelligence, 14*(4), 1307–1316. DOI: https://doi.org/10.1007/s12065-019-00334-2

Gite, S., Patil, S., Dharrao, D., Yadav, M., Basak, S., Rajendran, A., & Kotecha, K. (2023). Textual Feature Extraction Using Ant Colony Optimization for Hate Speech Classification. *Big Data and Cognitive Computing, 7*(1), 45. DOI: https://doi.org/10.3390/bdcc7010045

Wu, X., Fei, M., Wu, D., Zhou, W., Du, S., & Fei, Z. (2023). Enhanced Binary Black Hole algorithm for text feature selection on resources classification. *Knowledge-Based Systems, 274*, 110635. DOI: https://doi.org/10.1016/j.knosys.2023.110635

Rao, P. C. S., Kumar, A. J. S., Niyaz, Q., Sidike, P., & Devabhaktuni, V. K. (2021). Binary chemical reaction optimization based feature selection techniques for machine learning classification problems. *Expert Systems with Applications, 167*, 114169. ISSN 0957-4174. DOI: https://doi.org/10.1016/j.eswa.2020.114169

Küçükdeniz, T., & Büyüksaatçı, S. Imperialist Competitive Algorithm Compared With Particle Swarm Optimization And K-Means On Document Clustering (OPTI 2014).

Mojaveriyan, M., Ebrahimpour-komleh, H., & jalaleddin Mousavirad, S. (2016). IGICA: a hybrid feature selection approach in text categorization. International Journal of Intelligent Systems and Applications, 8(3), 42. DOI: https://doi.org/10.5815/ijisa.2016.03.05

Asheghi Dizaji, Z., Asghari Aghjehdizaj, S., & Soleimanian Gharehchopogh, F. (2020). An Improvement in Support Vector Machines Algorithm with Imperialism Competitive Algorithm for Text Documents Classification. *Journal of Soft Data Processing, 17*(1), 117-130. DOI: https://doi.org/10.29252/jsdp.17.1.117

Kavitha, D. (2021). Weighted Feature Based Imperialist Competitive Algorithm With Ensemble Learning For Imbalanced Data Classification. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(7), 1037–1050.

Alghamdi, H. M., Hamza, S. H., Mashraqi, A. M., & Abdel-Khalek, S. (2022). Seeker Optimization with Deep Learning Enabled Sentiment Analysis on Social Media. Computers, Materials & Continua, 73(3). DOI: https://doi.org/10.32604/cmc.2022.031732

Muhammad, A., Abdullah, S., & Sani, N. S. (2021). Optimization of Sentiment Analysis Using Teaching-Learning Based Algorithm. Computers, Materials & Continua, 69(2). DOI: https://doi.org/10.32604/cmc.2021.018593

Khurana, A., & Verma, O.P. (2020). Novel approach with nature-inspired and ensemble techniques for optimal text classification. *Multimedia Tools and Applications, 79*(21), 23821-23848. DOI: https://doi.org/10.1007/s11042-020-09013-2

Singh, G., Nagpal, A., & Singh, V. (2023). Optimal feature selection and invasive weed tunicate swarm algorithm-based hierarchical attention network for text classification. *Connection Science, 35*(1). DOI: https://doi.org/10.1080/09540091.2023.2231171

Fan, C., Zhang, T., Yang, Z., & Wang, L. (2015). A Text Clustering Algorithm Hybriding Invasive Weed Optimization with K-Means. In *2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom)* (pp. 1333-1338). Beijing, China: IEEE. DOI: https://doi.org/10.1109/UIC-ATC-ScalCom-CBDCom-IoP.2015.241

Majidpour, H., & Soleimanian Gharehchopogh, F. (2018). An improved flower pollination algorithm with AdaBoost algorithm for feature selection in text documents classification. Journal of Advances in Computer Research, 9(1), 29-40.

Muhammad Iqbal, A. L., Yaakub, M. R., & Ibrahim, S. A. (2022). Flower Pollination Algorithm for Feature Selection in Tweets Sentiment Analysis. International Journal of Advanced Computer Science and Applications,13. DOI: https://doi.org/10.14569/IJACSA.2022.0130551

https://en.wikipedia.org/wiki/Table_of_metaheuristics

Downloads

Published

2024-04-30

How to Cite

Kaya, C., Kilimci, Z. H., Uysal, M., & Kaya, M. (2024). A Review of Metaheuristic Optimization Techniques in Text Classification. International Journal of Computational and Experimental Science and Engineering, 10(2). https://doi.org/10.22399/ijcesen.295

Issue

Section

Review Article