SentiNet: A Deep Learning-Based Architecture with Hyperparameter Optimization for Sentiment Analysis of Customer Feedback Reviews
DOI:
https://doi.org/10.22399/ijcesen.1810Keywords:
Sentiment Analysis, Opinion Mining, Deep Learning, Artificial Intelligence, Online Review AnalysisAbstract
In the contemporary era, customers' opinions are paramount as they can help improve the quality of service that leads to business growth. People from all walks of life often voice their opinions about goods and services using social media. Modern businesses cannot ignore social media feedback. As technology advances, including big data, cloud computing, and distributed computing architectures, it is now possible to analyze large volumes of data to discover trends or patterns in customer behavior. Therefore, sentiment analysis has become an important research area that helps organizations promote their businesses. Artificial intelligence, of late, is widely used to discover sentiments from customer reviews. However, analyzing sentiments accurately is nontrivial due to the complexity of procedures involved in mining textual data. There is a need to leverage performance in sentiment analysis. This research aimed to achieve this goal by proposing a DL-based framework for analyzing the sentiments of given data. We proposed a novel DL architecture, SentiNet, to efficiently classify sentiments in customer reviews. We proposed an Efficient Learning-Based Sentiment Analyzer (LBSA) algorithm, which exploits novel vectorization, embeddings, and the novel architecture of the proposed SentiNet model. Our empirical study with a benchmark dataset of customer reviews on restaurants and food items revealed that the proposed SentiNet model outperformed many existing DLs with the most accurate simulations of 98.68%. Our framework can be incorporated into business applications for sentiment analysis and improving service quality
References
[1] Wang, R., Li, Z., Cao, J., Chen, T., & Wang, L. (2019). Convolutional Recurrent Neural Networks for Text Classification. International Joint Conference on Neural Networks (IJCNN). 1-6. https://doi.org/10.1109/IJCNN.2019.8852406
[2] Al-Smadi, M., Talafha, B., Al-Ayyoub, M., & Jararweh, Y. (2018). Using long short-term memory deep neural networks for aspect-based sentiment analysis of Arabic reviews. International Journal of Machine Learning and Cybernetics. https://doi.org/10.1007/s13042-018-0799-4
[3] Alharbi, M. A. S., & Doncker, E. (2018). Twitter Sentiment Analysis with a Deep Neural Network: An Enhanced Approach using User Behavioral Information. Cognitive Systems Research. https://doi.org/10.1016/j.cogsys.2018.10.001
[4] Jelodar, H., Wang, Y., Orji, R., & Huang, H. (2020). Deep Sentiment Classification and Topic Discovery on Novel Coronavirus or COVID-19 Online Discussions: NLP Using LSTM Recurrent Neural Network Approach. IEEE Journal of Biomedical and Health Informatics. 1-1. https://doi.org/10.1109/JBHI.2020.3001216
[5] Basiri, M. E., Nemati, S., Abdar, M., Cambria, E., & Acharrya, U. R. (2021). ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis. Future Generation Computer Systems. 115;279-294. https://doi.org/10.1016/j.future.2020.08.005
[6] Jianqiang, Z., & Xiaolin, G. (2018). Deep Convolution Neural Networks for Twitter Sentiment Analysis. IEEE Access. 1-1. https://doi.org/10.1109/ACCESS.2017.2776930
[7] Xu, G., Meng, Y., Qiu, X., Yu, Z., & Wu, X. (2019). Sentiment Analysis of Comment Texts Based on BiLSTM. IEEE Access. 7;51522-51532. https://doi.org/10.1109/ACCESS.2019.2909919
[8] Dohaiha, H. H., Prasad, P. W. C., Maag, A., & Alsadoon, A. (2018). Deep Learning for Aspect-Based Sentiment Analysis: A Comparative Review. Expert Systems with Applications. https://doi.org/10.1016/j.eswa.2018.10.003
[9] Bahad, P., Saxena, P., & Kamal, R. (2019). Fake News Detection using Bi-directional LSTM-Recurrent Neural Network. Procedia Computer Science. 165;74-82. https://doi.org/10.1016/j.procs.2020.01.072
[10] Yang, C., Zhang, H., Jiang, B., & Li, K. (2019). Aspect-based sentiment analysis with alternating coattention networks. Information Processing & Management. 56(3);463-478. https://doi.org/10.1016/j.ipm.2018.12.004
[11] Jin, Z., Yang, Y., & Liu, Y. (2019). Stock closing price prediction based on sentiment analysis and LSTM. Neural Computing and Applications. https://doi.org/10.1007/s00521-019-04504-2
[12] Rehman, A. U., Malik, A. K., Raza, B., & Ali, W. (2019). A Hybrid CNN-LSTM Model for Improving Accuracy of Movie Reviews Sentiment Analysis. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-019-07788-7
[13] Usama, M., Ahmad, B., Song, E., Hossain, M. S., Alrashoud, M., & Muhammad, G. (2020). Attention-based sentiment analysis using convolutional and recurrent neural network. Future Generation Computer Systems. https://doi.org/10.1016/j.future.2020.07.022
[14] Onan, A. (2022). Bidirectional convolutional recurrent neural network architecture with group-wise enhancement mechanism for text sentiment classification. Journal of King Saud University - Computer and Information Sciences. 34(5);2098-2117. https://doi.org/10.1016/j.jksuci.2022.02.025
[15] Ligthart, A., Catal, C., & Tekinerdogan, B. (2021). Systematic reviews in sentiment analysis: a tertiary study. Artificial Intelligence Review. https://doi.org/10.1007/s10462-021-09973-3
[16] Muhammad, P. F., Kusumaningrum, R., & Wibowo, A. (2021). Sentiment Analysis Using Word2vec And Long Short-Term Memory (LSTM) For Indonesian Hotel Reviews. Procedia Computer Science. https://doi.org/10.1016/j.procs.2021.01.061
[17] Gupta, S., Bouadjenek, M. R., & Robles-Kelly, A. (2023). PERCY: A post-hoc explanation-based score for logic rule dissemination consistency assessment in sentiment classification. Knowledge-Based Systems. 275;1-18. https://doi.org/10.1016/j.knosys.2023.110685
[18] Du, K., Xing, F., & Cambria, E. (2023). Incorporating Multiple Knowledge Sources for Targeted Aspect-based Financial Sentiment Analysis. ACM Transactions on Knowledge Discovery from Data. 14(3);1-24. https://doi.org/10.1145/3580480
[19] Haque, R., Islam, N., Tasneem, M., & Das, A. K. (2023). Multi-class sentiment classification on Bengali social media comments using machine learning. International Journal of Computing and Communication Engineering. 4;21-35. https://doi.org/10.1016/j.ijcce.2023.01.001
[20] Fernández, J., Chiachío, J., Barros, J., Chiachío, M., & Kulkar, C. S. (2024). Physics-guided recurrent neural network trained with approximate Bayesian computation: A case study on structural response prognostics. Reliability Engineering & System Safety. 243;1-12. https://doi.org/10.1016/j.ress.2023.109822
[21] Mao, J., Qian, Z., & Lucas, T. (2023). Sentiment Analysis of Animated Online Education Texts Using Long Short-Term Memory Networks in the Context of the Internet of Things. IEEE Access. 11;109121-109130. https://doi.org/10.1109/ACCESS.2023.3321303
[22] Kanwal, I., Wahid, F., Ali, S., Ateeq-Ur-Rehman, Alkhayyat, A., & Al-Radaei, A. (2023). Sentiment Analysis Using Hybrid Model of Stacked Auto-Encoder-Based Feature Extraction and Long Short Term Memory-Based. IEEE Access. 11;124181-124197. https://doi.org/10.1109/ACCESS.2023.3313189
[23] Berrimi, M., Oussalah, M., Moussaoui, A., & Saidi, M. (2023). A hybrid optimization algorithm using BiLSTM structure for sentiment analysis. ACM Transactions on Asian and Low-Resource Language Information Processing. 22(4);1-26. https://doi.org/10.1145/3578265
[24] Park, J., & Seo, Y. (2023). Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit Maximization. IEEE Access. 11;44828-44841. https://doi.org/10.1109/ACCESS.2023.3273898
[25] Tan, K. L., Lee, C. P., Anbananthen, K. S. M., & Lim, K. M. (2022). RoBERTa-LSTM: A Hybrid Model for Sentiment Analysis With Transformer and Recurrent Neural Network. IEEE Access. 10;21517-21525. https://doi.org/10.1109/ACCESS.2022.3152828
[26] Tan, K. L., Lee, C. P., Lim, K. M., & Anbananthen, K. S. M. (2022). Sentiment Analysis With Ensemble Hybrid Deep Learning Model. IEEE Access. 10;103694-103704. https://doi.org/10.1109/ACCESS.2022.3210182
[27] Song, M., Park, H., & Shin, K. (2019). Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean. Information Processing & Management. 56(3);637-653. https://doi.org/10.1016/j.ipm.2018.12.005
[28] Van Houdt, G., Mosquera, C., & Nápoles, G. (2020). A review on the long short-term memory model. Artificial Intelligence Review. https://doi.org/10.1007/s10462-020-09838-1
[29] Ma, Y., Peng, H., Khan, T., Cambria, E., & Hussain, A. (2018). Sentic LSTM: a Hybrid Network for Targeted Aspect-Based Sentiment Analysis. Cognitive Computation. https://doi.org/10.1007/s12559-018-9549-x
[30] Huang, W., Rao, G., Feng, Z., & Cong, Q. (2018). LSTM with sentence representations for Document-level Sentiment Classification. Neurocomputing. https://doi.org/10.1016/j.neucom.2018.04.045
[31] Holzinger, A., Kieseberg, P., Tjoa, A. M., & Weippl, E. (2018). A Combined CNN and LSTM Model for Arabic Sentiment Analysis. Machine Learning and Knowledge Extraction. Chapter 12;179-191. https://doi.org/10.1007/978-3-319-99740-7_12
[32] Sohangir, S., Wang, D., Pomeranets, A., & Khoshgoftaar, T. M. (2018). Big Data: Deep Learning for financial sentiment analysis. Journal of Big Data. 5(1);3. https://doi.org/10.1186/s40537-017-0111-6
[33] Tamara, K., & Milicevic, N. (2018). Comparing Sentiment Analysis and Document Representation Methods of Amazon Reviews. IEEE 16th International Symposium on Intelligent Systems and Informatics (SISY). 283-286. https://doi.org/10.1109/SISY.2018.8524814
[34] Deng, D., Jing, L., Yu, J., & Sun, S. (2019). Sparse Self-Attention LSTM for Sentiment Lexicon Construction. IEEE/ACM Transactions on Audio, Speech, and Language Processing. 27(11);1777-1790. https://doi.org/10.1109/TASLP.2019.2933326
[35] Heikal, M., Torki, M., & El-Makky, N. (2018). Sentiment Analysis of Arabic Tweets using Deep Learning. Procedia Computer Science. 142;114-122. https://doi.org/10.1016/j.procs.2018.10.466
[36] Gandhi, U. D., Kumar, P. M., Babu, G. C., & Karthick, G. (2021). Sentiment Analysis on Twitter Data by Using Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM). Wireless Personal Communications. https://doi.org/10.1007/s11277-021-08580-3
[37] Shobana, J., & Murali, M. (2021). An efficient sentiment analysis methodology based on long short-term memory networks. Complex & Intelligent Systems. https://doi.org/10.1007/s40747-021-00436-4
[38] Saha, B. N., & Senapati, A. (2020). Long Short Term Memory (LSTM) based Deep Learning for Sentiment Analysis of English and Spanish Data. International Conference on Computational Performance Evaluation (ComPE). 442-446. https://doi.org/10.1109/ComPE49325.2020.9200054
[39] Qaisar, S. M. (2020). Sentiment Analysis of IMDb Movie Reviews Using Long Short-Term Memory. 2nd International Conference on Computer and Information Sciences (ICCIS). https://doi.org/10.1109/ICCIS49240.2020.9257657
[40] Af'idah, D. I., Kusumaningrum, R., & Surarso, B. (2020). Long Short Term Memory Convolutional Neural Network for Indonesian Sentiment Analysis towards Touristic Destination Reviews. International Seminar on Application for Technology of Information and Communication (iSemantic). 630-637. https://doi.org/10.1109/iSemantic50169.2020.9234210
[41] Zomato Bangalore Restaurants Dataset. Retrieved from https://www.kaggle.com/datasets/himanshupoddar/zomato-bangalore-restaurants/data
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 International Journal of Computational and Experimental Science and Engineering
This work is licensed under a Creative Commons Attribution 4.0 International License.
