Evaluating the Efficiency of Vietnamese SMS Spam Detection Techniques
DOI:
https://doi.org/10.54654/isj.v1i18.932Keywords:
SMS Spam, Vietnamese SMS Spam, machine learning, deep learning, transfer learning, PhoBertTóm tắt
Abstract— This paper is aimed at evaluating the efficiency of Vietnamese SMS spam detection methods on different variants of Vietnamese datasets by utilizing both traditional machine learning models and deep learning models. The researchers experimented with five algorithms, which were Support Vector Machine (SVM), Naive Bayes (NB), Random Forests (RF), Convolutional Neural Network (CNN), and Long Short-Term Memory (LSTM), on three different Vietnamese datasets. The findings reveal that the LSTM and CNN, supported by a transformer learning model - PhoBert, were more efficient than the traditional machine learning models. The LSTM model showed the highest accuracy of 97,77% when operating on the full-accent Vietnamese dataset. Similarly, the CNN model and PhoBert model showed the highest accuracy of 95,56% when dealing with non-diacritic Vietnamese dataset.
Downloads
References
CTIA, “2021 Annual Survey HIGHLIGHTS,” 2021. [Online]. Available: https://www.ctia.org/news/2021-annual-survey-highlights.
Attentive, “2021 SMS Marketing Benchmarks Report,” 2021. [Online]. Available: https://www.attentivemobile.com/2021-sms-marketing-benchmarks-report. [Accessed 2022].
Shafi’I Muhammad Abdulhamid; Muhammad Shafie Abd Latiff; Haruna Chiroma; Oluwafemi Osho; Gaddafi Abdul-Salaam, “A Review on Mobile SMS Spam Filtering Techniques,” IEEE Access, vol. 5, pp. 15650 - 15666, 2017.
K. Yadav, S. K. Saha, P. Kumaraguru, and R. Kumra, “Take control of your smses: Designing an usable spam sms filtering system,” in 2012 IEEE 13th International Conference on Mobile Data Management, Bengaluru, India, 2012.
El-Alfy, E.-S.M. and AlHasan, A.A., “Spam filtering framework for multimodal mobile communication based on dendritic cell algorithm,” Future Generation Computer Systems, vol. 64, pp. 98-107, 2016.
A. Narayan and P. Saxena, “The curse of 140 characters: evaluating the efficacy of sms spam detection on android,” in Third ACM workshop on Security and privacy in smartphones & mobile devices, Berlin, Germany, 2013.
Milivoje Popovac, Mirjana Karanovic, Srdjan Sladojevic, Marko Arsenovic, Andras Anderla, “Convolutional Neural Network Based SMS Spam Detection,” in 2018 26th Telecommunications Forum (TELFOR), Belgrade, Serbia , 2018.
Gauri Jain, Manisha Sharma, Basant Agarwal , “Optimizing semantic LSTM for spam detection,” International Journal of Information Technology, vol. 11, pp. 239 - 250, 2019.
W. Gomaa, “The Impact of Deep Learning Techniques on SMS Spam Filtering,” International Journal of Advanced Computer Science and Applications, vol. 11, no. 1, pp. 544 - 549, 2020.
Aliaksandr Barushka, Petr Hajek, “Spam filtering using integrated distribution-based balancing approach and regularized deep neural networks,” Applied Intelligence , vol. 48, p. 3538–3556, 2018.
. Vu Minh Tuan, Dang Dinh Quan, Nguyen Thanh Ha, Tran Quang Anh, “Lọc tin nhắn rác với Spam-Assassin,” Journal of Science and Technology on Information and Communications, vol. 3, no. 4, pp. 34-41, 2017.
Vu Minh Tuan, Quang Anh Tran, Minh Quang Ha, Lam Bui Thu, “A Multi-objective Approach for Vietnamese Spam Detection,” in Knowledge and Systems Engineering 2013, Hanoi, 2014.
Thai Hoang Pham, Phuong Le Hong, “Content-based Approach for Vietnamese Spam SMS Filtering,” in The 20th International Conference on Asian Language , Taiwain, 2016.
R. Johnson, T. Zhang, “Supervised and semi-supervised text categorization using LSTM for region embeddings,” in The 33rd International Conference on Machine Learning, New York, 2016.
X. Zhang, J. Zhao, Y. LeCun, “Character-level convolutional networks for text classification,” in The 28th Advances in Neural Information Processing Systems, Quebec, 2015.
Kiem-Hieu Nguyen, Cheol-Young Ock, “Diacritics Restoration in Vietnamese: Letter Based vs. Syllable Based Model,” in PRICAI 2010: Trends in Artificial Intelligence, Berlin, Heidelberg, 2010.
Jakub Náplava, Milan Straka, Pavel Straňák, Jan Hajič, “Diacritics Restoration Using Neural Networks,” in the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, 2018.
Hilal Tekgöz; Halil İbrahim Çelenli; Sevinç İlhan Omurca, “Semantic Similarity Comparison of Word Representation Methods in the Field of Health,” in 2021 6th International Conference on Computer Science and Engineering (UBMK), Ankara, Turkey, 2021.
Dat Quoc Nguyen, Anh Tuan Nguyen, “PhoBERT: Pre-trained language models for Vietnamese,” in Findings of the Association for Computational Linguistics: EMNLP 2020, 2020.
G. Forman, “BNS feature scaling: an improved representation over tf-idf for svm text classification,” in Proceedings of the 17th ACM conference on Information and knowledge management, Napa Valley California USA, 2008.
J.A.K. Suykens; J. Vandewalle , “Least Squares Support Vector Machine Classifiers,” Neural Processing Letters , vol. 9, pp. 293 - 300, 1999.
George H. John, Pat Langley, “Estimating Continuous Distributions in Bayesian Classifiers,” in Eleventh Conference on Uncertainty in Artificial Intelligence (UAI1995), Quebec, Canada, 1995.
L. Breiman, “Random Forests,” Machine Learning volume , vol. 45, no. 1, pp. 5-32, 2001.
Downloads
Published
How to Cite
Issue
Section
License
Proposed Policy for Journals That Offer Open Access
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Proposed Policy for Journals That Offer Delayed Open Access
Authors who publish with this journal agree to the following terms:
1. Authors retain copyright and grant the journal right of first publication, with the work [SPECIFY PERIOD OF TIME] after publication simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
