Klasifikasi Sentimen Ulasan Buku Pada Platform Shopee: Studi Komparatif Naive Bayes dan SVM Dengan Pembobotan TF-IDF pada Dataset Seimbang
Article Sidebar
Main Article Content
Abstract
The surge in informal and unstructured product review data in e-commerce has become a major obstacle in manual business evaluation. This study aims to conduct a comparative study of book product review sentiment classification on the Shopee platform using the Multinomial Naive Bayes algorithm and Support Vector Machine (SVM) with a linear kernel. The dataset used consists of 1,101 reviews obtained through web scraping techniques. The sentiment class labeling procedure was carried out manually through cross-validation by three annotators based on Shopee star rating curation and textual content analysis to ensure data validity. After going through the text pre-processing (Sastrawi) stage and Term Frequency-Inverse Document Frequency (TF-IDF) feature extraction, the model was tested and its strength was evaluated using the Stratified 10-Fold Cross Validation technique. The test results showed that the SVM algorithm produced slightly superior performance with an accuracy rate of 86.47%, precision of 88.37%, and recall of 84.04%. Meanwhile, Multinomial Naive Bayes achieved 86.29% accuracy, 87.16% precision, and 85.12% recall. In conclusion, although both models demonstrated similar robustness on a balanced dataset, SVM offered a higher level of precision in addressing the specific characteristics of the book review domain, which is characterized by lengthy and informal descriptions in the digital ecosystem.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
References
Steven and I. Fenriana, “Analisis Sentimen Membandingkan Pengguna Aplikasi E-Commerce Tokopedia Dan Shopee Menggunakan Algoritma,” J. POTERS (Proceedings Technol. Eng. Comput., vol. 1, no. 1, pp. 32–39, 2025, [Online]. Available: https://jurnal.buddhidharma.ac.id/index.php/poters/article/view/3588
D. Setyowati, “Transaksi E-Commerce Pada 2024,” katadata.co.id. [Online]. Available: https://katadata.co.id/digital/e-commerce/685ba4184c37a/transaksi-belanja-online-di-indonesia-melambat-thailand-dan-malaysia-melesat
R. C. Rivaldi and T. D. Wismarini, “Analisis Sentimen Pada Ulasan Produk Dengan Metode Natural Language Processing ( NLP ),” J. Elektron. dan Komput., vol. 17, no. 1, pp. 120–128, 2024, doi: https://doi.org/10.51903/elkom.v17i1.1680.
H. Diandra Tasya, Dea Vahira Wani, Madhani Nur Syafitri, Naura Nitajria, “Menyelami Teks Ulasan Dalam Bahasa Indonesia Beserta Struktur,” J. Innov. Creat., vol. 5, no. 3, pp. 12995–12999, 2025, doi: https://doi.org/10.31004/joecy.v5i3.3972.
M. K. Shabrina Rasyid Munthe, S.Pd.I., M.S, Samsir, S.T., M. Rina Asriani Levianti, S.E., M.Ak, Dr. Basyarul Ulya, SH., M. K. Nurhanna Harahap, M.Hum, Abdul Hakim Dalimunthe, M. . M. Rusdi, S.Pd.I., M.M, Nurhabibah Ritonga, S.E., and M. K. Ibnu Rasyid Munthe, S.T., Buku Monograf Pemodelan Sentimen Dalam Ulasan Produk Dan Penerapannya Pada E-Commerce. Batu Bara, Sumatera Utara: PT. JASA NIAGA DIGITAL INDONESIA, 2025. [Online]. Available: https://jurnal.jndi.my.id/index.php/buku/article/view/339
B. I. Hasbi and I. S. Putro, “Perbandingan Kinerja Algoritma Naive Bayes Dan Support Vector Machine untuk Analisis Sentimen Ulasan Produk E- Commerce Menggunakan Pembobotan TF-IDF,” J. Ikraith-Informatika, vol. 9, no. 2, pp. 123–133, 2025, doi: https://doi.org/10.37817/ikraith-informatika.v9i2.
A. D. Wirahadi, S. Lestanti, and A. P. Kusuma, “Analisis Sentimen Terhadap Produk Kecantikan Emina Daily Matte Loose Powder di Emina Official Shop Menggunakan Metode Support Vector Machine,” J. Ekon. Manajemen, Akunt. dan Keuang., no. 1, pp. 1–10, 2026, doi: https://doi.org/10.53697/emak.v7i1.3624.
T. P. R. Sanjaya, A. Fauzi, and A. F. N. Masruriyah, “Analisis Sentimen Ulasan Pada E-Commerce Shopee Menggunakan Algoritma Naive Bayes Dan Support Vector Machine Analysis,” J. INFOTECH J. Inform. Teknol., vol. 4, no. 1, pp. 16–26, 2023, doi: 10.37373/infotech.v4i1.422.
A. Hanafiah et al., “Sentimen Analisis Terhadap Customer Review Produk Shopee Berbasis Wordcloud Dengan Algoritma Naïve Bayes Classifier,” J. INTECOMS J. Inf. Technol. Comput. Sci., vol. 6, pp. 230–236, 2023, doi: https://doi.org/10.31539/intecoms.v6i1.5845.
M. Y. Alghifari, M. R. Sanjaya, D. R. Indah, and E. L. Ruskan, “Perbandingan Algoritma Svm Dan Naive Bayes Dalam Analisis Sentimen Terhadap Ulasan Pengguna Bukalapak,” J. INOVTEK Polbeg - Seri Inform., vol. 10, no. 3, pp. 1623–1633, 2025, doi: https://doi.org/10.35314/dqhpkb12.
S. Setyabudi and E. Aryanny, “Analisis Sentimen Penilaian Pengguna Marketplace Lazada Dengan Metode Naïve Bayes Dan Support Vector Machine,” J. INOVTEK Polbeg - Seri Inform., vol. 10, no. 1, pp. 422–433, 2025, doi: https://doi.org/10.35314/sww8cg21.
F. Dikananda, A. R. Dikananda, and S. Anwar, “Analisis Sentimen Terhadap Marketplace Menggunakan Algoritma Naïve Bayes ( Studi Kasus : Lazada Indonesia ),” J. JATI, vol. 8, no. 4, pp. 8219–8225, 2024, doi: https://doi.org/10.36040/jati.v8i4.10965.
E. Indrayuni and A. Nurhadi, “Analisis Sentimen Aplikasi Tiktok Shop Seller Center Menggunakan Naive Bayes, Svm Dan Logistic Regression,” J. INTI Nusa Mandiri, vol. 20, no. 1, pp. 26–34, 2025, doi: https://doi.org/10.33480/inti.v20i1.6851.
M. R. Emiliana, M. R. I. Fata, and M. G. Adam, “Perbandingan Metode Naïve Bayes Dan Support Vector Machine Untuk Analisis Sentimen Pada Ulasan Pengguna Aplikasi X,” J. Pustaka Data, vol. 5, no. 2, pp. 331–341, 2025, doi: https://doi.org/10.55382/jurnalpustakadata.v5i2.1460.
A. Albladi, M. Islam, and C. Seals, “Sentiment Analysis of Twitter Data Using NLP Models: A Comprehensive Review,” IEEE Access, vol. 13, no. January, pp. 30444–30468, 2025, doi: 10.1109/ACCESS.2025.3541494.
K. Alahmadi, S. Alharbi, J. Chen, and X. Wang, “Generalizing Sentiment Analysis: A Review Of Progress, Challenges, And Emerging Directions,” Soc. Netw. Anal. Min., vol. 15, no. 1, p. 45, Apr. 2025, doi: 10.1007/s13278-025-01461-8.
J. Riebesell et al., “A Framework To Evaluate Machine Learning Crystal Stability Predictions,” Nat. Mach. Intell., vol. 7, no. 6, pp. 836–847, 2025, doi: 10.1038/s42256-025-01055-1.
P. Maxmiliano, Y. F. Riti, I. Y. Nugroho, and C. E. C. Juniarto, “Perbandingan Algoritma Naive Bayes Dan Bert Untuk Analisis Sentimen Ulasan Produk Shopee Berdasarkan Rating Dan Atribut Produk (Warna/Kategori),” J. Media Inform., vol. 6, no. 5, pp. 2552–2565, 2025, [Online]. Available: https://ejournal.sisfokomtek.org/index.php/jumin/article/download/6761/4284
L. Zhang, “Features Extraction Based On Naive Bayes Algorithm And TF-IDF For News Classification,” Journals Plos One, vol. 20, no. 7 July, pp. 1–17, 2025, doi: 10.1371/journal.pone.0327347.
S. U. Royan, N. Suarna, I. Ali, D. Solihudin, S. V. Machine, and S. V. Machine, “Analisis Sentimen Ulasan Produk Skincare Di Shopee Untuk Meningkatkan Kualitas Produk Menggunakan Metode Support Vector Machine,” J. Inf. Dan Komput., vol. 13, pp. 96–105, 2025, doi: https://doi.org/10.35959/jik.v13i01.656.
C. L. R. Dina Siti Nurrochmah, Nining Rahaningsih, Raditya Danar Dana, “Penerapan Algoritma Naive Bayes Dalam Analisis Sentimen Ulasan Aplikasi Kitalulus Di Google Play Store,” J. Inform. Terpadu, vol. 8, no. 1, pp. 1–7, 2022, doi: https://doi.org/10.54914/jit.v11i1.1544.
A. T. Bisono and A. Zulherry, “Analisis Sentimen Game Genshin Impact Untuk Mengetahui Reaksi Dan Harapan Pemain Menggunakan Metode Naïve Bayes,” sudo J. Tek. Inform., vol. 4, no. 2, pp. 183–193, 2025, doi: 10.56211/sudo.v4i2.1131.
S. D. Parameswari, M. Lubis, S. Suakanto, Y. Z. Ramadhan, R. N. Amanah, and R. A. Dila, “Studi Perbandingan Naïve Bayes Dan Support Vector Machine (SVM) Dalam Analisis Sentimen Pengguna Metaverse,” J. Teknol. dan Manaj. Ind. Terap., vol. 4, no. 3, pp. 1059–1065, 2025, doi: 10.55826/jtmit.v4i3.1122.
J. O. Leandro and M. I. Fianty, “Evaluation Of Sentiment Analysis Methods For Social Media Applications: A Comparison Of Support Vector Machines And Naïve Bayes,” Int. J. Informatics Vis., vol. 9, no. 2, pp. 796–807, 2025, doi: 10.62527/joiv.9.2.2905.
I. Kurniawan, A. L. Hananto, S. S. Hilabi, and A. Hananto, “Perbandingan Algoritma Naive Bayes Dan SVM Dalam Sentimen Analisis Marketplace Pada Twitter,” J. JATISI, vol. 10, no. 1, pp. 731–740, 2023, doi: https://doi.org/10.35957/jatisi.v10i1.3582.
R. Rahmat, A. Rahim, and A. Arbansyah, “Perbandingan Metode Naïve Bayes Dan Support Vector Machine Untuk Analisis Sentimen Pada Ulasan Pengguna Aplikasi Alibaba Di Google Play Store,” J. JATI, vol. 9, no. 2, pp. 3050–3057, 2025, doi: https://doi.org/10.36040/jati.v9i2.13269.