Klasifikasi Skintone Menggunakan Convolutional Neural Network (CNN) untuk Mencari Persentase Kecocokan dengan Warna Pakaian
DOI:
https://doi.org/10.59024/jiti.v4i4.2703Keywords:
Clothing Color Compatibility, Convolutional Neural Network, MobileNetV2, Skin Color Analysis, Skin Tone ClassificationAbstract
.. Choosing clothing colors that complement an individual's skin tone often relies on subjective judgment. This study develops a Convolutional Neural Network (CNN)-based system to classify skin tone and calculate clothing color compatibility percentages. A modified MobileNetV2 model was trained on 2,935 facial images categorized into Light, Medium, and Dark classes. Preprocessing included augmentation, normalization, resizing, and face detection using MediaPipe. Model performance was evaluated on an independent test set obtained from Kaggle and separated from training data before model development. The model achieved 94% test accuracy. Following classification, skin color was analyzed in CIELAB and HSV color spaces. Clothing color compatibility was calculated using a weighted scoring method involving five parameters: Hue, Undertone, Value, Saturation, and LAB Distance scores. Compatibility percentages were determined using predefined color-matching criteria. The system was implemented as a web-based application displaying predicted skin tone and compatibility percentages for predefined clothing colors. These findings demonstrate the potential of combining deep learning and color analysis to support more objective and personalized clothing color recommendations.
References
Agustina, R., Magdalena, R., & Pratiwi, N. K. C. (2022). Klasifikasi kanker kulit menggunakan metode convolutional neural network dengan arsitektur VGG-16. ELKOMIKA: Jurnal Teknik Energi Elektrik, Teknik Telekomunikasi, & Teknik Elektronika, 10(2), 446–458. https://doi.org/10.26760/elkomika.v10i2.446
Aja, C., & Gebbert, B. (2019). Does black suit everyone? The fit between skin tone and clothing color. Semantic Scholar. https://api.semanticscholar.org/CorpusID:218057342
Alwanda, M. R., Ramadhan, R. P. K., & Alamsyah, D. (2020). Implementasi metode convolutional neural network menggunakan arsitektur LeNet-5 untuk pengenalan doodle. Jurnal Algoritme, 1(1), 45–56.
Anhar, A., & Putra, R. A. (2023). Perancangan dan implementasi self-checkout system pada toko ritel menggunakan convolutional neural network (CNN). ELKOMIKA: Jurnal Teknik Energi Elektrik, Teknik Telekomunikasi, & Teknik Elektronika, 11(2), 466–478. https://doi.org/10.26760/elkomika.v11i2.466
Anupama, M. M., Aditya, M., Bindu, M., Prriya, M. G. G., & Prajna, M. (2025). Colour analysis using deep learning: Automating the future of colour detection and classification. International Journal of Advanced Research in Science, Communication and Technology, 1–7.
Aryanti, W. (2023). Penerapan artificial neural network dengan algoritma backpropagation untuk memprediksi harga saham. Jurnal Riset Statistika, 3(2), 107–118.
Astiningrum, M., Mentari, M., & Maranatha, Y. G. (2019). Ekstraksi fitur citra buah salak untuk penentuan mutu buah salak menggunakan pengolahan citra digital. Dalam Seminar Informatika Aplikatif Polinema (SIAP) (hlm. 205–210).
Azmi, K., Defit, S., & Sumijan, S. (2023). Implementasi convolutional neural network (CNN) untuk klasifikasi batik tanah liat Sumatera Barat. Jurnal Unitek, 16(1), 28–40. https://doi.org/10.52072/unitek.v16i1.504
Brownlee, J., Chng, Z. M., Chung, D., Cristina, S., Saeed, M., & Tam, A. (2022). Python for machine learning: Learn Python from machine learning projects. Machine Learning Mastery.
Coleman, W., Mariwalla, K., & Grimes, P. (2023). Updating the Fitzpatrick classification: The skin color and ethnicity scale. Dermatologic Surgery, 49(8), 725–731. https://doi.org/10.1097/DSS.0000000000003860
Fadli, M., & Saputra, R. A. (2023). Klasifikasi dan evaluasi performa model random forest untuk prediksi stroke. Jurnal Teknik, 12(1), 1–8.
Fayyadhila, R., Junaidi, A., & Prasetyo, N. A. (2021). Implementasi deep learning untuk klasifikasi citra undertone menggunakan algoritma convolutional neural network. Jurnal Informatika dan Rekayasa Perangkat Lunak, 3(2), 112–119.
Fortuna, D., Tahyudin, I., & Utomo, F. S. (2024). Optimization in makeup recommendations using RGB and YCbCr analysis with CNN algorithm for skin undertone. Dalam 2024 8th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE) (hlm. 545–550). IEEE. https://doi.org/10.1109/ICITISEE63424.2024.10730153
High, W. A., & Prok, L. D. (2021). Dermatology secrets (Edisi ke-6). Elsevier.
Ide, H., & Kurita, T. (2017). Improvement of learning for CNN with ReLU activation by introducing gating mechanism. Dalam 2017 International Joint Conference on Neural Networks (IJCNN) (hlm. 1655–1662). IEEE.
Jablonski, N. G. (2006). Skin: A natural history. University of California Press.
Juanita, R. A., & Juliadi, D. (2020). Penetapan potensi tabir surya krim ekstrak etanol daun ceremai (Phyllanthus acidus L.) dengan spektrofotometri UV-Vis. Jurnal Farmagazine, 7(1), 51–58. https://doi.org/10.47653/farm.v7i1.154
Karnadi, B., & Handhayani, T. (2024). Klasifikasi jenis buah dengan menggunakan metode MobileNetV2 dan InceptionV3. Jurnal Eksplora Informatika, 14(1), 35–42. https://doi.org/10.30864/eksplora.v14i1.1067
Kusuma, T. A. A. H., Usman, K., & Saidah, S. (2021). People counting for public transportations using You Only Look Once method. Jurnal Teknik Informatika (JUTIF), 2(1), 57–66. https://doi.org/10.20884/1.jutif.2021.2.2.77
Magdalena, R., Saidah, S., Pratiwi, N. K. C., & Putra, A. T. (2021). Klasifikasi tutupan lahan melalui citra satelit SPOT-6 dengan metode convolutional neural network (CNN). Jurnal Edukasi dan Penelitian Informatika (JEPIN), 7(3), 335–342. https://doi.org/10.26418/jp.v7i3.48195
Manza, Y., Suhada, M. W. D., Ndruru, A. F. S., & Rosnelly, R. (2025). Model machine learning untuk klasifikasi warna fashion menggunakan metode K-nearest neighbor. Jurnal Komputasi dan Sistem Informasi, 4(1), 20–29.
Nair, V., & Hinton, G. E. (2010). Rectified linear units improve restricted Boltzmann machines. Dalam Proceedings of the 27th International Conference on Machine Learning (ICML) (hlm. 807–814).
Nugraha, W., & Sasongko, A. (2022). Hyperparameter tuning on classification algorithm with grid search. Sistemasi: Jurnal Sistem Informasi, 11(2), 391–401. https://doi.org/10.32520/stmsi.v11i2.1750
Nugroho, P. A., Fenriana, I., & Arijanto, R. (2020). Implementasi deep learning menggunakan convolutional neural network (CNN) pada ekspresi manusia. Algor: Jurnal Ilmiah Komputer, 2(1), 12–20.
Okta, T. (2023). Perbandingan kinerja arsitektur LeNet dan AlexNet untuk klasifikasi citra aksara Lampung [Skripsi, Universitas Lampung]. Repositori Institusi.
Perrett, D. I., & Sprengelmeyer, R. (2021). Clothing aesthetics: Consistent colour choices to match fair and tanned skin tones. i-Perception, 12(6), 1–17. https://doi.org/10.1177/20416695211053361
Prabowo, F. W., Homaidi, A., & Lutfi, A. (2024). Deteksi warna kulit menggunakan metode deep learning dengan CNN (convolutional neural network) untuk menentukan kecocokan warna kulit dan warna busana. Jurnal J-Intech, 12(1), 45–54.
Pratiwi, H. A., Cahyanti, M., & Lamsani, M. (2021). Implementasi deep learning flower scanner menggunakan metode convolutional neural network. Sebatik, 25(1), 124–130. https://doi.org/10.46984/sebatik.v25i1.1297
Rustam, F., Siddique, M. A., Siddiqui, H. U. R., Ullah, S., Mehmood, A., Ashraf, I., & Choi, G. S. (2021). Wireless capsule endoscopy bleeding images classification using CNN based model. IEEE Access, 9, 33675–33688. https://doi.org/10.1109/ACCESS.2021.3061592
Sadewa, B. A., & Yamasari, Y. (2024). Implementasi deep transfer learning untuk klasifikasi nominal uang kertas rupiah. Journal of Informatics and Computer Science (JINACS), 5(4), 543–551. https://doi.org/10.26740/jinacs.v5n04.p543-551
Tugas, M. A. F. A., Ramadhani, K. N., & Sthevanie, F. (2020). Klasifikasi ras pada kucing menggunakan algoritma convolutional neural network (CNN). e-Proceeding of Engineering, 7(2), 6523–6530.
Wardani, K. R., & Leonardi, L. (2023). Klasifikasi penyakit pada daun anggur menggunakan metode convolutional neural network. Jurnal Tekno Insentif, 17(2), 112–126. https://doi.org/10.36787/jti.v17i2.1130
Wasil, M., Dewi, P. P., & Arafah, A. P. (2022). The influence of ROA, ROE, and DER on stock price with dividend policy as an intervening variable. Indonesia Accounting Research Journal, 10(2), 48–56. https://doi.org/10.35335/iarj.v10i2.8
Downloads
Published
Issue
Section
License
Copyright (c) 2026 JURNAL ILMIAH SAINS TEKNOLOGI DAN INFORMASI
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
