Pendidikan Matematika Inklusif untuk Siswa Tunarungu: Pengembangan Model YOLO Ringan untuk Deteksi Operator Aritmetika Dua Tangan
DOI:
https://doi.org/10.59024/jiti.v4i3.2165Keywords:
Deaf Students, Inclusive Mathematics Education, Real-Time Recognition, Two-Handed Arithmetic Operators, YOLO26Abstract
This study presents a real-time recognition system for two-handed arithmetic operators (Plus, Minus, Multiply, Divide) to support inclusive mathematics education for deaf students. Utilizing the YOLO26 architecture, the research evaluates four configurations—Nano and Small variants at 640px and 720px resolutions—trained on a newly developed private dataset of 2,828 images. Experimental results demonstrate exceptional accuracy, with all configurations achieving mAP50 scores above 0.99. The YOLO26-s variant at 720px provided the highest precision (0.9842), while benchmarking on a local GTX 1650 GPU confirmed real-time viability with frame rates reaching up to 88 FPS. Even when deployed on a mobile CPU (i5-12500H), the lightweight Nano models maintained a functional execution speed of 23 FPS. These findings confirm that optimized deep learning models can accurately interpret complex mathematical gestures on consumer-grade hardware. Ultimately, this lightweight framework successfully bypasses heavy skeletal tracking overhead, providing a highly robust and accessible foundation for interactive digital educational media.
References
Artha, I. K. B. D., Arthana, I. K. R., & Suputra, P. H. (2025). Pengembangan model long short-term memory berbasis MediaPipe Pose untuk klasifikasi dan penilaian gerakan push-up. JUTISI: Jurnal Ilmiah Teknik Informatika dan Sistem Informasi, 14(3), 2106. https://doi.org/10.35889/jutisi.v14i3.3363
Cahya, N., & Fazriyah, R. (2023). Learning methods based on deaf children's learning styles. ALACRITY: Journal of Education, 3. http://lpppipublishing.com/index.php/alacrity
Casas, E., Ramos, L., Bendek, E., & Rivas-Echeverria, F. (2023). Assessing the effectiveness of YOLO architectures for smoke and wildfire detection. IEEE Access, 11, 108451–108469. https://doi.org/10.1109/ACCESS.2023.3312217
Fitriyani, F. N. C. R. F. (2024). Learning methods based on deaf children's learning styles. ALACRITY: Journal of Education. https://doi.org/10.52121/alacrity.v3i3.202
Gunaya, I. W., Kesiman, M. W. A., & Suputra, P. H. (2025). Indonesian sign language (BISINDO) recognition using long short-term memory method. Proceedings of the 2025 International Conference on Computer System, Information Technology, and Electrical Engineering (COSITE 2025), 256–261. https://doi.org/10.1109/COSITE68330.2025.11414365
Hidayat, A. T., Sunarya, I. M. G., Andisana, S. P. G., Smrti, E. N., Wahyu Erlangga, G. A. S., & lainnya. (2026). Perbandingan performa model CNN pada klasifikasi biji kopi dengan citra berbasis conditional lightweight GAN. Jurnal Pendidikan Teknologi dan Kejuruan, 23(1).
Hussain, M. (2023). YOLO-v1 to YOLO-v8, the rise of YOLO and its complementary nature toward digital manufacturing and industrial defect detection. Machines, 11(7), 677. https://doi.org/10.3390/machines11070677
Ilmi, N., & Suryoprayogo, H. (2022). Pengenalan angka bahasa isyarat dengan menggunakan local directional pattern dan klasifikasi k-nearest neighbour. Journal of Informatics and Communication Technology (JICT), 4(1). https://doi.org/10.52661/j_ict.v4i1.103
Kesiman, M. W. A., Maysanjaya, I. M. D., Pradnyana, I. M. A., Sunarya, I. M. G., & Suputra, P. H. (2020). Profiling Balinese dances with silhouette sequence pattern analysis. Proceedings of the International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM 2020), 423–428. https://doi.org/10.1109/CENIM51130.2020.9297893
Kesiman, M. W. A., Sunarya, I. M. G., & Sumantara, I. G. L. T. (2024). Comparative analysis of CNN methods for periapical radiograph classification. Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 13(2), 204–214. https://doi.org/10.23887/janapati.v13i2.71664
Khasawneh, M. A. S. (2023). The use of video as media in distance learning for deaf students. Contemporary Educational Technology, 15(2). https://doi.org/10.30935/cedtech/13012
Lin, H. Y., Tu, K. C., & Li, C. Y. (2020). VAID: An aerial image dataset for vehicle detection and classification. IEEE Access, 8, 212209–212220. https://doi.org/10.1109/ACCESS.2020.3040290
Liu, L., Blancaflor, E. B., & Abisado, M. (2023). A lightweight multi-person pose estimation scheme based on Jetson Nano. Applied Computer Science, 19(1). https://doi.org/10.35784/acs-2023-01
Made, I. P. P., Indradewi, I. G. A. A. D., & Suputra, P. H. (2025). Pengenalan kata Kolok secara real time menggunakan MediaPipe dan algoritma long short-term memory (LSTM). SINTECH Journal. https://doi.org/10.31598
Muñoz Galindez, J. A., Villota Coral, L. V., & Vargas Cañas, R. (2025). The dynamic Colombian sign language dataset for basic conversation LSC70. Data in Brief, 58, 111213. https://doi.org/10.1016/j.dib.2024.111213
Natesan, B., Liu, C. M., Ta, V. D., & Liao, R. (2023). Advanced robotic system with keypoint extraction and YOLOv5 object detection algorithm for precise livestock monitoring. Fishes, 8(10), 524. https://doi.org/10.3390/fishes8100524
Natih, I. D. G. A. W., Kesiman, M. W. A., & Sunarya, I. M. G. (2025). Analisis perbandingan arsitektur dan optimizer YOLOv11 untuk estimasi buah kelapa. RIGGS: Journal of Artificial Intelligence and Digital Business, 4(4), 12–19. https://doi.org/10.31004/riggs.v4i4.3329
Ni Made Rai Wisudariani, Sriasih, S. A. P., Adnyani, N. L. P. S., Suarcaya, P., & Saputra, N. P. H. (2023). Papalisi sebagai wahana edukasi literasi di SD Negeri 2 Bengkala. Prosiding Senadimas 2023. https://conference.undiksha.ac.id/senadimas/2023/prosiding/file/138.pdf
Ridha, S., Ngasimurrohman, M., Ulfaini, R., Ekarini, A., & Ibrahim. (2020). Problematika siswa difabel rungu dalam pembelajaran matematika di sekolah inklusi. JPM UIN Antasari, 7(1), 8–18.
Sukma Dewi, N. P. D. A., Kesiman, M. W. A., Sunarya, I. M. G., & Indradewi, I. G. A. A. D. (2023). Classification of Balinese herbal plant leaf using convolutional neural network. 2023 10th International Conference on Advanced Informatics: Concept, Theory and Application (ICAICTA 2023). https://doi.org/10.1109/ICAICTA59291.2023.10390503
Terven, J., Córdova-Esparza, D. M., & Romero-González, J. A. (2023). A comprehensive review of YOLO architectures in computer vision: From YOLOv1 to YOLOv8 and YOLO-NAS. Machine Learning and Knowledge Extraction, 5(4), 1680–1716. https://doi.org/10.3390/make5040083
Downloads
Published
Issue
Section
License
Copyright (c) 2026 JURNAL ILMIAH SAINS TEKNOLOGI DAN INFORMASI
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
