Smart Academic Chatbot for Student Information Services Based on Transformer-Fine Tuning

Muhammad Nazwan; Ananda  Hilmy; Azua  Ramadhan; Fernandi Lucky  Putra; Natasya Nur  Hadi; I Gusti Bagus Agung  Dharmaya; Mhd Adi Setiawan Aritonang; Deosa Putra  Caniago

doi:10.58520/jddat.v5i2.88

Authors

Muhammad Nazwan Institut Teknologi Batam
Ananda Hilmy Institut Teknologi Batam
Azua Ramadhan Institut Teknologi Batam
Fernandi Lucky Putra Institut Teknologi Batam
Natasya Nur Hadi Institut Teknologi Batam
I Gusti Bagus Agung Dharmaya Institut Teknologi Batam
Mhd Adi Setiawan Aritonang Institut Teknologi Batam
Deosa Putra Caniago Institut Teknologi Batam

DOI:

https://doi.org/10.58520/jddat.v5i2.88

Keywords:

Academic Chatbot, Transformer, Fine-Tuning, Natural Language Processing, Student Information Service

Abstract

This research developed a Transformer-based Smart Academic Chatbot using the fine-tuning method to generate more accurate responses tailored to students' needs. The development process follows the Waterfall model, starting from the collection of academic question-answer data, pre-processing, architecture design, to implementation and testing. The evaluation results show that the chatbot is able to provide relevant answers with a good level of accuracy, as well as improve the ease of access to academic information. This system has the potential to be a smart solution in supporting the digital transformation of campus academic services.

References

S. Hadid, U. Ramadhani, S. D. Suari, dan A. G. E. Putri, “Analisis Dampak Penggunaan Chatbot AI Dalam Pembelajaran di Kalangan Mahasiswa PGSD Universitas Jambi,” JUPITER, vol. 2, no. 3, pp. 160–166, 2024.

A. Basri dan Ernawati, “Pemanfaatan Chatbot AI Untuk Mendukung Penyelesaian Tugas Akademik Mahasiswa Matematika: Studi Kasus Universitas Muslim Maros,” Prosiding Seminar Nasional FKIP Universitas Muslim Maros, vol. 2, no. 1, pp. 55–60, 2025.

H. P. Tarigan, “Integrasi Chatbot Berbasis NLP pada Sistem Layanan Akademik Universitas,” Jurnal Komputer, vol. 3, no. 1, pp. 13–18, 2024.

F. Sánchez-Vera, “Subject-Specialized Chatbot in Higher Education as a Tutor for Autonomous Exam Preparation: Analysis of the Impact on Academic Performance and Students’ Perception of Its Usefulness,” Education Sciences, vol. 15, no. 1, p. 26, 2025.

Y. Xu, J. Zhu, M. Wang, F. Qian, Y. Yang, dan J. Zhang, “The Impact of a Digital Game-Based AI Chatbot on Students’ Academic Performance, Higher-Order Thinking, and Behavioral Patterns in an IT Curriculum,” Applied Sciences, vol. 14, no. 6418, 2024.

Alvin, A., Robet, R., & Tarigan, F. A. (2025). Implementasi Chatbot Otomatis Akademik Berbasis Web Menggunakan LLM dan Rule-Based System (Studi Kasus: STMIK Time). JIKO (Jurnal Informatika dan Komputer), 9(3), 651–665. https://doi.org/10.26798/jiko.v9i3.2209

Anwar, S. H., Abouaish, K. M., Matta, E. M., Farouq, A. K., Ahmed, A. A., & Negied, N. K. (2024). Academic Assistance Chatbot – A Comprehensive NLP and Deep Learning-based Approaches. Indonesian Journal of Electrical Engineering and Computer Science, 33(2), 1042–1056. https://doi.org/10.11591/ijeecs.v33.i2.pp1042-1056

Fahmi Ajiz, M., Ramadan, M. F. S., Mutia, H. D., & Yanuari, P. D. (2023). Pengembangan Aplikasi Chatbot Informasi Akademik Berbasis Web Menggunakan Metode Artificial Intelligence Markup Language (AIML). Media Jurnal Informatika, 15(2), 143–148. https://doi.org/10.35194/mji.v15i2.3316

Salsabila, S., & Sohidin. (2024). Pemahaman Etika Akademik Mahasiswa dalam Penggunaan Artificial Intelligence (AI). Journal of Education Research, 5(4), 6671–6680.

Wicaksono, D., Salim, D. J. N., & Almeyda, D. P. (2024). Pengembangan Layanan dan Pengenalan Akademik di Lingkungan Kampus Berbasis Aplikasi Chatbot bagi Calon Mahasiswa Baru. Jurnal Komtika (Komputasi dan Informatika), 8(1), 1–12. https://doi.org/10.31603/komtika.v8i1.11164

Ajlouni, A. O., Abu-Shawish, R. K., Silim, D. M., & Ibrahim, A. H. (2024). The Academic Intensity Use of Chatbot-Based Artificial Intelligence and Its Relation to Academic Well-Being: A Correlational Study at the University of Jordan. International Journal of Engineering Pedagogy (iJEP), 14(8), 72–87. https://doi.org/10.3991/ijep.v14i8.50339

Kumar, S., Paikar, D., Vutukuri, K. S., Ali, H., Ainala, S. R., Krishnan, A. M., & Zhang, Y. (2024). KatzBot: Revolutionizing Academic Chatbot for Enhanced Communication. arXiv preprint, arXiv:2410.16385. https://arxiv.org/abs/2410.16385

Ferelestian, V. J., Susanto, B., & Senapartha, I. K. D. (2023). Pengembangan Telegram Chatbot Informasi Mahasiswa Menggunakan Wit.ai. Jurnal Teknik Informatika (JUTEI), 7(2), 89–97. https://doi.org/10.21460/jutei.72.257

Dzaky, A. A., Zeniarja, J., Supriyanto, C., Shidik, G. F., Paramita, C., Subhiyakto, E. R., & Rakasiwi, S. (2024). Optimization Chatbot Services Based on DNN-BERT for Mental Health of University Students. Journal of Applied Informatics and Computing (JAIC), 8(1), 13–21. https://jurnal.polibatam.ac.id/index.php/JAIC

Arumsari, D., Kharisma, & Aesyi, U. S. (2024). Sistem Chatbot Layanan Informasi Mahasiswa Menggunakan Algoritma Long Short-Term Memory. Indonesian Journal on Data Science, 2(2), 77–86. https://ejournal.unjaya.ac.id/index.php/ijds

Sheplyakov, A. S., et al. “Using chatbot application ‘Telegram’ to improve functional fitness, physical fitness and academic performance of students.” BIO Web of Conferences, 2024.

Astuti, W., et al. “DIET Classifier Model Analysis for Words Prediction in Academic Chatbot.” ILKOM Jurnal Ilmiah, Vol.16 No.1, 2024.

Sinaga, A. J. N., et al. “Adoption of Artificial Intelligence Chatbot Technology in Academic Activities of Jakarta Students: Ease of Use.” 2024.

Dawood, M. N. “Technology-Driven Academic Advising: A Faculty Case Study on Chatbot Integration in The College of Technological Innovation.” IOSR-JCE, Vol.26 Issue 6, 2024.

Buraphadeja, V., & Chantokul, D. “Supporting Student Engagement and Academic Guidance through a Chatbot in Blended Learning.” International Journal on E-Learning, 2024