A Chatbot-Based Expert System for Supporting Conceptual Understanding in DC Circuit Analysis: Development and Evaluation in Electrical Engineering Education

Authors

  • Benny Haposan Sianipar Universitas Negeri Padang, Indonesia
  • Alifah Bigum Nabila Universitas Negeri Padang, Indonesia
  • Usmeldi Usmeldi Universitas Negeri Padang, Indonesia
  • Rahmiati Rahmiati Universitas Negeri Padang, Indonesia

DOI:

https://doi.org/10.35445/alishlah.v18i3.9817

Keywords:

expert system, chatbot, DC circuit analysis, learning outcomes, artificial intelligence in education

Abstract

This study addresses the limited development of chatbot-based expert systems that integrate rule-based reasoning and conceptual guidance for direct current (DC) circuit analysis learning in electrical engineering education. The study aimed to develop and evaluate a chatbot-based expert system designed to support students’ conceptual understanding of DC circuit analysis. A Research and Development (R&D) approach employing the 4D model (Define, Design, Develop, Disseminate) was applied in this study. The effectiveness evaluation used a one-group pretest–posttest design involving 25 undergraduate students from an Electrical Engineering Education program. The developed system was validated by one electrical engineering expert and two educational media experts before implementation. The validation results showed high validity across all evaluated aspects, with Aiken’s V values categorized as very valid. The practicality test indicated that the system was highly practical, achieving a mean score of 4.32 out of 5.00 (86.3%). The effectiveness test showed improvement in students’ learning outcomes, reflected by a normalized gain (N-gain) score of 0.32 in the moderate category. In addition, the paired sample t-test demonstrated a statistically significant difference between pretest and posttest scores (p < 0.001). Although the study was conducted with a limited sample and without a control group, the findings indicate that the chatbot-based expert system showed potential to support students’ conceptual understanding and procedural learning in DC circuit analysis. This study contributes to the development of AI-assisted learning media in vocational and engineering education, particularly in supporting interactive and concept-oriented learning environments.

References

Alemdag, E. (2025). The effect of chatbots on learning: A meta-analysis of empirical research. Journal of Research on Technology in Education, 57(2), 459–481. https://doi.org/10.1080/15391523.2023.2255698

Baidoo-Anu, D., & Owusu Ansah, L. (2023). Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Journal of AI, 7(1), 52–62. https://doi.org/10.61969/jai.1337500

Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4, Article 100118. https://doi.org/10.1016/j.caeai.2022.100118

Deng, X., & Yu, Z. (2023). A meta-analysis and systematic review of the effect of chatbot technology use in sustainable education. Sustainability, 15(3), Article 2940. https://doi.org/10.3390/su15032940

Engelhardt, P. V., & Beichner, R. J. (2004). Students’ understanding of direct current resistive electrical circuits. American Journal of Physics, 72(1), 98–115. https://doi.org/10.1119/1.1614813

Giarratano, J. C., & Riley, G. D. (2005). Expert systems: Principles and programming (4th ed.). Thomson Course Technology.

Habibi, A., Muhaimin, M., Kopong, B., Gusti, Y., Wahyuni, S., & Octavia, A. (2023). ChatGPT in higher education learning: Acceptance and use. Computers and Education: Artificial Intelligence, 5, Article 100190. https://doi.org/10.1016/j.caeai.2023.100190

Jackson, P. (1999). Introduction to expert systems (3rd ed.). Addison-Wesley.

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2022). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28, 973–1018. https://doi.org/10.1007/s10639-022-11177-3

Laun, M., & Wolff, F. (2025). Chatbots in education: Hype or help? A meta-analysis. Learning and Individual Differences, 119, Article 102646. https://doi.org/10.1016/j.lindif.2025.102646

Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, Article 100033. https://doi.org/10.1016/j.caeai.2021.100033

Ouyang, F., Zheng, L., Jiao, P., & Zhu, Y. (2022). Artificial intelligence in online higher education: A systematic review of empirical research from 2011 to 2020. Education and Information Technologies, 27(6), 7893–7925. https://doi.org/10.1007/s10639-022-10925-9

Pérez-Marín, D. (2021). A review of the practical applications of pedagogic conversational agents to be used in school and university classrooms. International Journal of Interactive Multimedia and Artificial Intelligence, 7(4), 18–33.

Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers & Education, 151, Article 103862. https://doi.org/10.1016/j.compedu.2020.103862

Thiagarajan, S., Semmel, D. S., & Semmel, M. I. (1974). Instructional development for training teachers of exceptional children: A sourcebook. Indiana University.

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel? ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, Article 15. https://doi.org/10.1186/s40561-023-00237-x

Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Drachsler, H., & Specht, M. (2021). Are we there yet? A systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4, Article 654924. https://doi.org/10.3389/frai.2021.654924

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education—Where are the educators? International Journal of Educational Technology in Higher Education, 16, Article 39. https://doi.org/10.1186/s41239-019-0171-0

Additional Files

Published

2026-08-03

How to Cite

Sianipar, B. H., Nabila, A. B., Usmeldi, U., & Rahmiati, R. (2026). A Chatbot-Based Expert System for Supporting Conceptual Understanding in DC Circuit Analysis: Development and Evaluation in Electrical Engineering Education. AL-ISHLAH: Jurnal Pendidikan, 18(3). https://doi.org/10.35445/alishlah.v18i3.9817

Issue

Vol. 18 No. 3 (2026): In Progress September 2026

Section

Articles

Citation Check

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.