Digital Learning Management using OpenAI ChatGPT: A Systematic Literature Review


  • M. Shoffa Saifillah Al Faruq
  • Ahmad Sunoko
  • Hamidulloh Ibda
  • Khairul Wahyudi


Digital Learning Management; OpenAI ChatGPT; Systematic Literature Review


Several studies have investigated digital learning management, but few did so, using OpenAI ChatGPT together with a systematic literature review. The research reported here, aimed to explore the current literature related to the concept, use, and impact of OpenAI ChatGPT. The Systematic Literature Review (SLR) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methods were applied in this research with the stages of identification, screening, eligibility, and inclusion assisted by the Publish or Perish 7, VOSviewer 1.6.18, and NVIVO 12 Plus applications. The findings of Scopus-indexed articles amounted to 2,852 pieces which were filtered into 51 pieces according to themes. The 51 articles were analysed according to the specified topics through the NVIVO 12 Plus application, and the results are presented here. The findings indicate that digital learning management is an online-based learning management system, e-learning, using LMS, AI, and ChatGPT in learning activities from elementary school to university. ChatGPT fosters academic performance, text preparation, curriculum development, compiling academic papers and texts, answering cross-cutting problems, assisting research, assisting educational administration, and using assessment tools in medical education. ChatGPT has positive and negative impacts of which the education community must take cognisance. Thus, future research needs to explore digital learning management based on OpenAI ChatGPT in various cross-disciplines and from various perspectives for comparative results and triangulation.


Abdullah, A. & Omar, M. (2022). Integrated Learning Management During Pandemic. Journal of Research in Educational Management, 1(1).

Ahmad, A. Q., Jawad, M. A. & Jaber, K. M. (2022). E-learning issues and solutions for students with disabilities during COVID-19 pandemic: Al-Zaytoonah University of Jordan case study. International Journal of Evaluation and Research in Education, 11(4), 2087–2094.

Akour, M. & Alenezi, M. (2022). Higher Education Future in the Era of Digital Transformation. Education Sciences, 12(784), 1–13.

Alnaqbi, N. M. & Fouda, W. (2023). Exploring the role of ChatGPT and social media in enhancing student evaluation of teaching styles in higher education using neutrosophic sets. International Journal of Neutrosophic Science, 20(4), 181–190.

Ausat, A. M. A., Massang, B., Efendi, M., Nofirman, N. & Riady, Y. (2023). Can Chat GPT replace the role of the teacher in the classroom: A fundamental analysis. Journal on Education, 5(4).

Baduge, S. K., Thilakarathna, S., Perera, J. S., Arashpour, M., Sharafi, P., Teodosio, B., Shringi, A. & Mendis, P. (2022). Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications. Automation in Construction, 141(June), 104440.

Bitzenbauer, P. (2023). ChatGPT in physics education: A pilot study on easy-to-implement activities. Contemporary Educational Technology, 15(3).

Castonguay, A., Farthing, P., Davies, S. L., Vogelsang, L., Manal, K., Risling, T. & Green, N. (2023). Revolutionizing nursing education through AI integration: A reflection on the disruptive impact of ChatGPT. Nurse Education Today, 129(October).

Chaka, C. (2023). Generative AI Chatbots: - ChatGPT versus YouChat versus Chatsonic: Use Cases of Selected Areas of Applied English Language Studies. International Journal of Learning, Teaching and Educational Research, 22(6), 1–19.

Chamorro-Atalaya, O., Olivares-Zegarra, S., Sobrino-Chunga, L., Guerrero-Carranza, R., Vargas-Diaz, A., Huarcaya-Godoy, M., Rasilla-Rovegno, J., Suarez-Bazalar, R., Poma-Garcia, J. & Cruz-Telada, Y. (2023). Application of the Chatbot in University Education: A Bibliometric Analysis of Indexed Scientific Production in SCOPUS, 2013-2023. International Journal of Learning, Teaching and Educational Research, 22(7), 281–304.

Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20(1).

Chan, C. K. Y. & Tsi, L. H. Y. (2023). The AI Revolution in Education: Will AI Replace or Assist Teachers in Higher Education? Computer Science, 1(2 May).

Chang, D. H., Lin, M. P. C., Hajian, S. & Wang, Q. Q. (2023). Educational Design Principles of Using AI Chatbot that Supports Self-Regulated Learning in Education: Goal Setting, Feedback, and Personalization. Sustainability, 15.

Chiu, T. K. F. (2023). The impact of Generative AI (GenAI) on practices, policies and research direction in education: A case of ChatGPT and Midjourney. Interactive Learning Environments, 1–17.

Cooper, G. (2023). Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence. Journal of Science Education and Technology, 32(1), 444–452.

Costello, E. (2023). ChatGPT and the Educational AI Chatter: Full of Bullshit or Trying to Tell Us Something? Postdigital Science and Education.

Curtis, N. (2023). To ChatGPT or not to ChatGPT? The Impact of Artificial Intelligence on Academic Publishing. The Pediatric Infectious Disease Journal, 42(4).

Dampson, D. G., Addai-Mununkum, R., Apau, S. K. & Bentil, J. (2020). COVID-19 and Online Learning: A SWOT Analysis of Users' Perspectives on Learning Management System of University of Education, Winneba, Ghana. International Journal of Learning, Teaching and Educational Research, 19(9).

Daza, A., Robles, W. F. P. & Jiménez, J. A. S. (2023). The Impact of Chatbots on Customer Satisfaction: A Systematic Literature Review. TEM Journal, 12(3).

De-Winter, J. C. F. (2023). Can ChatGPT Pass High School Exams on English Language Comprehension? International Journal of Artificial Intelligence in Education.

Dergaa, I., Chamari, K., Zmijewski, P. & Saad, H. Ben. (2023). From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615–622.

Emenike, M. E. & Emenike, B. U. (2023). Was This Title Generated by ChatGPT? Considerations for Artificial Intelligence Text-Generation Software Programs for Chemists and Chemistry Educators. Journal of Chemical Education, 100.

Farrokhnia, M., Banihashem, S. K., Noroozi, O. & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1–15.

Fergus, S., Botha, M. & Ostovar, M. (2023). Evaluating Academic Answers Generated Using ChatGPT. Journal of Chemical Education, 100.

Fiialka, S., Kornieva, Z. & Honcharuk, T. (2023). ChatGPT in Ukrainian Education: Problems and Prospects. International Journal of Emerging Technologies in Learning (IJET), 18(17), 236–250.

Firaina, R. & Sulisworo, D. (2023). Exploring the Usage of ChatGPT in Higher Education: Frequency and Impact on Productivity. Buletin Edukasi Indonesia /, 3(1).

Firat, M. (2023). What ChatGPT means for universities: Perceptions of scholars and students. Journal of Applied Learning & Teaching, 6(1).

Fuchs, K. & Aguilos, V. (2023). Integrating Artificial Intelligence in Higher Education: Empirical Insights from Students about Using ChatGPT. International Journal of Information and Education Technology., 13(9), 1365–1371.

Gaber, S. A., Shahat, H. A., Alkhateeb, I. A., Hasan, S. A. Al, Alqatam, M. A., Almughyirah, S. M. & Kamel, M. keshar. (2023). Faculty Members’ Awareness of Artificial Intelligence and Its Relationship to Technology Acceptance and Digital Competencies at King Faisal University. International Journal of Learning, Teaching and Educational Research, 22(7).

Grassini, S. (2023). Shaping the Future of Education: Exploring the Potential and Consequences of AI and ChatGPT in Educational Settings. Education Sciences, 13(7).

Guo, T., Yu, K., Aloqaily, M. & Wan, S. (2022). Constructing a prior-dependent graph for data clustering and dimension reduction in the edge of AIoT. Future Generation Computer Systems, 128, 381–394.

Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2).

Haman, M. & Školník, M. (2023). Using ChatGPT to conduct a literature review. Accountability in Research.

Hashim, M., Ashmel, M., Tlemsani, I. & Matthews, R. (2022). Higher education strategy in digital transformation. Education and Information Technologies, 27(3), 3171–3195.

Holmes, W., Iniesto, F., Anastopoulou, S. & Boticario, J. G. (2023). Stakeholder Perspectives on the Ethics of AI in Distance-Based Higher Education. The International Review of Research in Open and Distributed Learning, 24(2).

Ibda, H., Al-Hakim, M. F., Saifuddin, K., Khaq, Z. & Sunoko, A. (2023). E-sports Games in Elementary School: A Systematic Literature Review. JOIV : International Journal on Informatics Visualization, 7(2).

Ibda, H., Syamsi, I. & Rukiyati, R. (2023). Professional elementary teachers in the digital era: A systematic literature review. International Journal of Evaluation and Research in Education, 12(1).

Kaddoura, S., Popescu, D. E. & Hemanth, J. D. (2022). A systematic review on machine learning models for online learning and examination systems. Peer J Computer Science, 8(Ml), 1–32.

Karakose, T. (2023). The Utility of ChatGPT in Educational Research -Potential Opportunities and Pitfalls. Educational Process: International Journal, 12(2), 7–13.

Keiper, M. C., Fried, G., Lupinek, J. & Nordstrom, H. (2023). Artificial intelligence in sport management education: Playing the AI game with ChatGPT. Journal of Hospitality, Leisure, Sport and Tourism Education, 33.

Khaddage, F. & Flintoff, K. (2023). Say Goodbye to Structured Learning ChatGPT in Education: Is it a Threat or an Opportunity? Society for Information Technology & Teacher Education International Conference, Mar 13.

Khan, R. A., Jawaid, M., Khan, A. R. & Sajjad, M. (2023). ChatGPT-Reshaping medical education and clinical management. Pakistan Journal of Medical Sciences, 39(2), 605–607.

Kitchenham. (2007). Guidelines for Performing Systematic Literature Reviwes in Software engineering. Elsiver.

Koc, E., Hatipoglu, S., Kivrak, O., Celik, C. & Koc, K. (2023). Houston, we have a problem! The use of ChatGPT in responding to customer complaints. Technology in Society, 74(August).

Korkmaz, A., Aktürk, C. & Talan, T. (2023). Analysing the User’s Sentiments of ChatGPT Using Twitter Data. Iraqi Journal for Computer Science and Mathematics, 14(2).

Li, Jianning, Dada, A., Kleesiek, J, & Egger, J. (2023). ChatGPT in Healthcare: A Taxonomy and Systematic Review. Medrxiv: The Preprint Server for Health Sciences.

Li, Joey, Herdem, M. S., Nathwani, J. & Wen, J. Z. (2022). Methods and applications for Artificial Intelligence, Big Data, Internet of Things, and Blockchain in smart energy management. Energy and AI, 11(January).

Lin, P. (2023). ChatGPT: Friend or foe (to corpus linguists)? Applied Corpus Linguistics, 3(3).

Lo, C. K. (2023). What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature. Education Sciences, 13(410).

Loh, H. W., Ooi, C. P., Seoni, S., Barua, P. D., Molinari, F. & Acharya, U.R. (2022). Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011–2022). Computer Methods and Programs in Biomedicine, 226(10).

Ma’arif, S., Ibda, H., Ahmadi, F., Qosim, N. & Muanayah, N. A. (2023). Islamic moderation in education and the phenomenon of cyberterrorism: a systematic literature review. Indonesian Journal of Electrical Engineering and Computer Science (IJEECS), 31(3).

Moldt, J. A., Festl-Wietek, T., Madany Mamlouk, A., Nieselt, K., Fuhl, W. & Herrmann-Werner, A. (2023). Chatbots for future docs: exploring medical students’ attitudes and knowledge towards artificial intelligence and medical chatbots. Medical Education Online, 28(1).

Mondal, H., Mondal, S. & Podder, I. (2023). Using ChatGPT for Writing Articles for Patients’ Education for Dermatological Diseases: A Pilot Study. Indian Dermatology Online Journal, 14.

Montenegro-Rueda, M., Fernández-Cerero, J., Fernández-Batanero, J. M. & López-Meneses, E. (2023). Impact of the Implementation of ChatGPT in Education: A Systematic Review. Computers, 12(8).

Moorhouse, B. L., Li, Y. & Walsh, S. (2023). E-Classroom Interactional Competencies: Mediating and Assisting Language Learning During Synchronous Online Lessons. RELC Journal, 54(1), 114–128.

Muñoz, S. A. S., Gayoso, G. G., Huambo, A. C., Tapia, R. D. C., Incaluque, J. L., Aguila, O. E. P., Cajamarca, J. C. R., Acevedo, J. E. R., Rivera, H. V. H. & Arias-Gonzáles, J. L. (2023). Examining the Impacts of ChatGPT on Student Motivation and Engagement. Przestrzen Spoleczna, 1.

Ng, D. T. K., Ching, A. C. H. & Law, S. W. (2023). Online learning in management education amid the pandemic: A bibliometric and content analysis. The International Journal of Management Education, 21(23).

Nichols, T. (2017). The Death of Expertise: The Campaign against Established Knowledge and Why it Matters. Oxford University Press.

O’Connor, Siobhan, Wang, Y., Cooke, S., Ali, A., Kennedy, S., Lee, J. J. & Booth, R. G. (2023). Designing and delivering digital learning (e-Learning) interventions in nursing and midwifery education: A systematic review of theories. Nurse Education in Practice, 69(May).

O’Connor, Siobhán, Yan, Y., Thilo, F. J. S., Felzmann, H., Dowding, D. & Lee, J. J. (2022). Artificial intelligence in nursing and midwifery: A systematic review. Journal of Clinical Nursing, July.

Pan, Y. & Zhang, L. (2023). Integrating BIM and AI for Smart Construction Management: Current Status and Future Directions. Archives of Computational Methods in Engineering, 30, 1081–1110.

Panthier, C. & Gatinel, D. (2023). Success of ChatGPT, an AI language model, in taking the French language version of the European Board of Ophthalmology examination: A novel approach to medical knowledge assessment. Journal Francais d’Ophtalmologie, 46(7), 706–711.

Pari-Bedoya, I. N. M. de la A., Vargas-Murillo, A. R., Palacios, R. J., Guevara-Soto, F. de J. & Ypanaque-Pereira, I. L. (2023). Smart Learning in Virtual Worlds: A Systematic Literature Review on the Usage and Applications of Metaverse in Education. International Journal of Learning, Teaching and Educational Research, 22(9).

Pattyn, F. (2023). Preliminary Structured Literature Review Results Using ChatGPT: Towards a Pragmatic Framework for Product Managers at Software Startups. 2023 IEEE 31st International Requirements Engineering Conference Workshops (REW).

Pradana, M., Elisa, H. P. & Syarifuddin, S. (2023). Discussing ChatGPT in education: A literature review and bibliometric analysis. Cogent Education, 10(2).

Prahani, B. K., Imah, E. M., Maureen, I. Y., Rakhmawati, L. & Saphira, H. V. (2023). Trend and Visualization of Artificial Intelligence Research in the Last 10 Years. TEM Journal, 12(2).

Prananta, A. W., Susanto, N., Purwantoro, A. & Fuadah, N. (2023). ChatGPT Artificial Intelligence Integration in Science Learning Media: Systematic Literature Review. JPPIPA, 9(7).

Pulliam, M. (2017). The Death of Expertise: The Campaign Against Established Knowledge and Why It Matters by Tom Nichols. Journal of Intellectual Freedom and Privacy, 2(3–4).

Rahman, A. (2022). Mapping the Efficacy of Artificial Intelligence-based Online Proctored Examination (OPE) in Higher Education during COVID-19: Evidence from Assam, India. International Journal of Learning, Teaching and Educational Research, 21(9), 76–94.

Rahman, M. & Watanobe, Y. (2023). ChatGPT for Education and Research: Opportunities, Threats, and Strategies. Applied Sciences, 13(5783).

Rasul, T., Sumesh Nair, Kalendra, D., Robin, M., Santini, F. de O., Ladeira, W. J., Sun, M., Day, I., Rather, R. A. & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning & Teaching, 6(1).

Ratten, V. (2023). The post COVID-19 pandemic era: Changes in teaching and learning methods for management educators. The International Journal of Management Education, 21(2).

Razak, N. A., Rasli, R. M., Subhan, S., Ahmad, N. A. & Malik, S. (2023). Systematic review on digital transformation among teachers in public schools. International Journal of Evaluation and Research in Education, 12(2), 1059–1078.

Renato, V.-M. A., Pari-Bedoya, I. N. M. de la A. & Guevara-Soto, F. de J. (2023). Challenges and Opportunities of AI-Assisted Learning: A Systematic Literature Review on the Impact of ChatGPT Usage in Higher Education. International Journal of Learning, Teaching and Educational Research, 22(7).

Risang, B. & Mukarto. (2023). Exploring the Implications of ChatGPT for Language Learning in Higher Education. Indonesian Journal of English Language Teaching and Applied Linguistics, 7(2). 93/ijeltal.v7i2.1387

Rizal, R., Rusdiana, D., Setiawan, W. & Siahaan, P. (2021). Development of a Problem-Based Learning Management System-Supported Smartphone (PBLMS3) Application Using the ADDIE Model to Improve Digital Literacy. International Journal of Learning, Teaching and Educational Research, 10(11).

Robledo, D. A. R., Zara, C. G., Montalbo, S. M., Gayeta, N. E., Gonzales, A. L., Escarez, M. G. A. & Maalihan, E. D. (2023). Development and Validation of a Survey Instrument on Knowledge, Attitude, and Practices (KAP) Regarding the Educational Use of ChatGPT among Preservice Teachers in the Philippines. International Journal of Information and Education Technology, 13(10).

Rudolph, J., Tan, S. & Tan, S. (2023). War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. Journal of Applied Learning and Teaching, 6(1), 364–389.

Sallam, M. (2023). Practice : Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare, 11(887).

Sánchez-Ruiz, L. M., Moll-López, S., Nuñez-Pérez, A., Moraño-Fernández, J. A. & Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Applied Sciences, 13(6039).

Seng, K. P., Ang, L. M., & Ngharamike, E. (2022). Artificial intelligence Internet of Things: A new paradigm of distributed sensor networks. Sage Journals.

Shamima, A., M., El, A. A. & Helmi, H. (2022). Artificial intelligence and machine learning in finance: A bibliometric review. Research in International Business and Finance, 61(October).

Singh, H. & Singh, A. (2023). ChatGPT: Systematic Review, Applications, and Agenda for Multidisciplinary Research. Journal of Chinese Economic and Business Studies, 21(2), 193–212.

Skjuve, M., Følstad, A. & Brandtzaeg, P. B. (2023). The User Experience of ChatGPT: Findings from a Questionnaire Study of Early Users. CUI ’23: Proceedings of the 5th International Conference on Conversational User Interfaces, July, 1–10.

Sobaih, A. E. E., Hasanein, A. & Elshaer, I. A. (2022). Higher Education in and after COVID-19: The Impact of Using Social Network Applications for E-Learning on Students’ Academic Performance. Sustainability (Switzerland), 14(5195), 2–12.

Strakos, J. K., Douglas, M. A., McCormick, B. & Wright, M. (2023). A learning management system-based approach to assess learning outcomes in operations management courses. The International Journal of Management Education, 21(2).

Strzelecki, A. (2023). To use or not to use ChatGPT in higher education? A study of students’ acceptance and use of technology. Interactive Learning Environments.

Su, J. & Yang, W. (2023). Unlocking the Power of ChatGPT: A Framework for Applying Generative AI in Education. ECNU Review of Education, 6(3), 355–366.

Sullivan, M., Kelly, A. & McLaughlan, P. (2023). ChatGPT in higher education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching, 6(1), 31–40.

Sumarno. (2023). The Integration of Digital Technology in Public Management Transformation: Implications for Educational Advancements in Indonesia. International Journal of Asian Education (IJAE), 4(2).

Tantowi, A., Ibda, H., Saifuddin, K., Baehaqi, M., Muammar & Khaq, Z. (2023). Teacher Performance in Online Learning during the COVID-19 Pandemic: A Systematic Literature Review. International Journal on Advanced Science, Engineering and Information Technology, 13(4).

Thurzo, A., Strunga, M., Urban, R., Surovková, J. & Afrashtehfar, K. I. (2023). Impact of Artificial Intelligence on Dental Education: A Review and Guide for Curriculum Update. Education Sciences, 13(2).

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R. & Agyemang, B. (2023). What if the devil is my guardian angel? ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(15).

Topouzelis, Kremezi M., Kristollari, V., Karathanassi, V. & Konstantinos, ?. (2021). Pansharpening PRISMA Data for Marine Plastic Litter Detection Using Plastic Indexes. IEEE Access, 9, 61955–61971.

Totlis, T., Natsis, K., Filos, D., Ediaroglou, V., Mantzou, N., Duparc, F. & Piagkou, M. (2023). The potential role of ChatGPT and artificial intelligence in anatomy education: a conversation with ChatGPT. Surgical and Radiologic Anatomy, 45, 1321–1329.

Turnbull, D., Chugh, R. & Luck, J. (2020). Learning Management Systems, An Overview. Encyclopedia of Education and Information Technologies, 01 January.

Unwin, T., Kleessen, B., Hollow, D., Williams, J. B., Oloo, L. M., Alwala, J., Mutimucuio, I., Eduardo, F. & Muianga, X. (2010). Digital learning management systems in Africa: myths and realities. Open Learning: The Journal of Open, Distance and e-Learning, 25(1).

Uunona, G. N. & Goosen, L. (2023). Leveraging Ethical Standards in Artificial Intelligence Technologies: A Guideline for Responsible Teaching and Learning Applications. Handbook of Research on Instructional Technologies in Health Education and Allied Disciplines, 21.

Van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R. & Bockting, C. L. (2023). ChatGPT: five priorities for research. Nature, 614((7947)), 224–226.

Vargas-Murillo, A. R., Pari-Bedoya, I. N. M. de la A. & Guevara-Soto, F. de J. (2023). The Ethics of AI Assisted Learning: A Systematic Literature Review on the Impacts of ChatGPT Usage in Education. ICDEL ’23: Proceedings of the 2023 8th International Conference on Distance Education and Learning, 8–13.

Veluvali, P. & Surisetti, J. (2022). Learning Management System for Greater Learner Engagement in Higher Education—A Review. Higher Education for the Future, 9(1), 107–121.

Yu, Z., Xu, W. & Yu, L. (2022). Constructing an Online Sustainable Educational Model in COVID-19 Pandemic Environments. Sustainability (Switzerland), 14(6), 1–16.

Yusof, R., Yin, K. Y., Norwani, N. M., Ahmad, N. L. & Ismail, Z. (2022). Investigating the Role of Digital Learning in Enhancing Educational Values: Online Socialization and Its Effect on Peer Learning, Collaborative Skills and Knowledge Construction. International Journal of Learning, Teaching and Educational Research, 21(9), 441–459.

Zekaj, R. (2023). AI Language Models as Educational Allies: Enhancing Instructional Support in Higher Education. International Journal of Learning, Teaching and Educational Research, 22(8), 120–134.