Proceedings of International Conference on Applied Innovation in IT
2025/04/26, Volume 13, Issue 1, pp.35-42

Optimizing Routine Educational Tasks through Prompt Engineering: A Comparative Study of AI Chatbots


Svitlana Skvortsova, Tetiana Symonenko and Kira Hnezdilova


Abstract: The rapid integration of artificial intelligence (AI) in education necessitates the development of effective strategies for optimizing routine teaching tasks. This study explores the relevance of prompt engineering as a tool for enhancing AI-generated responses, reducing educators' workload, and improving the efficiency of lesson planning, content creation, and assessment design. The primary objective of this research is to develop and evaluate a structured methodology for designing prompts that maximize the relevance, completeness, and applicability of AI-generated outputs. To achieve this goal, a three-phase methodology was employed: (1) a preparatory phase involving a literature review and the development of standardized educational prompts, (2) an experimental phase testing these prompts across multiple AI chatbot models (Claude, GPT, and Copilot), and (3) an analytical phase assessing chatbot responses based on predefined criteria, including relevance, accuracy, completeness, practicality, and structuredness. The results indicate significant differences in chatbot performance. Claude demonstrated superior contextual understanding, GPT provided well-balanced and structured responses, while Copilot exhibited high factual accuracy but required improvements in contextual adaptation. Statistical analysis using the Kruskal-Wallis H test confirmed these variations, highlighting the necessity of model-specific prompt optimization. The study’s findings have both practical and theoretical significance. Practically, they provide educators with a structured approach to prompt engineering, enabling more effective use of AI tools in teaching. Theoretically, the research contributes to the growing field of AI- assisted education by offering insights into optimizing human-AI interaction. The conclusions emphasize the need for continued refinement of AI models and further exploration of prompt engineering techniques. Future research should focus on expanding testing across various disciplines and integrating AI-driven tools into digital learning environments to enhance personalized education.

Keywords: AI in Education, Prompt Engineering, Chatbot Evaluation, Lesson Planning Automation, AI-Assisted Teaching.

DOI: Under Indexing

Download: PDF

References:

  1. D. Baidoo-Anu and L. Owusu Ansah, "Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning," SSRN, 2023. [Online]. Available: https://dx.doi.org/10.2139/ssrn.4337484.
  2. A. Bozkurt, "Tell me your prompts and I will make them true: The alchemy of prompt engineering and generative AI," Open Praxis, vol. 16, no. 2, pp. 111–118, 2024. [Online]. Available: https://doi.org/10.55982/openpraxis.16.2.661
  3. A. Bozkurt and R. C. Sharma, "Generative AI and prompt engineering: The art of whispering to let the genie out of the algorithmic world," Asian Journal of Distance Education, vol. 18, no. 2, pp. i–vii, 2023. [Online]. Available: https://doi.org/10.5281/zenodo.8174941.
  4. W. Cain, "Prompting Change: Exploring Prompt Engineering in Large Language Model AI and Its Potential to Transform Education," TechTrends, vol. 68, no. 1, pp. 47–57, 2024. [Online]. Available: https://doi.org/10.1007/s11528-023-00896-0.
  5. G. Cooper, "Examining science education in ChatGPT: An exploratory study of generative artificial intelligence," Journal of Science Education and Technology, vol. 32, no. 3, pp. 444–452, 2023. [Online]. Available: https://doi.org/10.1007/s10956-023-10039-y.
  6. Y. Li, J. Shi, and Z. Zhang, "An approach for rapid source code development based on ChatGPT and prompt engineering," IEEE Access, vol. 12, 2024. [Online]. Available: https://doi.org/10.1109/ACCESS.2024.3385682.
  7. S. Schulhoff, M. Ilie, N. Balepur, K. Kahadze, A. Liu, C. Si, ... and P. Resnik, "The prompt report: A systematic survey of prompting techniques," arXiv preprint, arXiv:2406.06608, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2406.06608.
  8. S. Skvortsova, T. Symonenko, T. Britskan, O. Onopriienko, and R. Romanyshyn, "Artificial intelligence in the professional activity of a university lecturer in Ukraine: Realities and prospects," Proceedings of the Second International Workshop on Artificial Intelligent Systems in Education, co-located with 23rd International Conference of the Italian Association for Artificial Intelligence (AIxIA 2024), vol. 3879, 2024. [Online]. Available: https://ceur-ws.org/Vol-3879/AIxEDU2024_paper_14.pdf.
  9. J. Wei, X. Wang, D. Schuurmans, M. Bosma, E. Chi, Q. Le, and D. Zhou, "Chain of thought prompting elicits reasoning in large language models," arXiv preprint, arXiv:2201.11903, 2022. [Online]. Available: https://arxiv.org/pdf/2201.11903.
  10. I. Y. Yurchak, O. O. Kychuk, V. M. Oksentyuk, and A. O. Khich, "Capabilities and limitations of large language models," Computer Systems and Networks, vol. 6, no. 2, pp. 286–300, 2024. [Online]. Available: https://doi.org/10.23939/csn2024.02.286.


    HOME

       - Call for Papers
       - Paper Submission
       - For Authors
       - For Reviewers
       - Important Dates
       - Conference Committee
       - Editorial Board
       - Reviewers
       - Last Proceedings


    PROCEEDINGS

       - Volume 13, Issue 1 (ICAIIT 2025)        - Volume 12, Issue 2 (ICAIIT 2024)        - Volume 12, Issue 1 (ICAIIT 2024)        - Volume 11, Issue 2 (ICAIIT 2023)
       - Volume 11, Issue 1 (ICAIIT 2023)
       - Volume 10, Issue 1 (ICAIIT 2022)
       - Volume 9, Issue 1 (ICAIIT 2021)
       - Volume 8, Issue 1 (ICAIIT 2020)
       - Volume 7, Issue 1 (ICAIIT 2019)
       - Volume 7, Issue 2 (ICAIIT 2019)
       - Volume 6, Issue 1 (ICAIIT 2018)
       - Volume 5, Issue 1 (ICAIIT 2017)
       - Volume 4, Issue 1 (ICAIIT 2016)
       - Volume 3, Issue 1 (ICAIIT 2015)
       - Volume 2, Issue 1 (ICAIIT 2014)
       - Volume 1, Issue 1 (ICAIIT 2013)


    PAST CONFERENCES

       ICAIIT 2025
         - Photos
         - Reports

       ICAIIT 2024
         - Photos
         - Reports

       ICAIIT 2023
         - Photos
         - Reports

       ICAIIT 2021
         - Photos
         - Reports

       ICAIIT 2020
         - Photos
         - Reports

       ICAIIT 2019
         - Photos
         - Reports

       ICAIIT 2018
         - Photos
         - Reports

    ETHICS IN PUBLICATIONS

    ACCOMODATION

    CONTACT US

 

        

         Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0


                                                   This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License


           ISSN 2199-8876
           Publisher: Edition Hochschule Anhalt
           Location: Anhalt University of Applied Sciences
           Email: leiterin.hsb@hs-anhalt.de
           Phone: +49 (0) 3496 67 5611
           Address: Building 01 - Red Building, Top floor, Room 425, Bernburger Str. 55, D-06366 Köthen, Germany

        site traffic counter

Creative Commons License
Except where otherwise noted, all works and proceedings on this site is licensed under Creative Commons Attribution-ShareAlike 4.0 International License.