Application of artificial intelligence tools for automatic assessment of language skills
https://doi.org/10.51955/2312-1327_2025_4_149
Abstract
The article discusses the use of artificial intelligence (AI) tools for the automatic assessment of written works of 10th–11th grade students. The relevance of the study is driven by the growing demand for the integration of digital tools into the educational process and the need to modernize approaches to assessing language skills. An experimental study conducted a comparative analysis of the effectiveness, accuracy, and objectivity of automated essay checking using AI and traditional expert assessment. The results demonstrate the high effectiveness of AI in identifying grammatical and lexical errors, but significant discrepancies with expert assessment are noted in the criteria of text structure, logic, and style. Based on the analysis, recommendations are formulated for a hybrid assessment model that combines the technological capabilities of AI and pedagogical expertise.
About the Authors
E. E. Nikulin
Irkutsk State University
Russian Federation
Russian Federation
Evgeniy E. Nikulin
1, Karl Marx street Irkutsk, 664003
S. Yu. Bogdanova
Irkutsk State University
Russian Federation
Russian Federation
Svetlana Yu. Bogdanova, doctor of philology, professor
1, Karl Marx street Irkutsk, 664003
References
1. Alekseeva L. G., Alekseev P. S. (2024). The language of prompts, or the peculiarities of the formation of queries to generative neuro systems for creating images Verba. North-West linguistic journal. 3 (13): 50-61. (In Russian)
2. Automated Writing Evaluation Tools: Guide 2025 (2024). Available at: https://www.yomu.ai/blog/automated-writing-evaluation-tools-guide-2025 (accessed 17 October 2025).
3. Bogdanova S., Stepanova M., Matytcina M., Plastinina N., Plekhanova Y., Kudritskaya M. (2024). AI Technologies in Training PhD Students. 4th International Conference on Technology Enhanced Learning in Higher Education (TELE). 153-156. DOI 10.1109/TELE62556.2024.10605642.
4. Chowdhary K. R. (2020). Natural language processing. Fundamentals of artificial intelligence. New Delhi: Springer. 603-649.
5. Ekizer F. N. (2025). Exploring the impact of artificial intelligence on English language teaching: A meta-analysis. Acta Psychologica. 260: 105649. DOI 10.1016/j.actpsy.2025.105649.
6. Galaguzova M. A., Galaguzova Yu. N., Shtinova G. N. (2024). Artificial intelligence in pedagogy: from concept to function. Pedagogical survey in Russia. 2: 48-55. (In Russian)
7. Karpov V. E., Gotovcev P. M., Rojzenzon G. V. (2018). On the issue of ethics and the systems of artificial intelligence. Philosophy and society. 2 (87): 84-105. (In Russian)
8. Lapina A. (2021). Checking pupils’ homework will become automatic. Available at: https://skillbox.ru/media/education/proverka-domashnikh-zadaniy-shkolnikov-stanetavtomaticheskoy/. (accessed 16 October 2025) (In Russian)
9. Lapina A. (2022). A program has been created that can check English essays more effectively than a teacher. Available at: https://skillbox.ru/media/education/sozdana-programma-sposobnayaproveryat-esse-na-angliyskom-yazyke-effektivnee-uchitelya/ (accessed 16 October 2025) (In Russian)
10. North B. (2014). The CEFR in practice. Vol. 4. Cambridge: Cambridge University Press, 2014. 270 p.
11. Petrov S. V. (2022). Hypercorrectness as a reason for mistakes in the learners’ speech. International research journal. 2-3 (116): 160-162. (In Russian)
12. Pupkov T. S. (2021). Application of the confusion matrix for the assessment of the quality of training of the classification models. Topical issues of operation of security systems and protected telecommunication systems : Collection of materials from the All-Russian scientific and practical conference, Voronezh, 10/06/2021. Voronezh: Voronezhskij institut Ministerstva vnutrennih del Rossijskoj Federacii. 35-36. (In Russian)
13. Rahimi A. R. (2025). Developing and validating the scale of language teachers’ design thinking competency in artificial intelligence language teaching (LTDTAILT). Computers and Education: Artificial Intelligence. 8: 100420. DOI https://doi.org/10.1016/j.caeai.2025.100420.
14. Stupnickaya M. (2015). Criteria-based assessment. Pedagogical measurements. 1: 52-74. (In Russian)
15. Svincov R. (2016). False positive and false negative test results. Veterinary science of farm animals. 5: 62-65. (In Russian)
16. Tan X., Cheng G., Ling M. H. (2025). Artificial intelligence in teaching and teacher professional development: A systematic review. Computers and Education: Artificial Intelligence. 8. 100355. DOI https://doi.org/10.1016/j.caeai.2024.100355.
17. Ukwandu E., Omisade O., Jones K., Thorne S., Castle M. (2025). The future of teaching and learning in the context of emerging artificial intelligence technologies. Futures. 171: 103616. DOI https://doi.org/10.1016/j.futures.2025.103616.
Review
For citations:
Nikulin E.E., Bogdanova S.Yu. Application of artificial intelligence tools for automatic assessment of language skills. Crede Experto: transport, society, education, language. 2025;(4):149-159. (In Russ.) https://doi.org/10.51955/2312-1327_2025_4_149
Views:
36
JATS XML
Email this article 