Development of a mechanism for assessing the performance and efficiency of application of expert systems

The availability of IT educational resources for obtaining new and additional professional knowledge has become increasingly relevant in recent years. This is due to the fact that the use of expert systems opens up a series of advantages: expansion of geographical and temporal possibilities; unlimited availability; increasing the intensity of training; optimization of the acquisition and transfer of knowledge. At the same time, there is an urgent need to assess the effectiveness and efficiency of expert systems when assessing the level of qualifications of specialists who ensure flight safety (FS) in civil aviation. Currently, depending on the field of activity, the concepts of efficiency and effectiveness are interpreted in different ways. More often than not, performance reflects the degree to which a planned result has been achieved. Efficiency is the comparison of the result with the cost of achieving it. The practice of using points and ratings to assess the training of safety oversight inspectors in the format of using expert systems, as shown by the results of a previous study, reflects only the effectiveness and does not provide an opportunity to compare the learning processes from the standpoint of the effectiveness of their implementation. In this regard, the purpose of this work is to develop a new evaluation mechanism that combines the effectiveness and efficiency of the use of expert systems. This explains the relevance of the presented work

1. Aksyonov K. A. Development of decision support and simulation system BPSIM.DSS: integration of simulation, expert, situational and multi-agent modeling / K. A. Aksyonov, E. A. Bykov, O. P. Aksyonova, W. Kai, A. V. Popov, E. F. Smoliy, E. M. Sufrygina, I. A. Spitsina, A. A. Sheklein. In the collection: ESM 2009 – 2009 European Simulation and Modelling Conference: Modelling and Simulation 2009. Pp. 256-260.

2. Ariona Lopez, M. A., Hernandez Fiores, C., Gleason Garca, E. Expert Systems with Applications // 2003. T. 24. № 1. Pp. 95-101.

3. Bolshedvorskaya L. G., Koryagin N. D. (2019). Analysis of the use of expert systems for diagnosing problem areas in the training system of flight personnel for civil aviation. Innovations in civil aviation, T. 4. No. 4: 13-26. [in Russian]

4. Diao, Y., Passino, K. M. Intelligent fault-tolerant control using adaptive and learning methods // Control Engineering Practice. 2002. T. 10. № 8. Pp. 801-817.

5. Guseva A. I., Vesna E. B. (2013). Evaluation of the effectiveness and efficiency of network educational programs. Modern problems of science and education. No. 6: 259. [in Russian]

6. Ishikawa, T., Terano, T. Analogy by abstraction: case retrieval and adaptation for inventive design expert systems // Expert Systems with Applicatioms. 1996. T. 10. № 3-4. Pp. 351-356.

7. Kuzkin A. A. (2014). Evaluation of indicators of efficiency and effectiveness of IT-processes using hybrid neuro-fuzzy networks. Internet journal Science Studies. No. 1 (20): 67. [in Russian]

8. Lehto, M. R. A structured methodology for expert system development with application to safety ergonomics (human factors, artificial intelligence, modeling, systems safety). 1986. 119 p.

9. Lvovich, Ya. E., Preobrazhenskiy, A. P., Preobrazhenskiy, Yu. P., Choporov, O. N. Modelling of information systems with increased efficiency with application of optimization-expert evaluation // Journal of Physics: Conference Series. International Scientific Conference "Conference on Applied Physics, Information Technologies and Engineering - APITECH-2019". Krasnoyarsk Science and Technology City Hall of the Russian Union of Scientific and Engineering Associations; Polytechnical Institute of Siberian Federal University. 2019. Pp. 33-79.

10. Orlova L. N. (2012). Correlation analysis of the similarity of parameters of expert assessment of professional skills of students of the chemical-pedagogical faculty of Omsk State Pedagogical University. Modern problems of science and education. No. 2: 199. [in Russian]

11. Petrunin S. V. (2006). Organizational and logistic methods of increasing the efficiency of airlines' production activities. Petrunin. Moscow: AviaBusiness Group, 164 p. [in Russian]

12. Rodrigues-Bachiller, A. Part II: Expert systems and decision support systems // Journal of Environmental Assessment Policy and Management. 2000. T. 2. № 3. Pp. 415-448.

13. Rukhlinsky V. M., Bolshedvorskaya L. G. (2019). Ensuring the flight safety of new generation aircraft. Monograph. Moscow: Moscow State Technical University of Civil Aviation, 370 p. [in Russian]