THE METHOD OF DEVELOPING AN INTELLIGENT AUTOMATED SUBSYSTEM FOR ASSESSING THE LEVEL OF COMPETENCE FORMATION
Abstract
In the article the question of an estimation of reliability of level of formation of the competences on the basis of indistinct production cognitive maps is considered. The paper considers the issue of assessing the reliability of competence level based on fuzzy production cognitive maps. The automation of the process of assessing students’ competence level remains one of the urgent tasks iеn the field of informatization of education. However, the organization process of measuring and assessing the competence level, which demands the usage of information technologies, is currently not fully determined. This is due, inter alia, to the lack of recommendations for expanding the functionality of the existing informational systems used in higher education institutions for monitoring their educational process in the context of changes in the functioning environment. To monitor the forming of competencies, it is important to develop a subsystem for assessing the competence level as a part of the information system of educational organization. In modeling the process of assessing the level of development of students' competencies, weakly structured non-formalized information is used, therefore, it is advisable to use cognitive technologies when building models. The analysis of existing methods for formalizing knowledge and experience of experts allowed to determine that when developing a subsystem for assessing the level of competence formation, it is advisable to combine (hybridization) technologies that use, depending on the type of tasks, the positive properties of production, fuzzy and neural network models that complement the methods of classical expert assessment. However, the insufficiency of the methodological substantiation of the development of models and algorithms of the subsystem for assessing the level of competence development significantly reduces the reliability of the estimates obtained. The report proposes a methodology for developing a subsystem for assessing the level of competence formation, which allows creating information-mathematical support for such subsystems based on competence models, algorithms for their structural and parametric identification, and databases that help to assess the competence level. This method describes a system of competence level assessment based on reliability criterion. Thus, the proposed methodology for developing a cognitive subsystem improves the accuracy of assessing the level of competence development based on the creation of its information and mathematical software using fuzzy production cognitive competence models, neuro-fuzzy algorithms and the fuzzy Mamdani fuzzy inference rule base for their structural and parametric identification. At the end of the work, it is also proposed to consider a number of sources devoted to the formation of students' competences in subject areas [4-34], which will be considered in the further works of the authors.
References
[2] Borisov V.V. Nechetkiye modeli i seti. M.: Goryachaya Liniya – Telekom, 2007. 284 S. (In Russian)
[3] Sibikina I.V. Ocenka vliyaniya disciplin na formirovanie kompetencii obuchaemogo. Fundamental'nye i prikladnye issledovaniya universitetov, integraciya v regional'nyj innovacionnyj kompleks. Astrakhan: Izd-vo AGTU, 2010. Vol. 1, pp. 253-255. (In Russian)
[4] Ural'skov V.A., Atyasova E.V., Chervyakova A.M. Issledovanie kognitivnyh sposobnostej operatorov slozhnyh tekhnicheskih sistem na osnove ispol'zovaniya uchebno-trenirovochnyh sredstv. Neurocomputers and their applications. 2016, pp. 231-232. Available at: https://elibrary.ru/item.asp?id=28850386 (accessed 20.08.2018). (In Russian)
[5] Lobanov I.A., Rozhnov A.V. Ocenivanie ehffektivnosti problemno-orientirovannnoj sistemy upravleniya na rannih stadiyah zhiznennogo cikla kompleksa LA s ispol'zovaniem modeli FREE DISPOSAL HULL. Fundamental'nye problemy sistemnoj bezopasnosti i ustojchivosti. Yelets: YelSU, 2014, pp. 377-379. Available at: https://elibrary.ru/item.asp?id=21706659 (accessed 20.08.2018). (In Russian)
[6] Legovich Y.S., Rozhnov A.V., Lobanov I.A., Chernyavskij D.V. Upravlenie razvitiem v aspekte sistemnoj integracii na predproektnom ehtape zhiznennogo cikla problemno-orientirovannyh system. Imitacionnoe modelirovanie. Teoriya i praktika (IMMOD-2015). M.: IPU RAN, 2015. Vol. 2, pp. 163-167. Available at: https://elibrary.ru/item.asp?id=25420605 (accessed 20.08.2018). (In Russian)
[7] Rozhnov A.V. O virtual'nom molodyozhnom nauchnom kruglom stole na stranicah nauchno-tekhnicheskogo zhurnala «Nejrokomp'yutery: razrabotka, primenenie». Neurocomputers and their applications. 2016, pp. 19-21. Available at: https://elibrary.ru/item.asp?id=25673788 (accessed 20.08.2018). (In Russian)
[8] Rozhnov A.V., Lobanov I.A. The system integration proposals development at advanced technology emergency monitoring. Upravlenie razvitiem krupnomasshtabnyh sistem MLSD'2016. M.: IPU RAN, 2016. Vol. II, pp. 306-310. Available at: https://elibrary.ru/item.asp?id=28816273 (accessed 20.08.2018). (In Russian)
[9] Gudov G.N., Rozhnov A.V., Lobanov I.A., Kupach O.S. Metodicheskij podhod k opisaniyu slozhnyh ehvolyucioniruyushchih sistem pri realizacii ugroz bezopasnosti informacii. Problemy upravleniya bezopasnost'yu slozhnyh sistem. M.: RGGU, 2013, pp. 61-65. Available at: https://elibrary.ru/item.asp?id=22429501 (accessed 20.08.2018). (In Russian)
[10] Rozhnov A.V., Karpov V.V. Advanced space technologies proposals development with promising energy. Upravlenie razvitiem krupnomasshtabnyh sistem MLSD'2016. M.: IPU RAN, 2016, Vol. II, pp. 150-154. Available at: https://elibrary.ru/item.asp?id=28813658 (accessed 20.08.2018). (In Russian)
[11] Antioh G.M., Rozhnov A.V. Issledovanie zadach integrirovannoj sistemy modelirovaniya i analiza ehffektivnosti sredy funkcionirovaniya v razvitii idei Joint Warfare System. Sistemy proektirovaniya, tekhnologicheskoj podgotovki proizvodstva i upravleniya ehtapami zhiznennogo cikla promyshlennogo produkta (CAD/CAM/PDM-2014). M.: OOO "Analitik", 2014, pp. 101-103. Available at: https://elibrary.ru/item.asp?id=23223499 (accessed 20.08.2018). (In Russian)
[12] Legovich Y.S., Miodushevskij P.V., Rozhnov A.V. Sistemnaya integraciya i uskorennoe maketirovanie smeshannoj robototekhnicheskoj gruppirovki na predproektnoj stadii zhiznennogo cikla. Sistemy proektirovaniya, tekhnologicheskoj podgotovki proizvodstva i upravleniya ehtapami zhiznennogo cikla promyshlennogo produkta (CAD/CAM/PDM-2016). M.: OOO "Analitik", 2016, pp. 199-202. Available at: https://elibrary.ru/item.asp?id=27645837 (accessed 20.08.2018). (In Russian)
[13] Kupach O.S., Rozhnov A.V., Gudov G.N. Diversifikaciya tekhnologii analiza sredy funkcionirovaniya v prikladnyh servisah geoinformacionnyh intellektnyh sistem. 6-j Vserossijskoj mul'tikonferencii po problemam upravleniya. Rostov-on-Don: SFedU, 2013, Vol. 4 (URiSS-2013), pp. 59-62. Available at: https://elibrary.ru/item.asp?id=34857409 (accessed 20.08.2018). (In Russian)
[14] Legovich Y.S., Rozhnov A.V., Ruzhencev O.I. Intellektual'nye prava i ih zashchita pri razrabotke proryvnyh tekhnologij i komponentov gibridnyh intellektual'nyh i intellektualizirovannyh sistem. Neurocomputers and their applications. 2017, pp. 49-50. Available at: https://elibrary.ru/item.asp?id=28850272 (accessed 20.08.2018). (In Russian)
[15] Rozhnov A.V. Obobshchyonnoe predstavlenie kriptoprimitiva «Sponge» v prilozheniyah «Smart»-tekhnologij. Neurocomputers and their applications. 2016, pp. 24-26. Available at: https://elibrary.ru/item.asp?id=25671019 (accessed 20.08.2018). (In Russian)
[16] Rozhnov A.V., Lobanov I.A. Stratificirovannaya model' edinogo informacionno-upravlyayushchego polya dlya formalizacii osobennostej pereklyucheniya rezhimov upravleniya smeshannymi gruppami pilotiruemyh i bespilotnyh letatel'nyh apparatov. Ustojchivost' i kolebaniya nelinejnyh sistem upravleniya (konferenciya Pyatnickogo). M.: IPU RAN, 2016, pp. 304-307. Available at: https://elibrary.ru/item.asp?id=28299646 (accessed 20.08.2018). (In Russian)
[17] Sigov A.S., Nechaev V.V., Rozhnov A.V., Lobanov I.A. Metody integracii i bioinspirirovannye modeli dlya formirovaniya komponentov virtual'noj semanticheskoj sredy. Deponirovannye nauchnye raboty VINITI RAN. 2017. 31-V2017, pp. 1-25. Available at: https://elibrary.ru/item.asp?id=29338172 (accessed 20.08.2018). (In Russian)
[18] Sigov A.S., Nechaev V.V., Rozhnov A.V., Lobanov I.A. Postroenie versij informacionnoj infrastruktury s operezheniem vozniknoveniya informacionnyh potrebnostej upravleniya. 10-j Vserossijskay mul'tikonferenciay po problemam upravleniya (MKPU-2017). Rostov-on-Don: SFedU, 2017. Vol. 2 (RiM-2017), pp. 112-115. Available at: https://elibrary.ru/item.asp?id=29979716 (accessed 20.08.2018). (In Russian)
[19] Rozhnov A.V., Cypelev V.V. Osobennosti formirovaniya edinoj tekhnologii letatel'nogo apparata s uchyotom polozhenij Rezhima kontrolya za raketnoj tekhnologiej. Sistemy proektirovaniya, tekhnologicheskoj podgotovki proizvodstva i upravleniya ehtapami zhiznennogo cikla promyshlennogo produkta (CAD/CAM/PDM-2016). M.: OOO "Analitik", 2016, pp. 396-398. Available at: https://elibrary.ru/item.asp?id=27645896 (accessed 20.08.2018). (In Russian)
[20] Gudov G.N., Rozhnov A.V., Lobanov I.A. O novyh sredstvah kontrfakticheskogo prognozirovaniya i sopredel'nom potenciale informacionno-analiticheskogo obespecheniya slozhnyh sistem. Problemy prognozirovaniya chrezvychajnyh situacij. M.: FKU Centr «Antistihiya» MCHS Rossii, 2017, pp. 263-268. Available at: https://elibrary.ru/item.asp?id=32714929 (accessed 20.08.2018). (In Russian)
[21] Lepeshkin O.M., Rozhnov A.V. The substantiation of the reasons of formation of back coupling of problem-oriented control system in environment of radicals. Proccedings of the 17-th International Conference «Distributed Computer and Communication Networks: Control, Computation, Communications» (DCCN-2013). M.: TECHNOSPHERA, 2013, pp. 230-232. Available at: https://elibrary.ru/item.asp?id=21767350 (accessed 20.08.2018). (In Russian)
[22] Lobanov I.A., Rozhnov A.V., Lepeshkin O.M. To a question of simulation of intellectual control in the distributed information systems with use of the environment of diagrams of radicals. Proccedings of the 17-th International Conference «Distributed Computer and Communication Networks: Control, Computation, Communications» (DCCN-2013). M.: TECHNOSPHERA, 2013, pp. 206-209. Available at: https://elibrary.ru/item.asp?id=21767368 (accessed 20.08.2018). (In Russian)
[23] Ogandzhanyan S.B., Rozhnov A.V., Gudova L.R. Aktualizaciya i osobennosti ponimaniya v russkoyazychnoj celevoj auditorii obshchej definicii «iskusstvennyj intellekt». Neurocomputers and their applications. 2017, pp. 232-233. Available at: https://elibrary.ru/item.asp?id=28850387 (accessed 20.08.2018). (In Russian)
[24] Lobanov I.A., Rozhnov A.V. Integraciya i upravlenie kontentom problemno-orientirovannoj sistemy na rannej stadii zhiznennogo cikla. Sistemy proektirovaniya, tekhnologicheskoj podgotovki proizvodstva i upravleniya ehtapami zhiznennogo cikla promyshlennogo produkta (CAD/CAM/PDM–2013). M.: OOO "Analitik", 2013, pp. 320-322. Available at: https://elibrary.ru/item.asp?id=22576658 (accessed 20.08.2018). (In Russian)
[25] Prokopenkov A.A., Rozhnov A.V., Karpov V.V. Upravlenie slozhnymi sistemami i konvergentnye kognitivno-informacionnye tekhnologii (vvedenie). Neurocomputers and their applications. 2017, pp. 268-270. Available at: https://elibrary.ru/item.asp?id=28850411 (accessed 20.08.2018). (In Russian)
[26] Rozhnov A.V., Lychyov A.V. Issledovanie povedeniya sociotekhnicheskih ob"ektov v dinamike s primeneniem seti situacionnyh centrov. 10-ay Vserossijskay mul'tikonferenciay po problemam upravleniya (MKPU-2017). Rostov-on-Don: SFedU, 2017. Vol. 1 (IU-2017), pp. 210-212. Available at: https://elibrary.ru/item.asp?id=29913606 (accessed 20.08.2018). (In Russian)
[27] Abrosimov V., Ryvkin S., Goncharenko V., Rozhnov A., Lobanov I. Identikit of modifiable vehicles at Virtual Semantic Environment. Proceedings of 2017 International Conference on Optimization of Electrical and Electronic Equipment (OPTIM) & 2017 Intl Aegean Conference on Electrical Machines and Power Electronics (ACEMP). Brasov, 2017, pp. 905-910. DOI: 10.1109/OPTIM.2017.7975085
[28] Rozhnov A.V., Skorik N.A. Informacionno-analiticheskoe obespechenie predproektnyh issledovanij i sistemnaya integraciya: problemnye voprosy formirovaniya zadela i vnedreniya edinyh tekhnologij. Sistemy proektirovaniya, tekhnologicheskoj podgotovki proizvodstva i upravleniya ehtapami zhiznennogo cikla promyshlennogo produkta (CAD/CAM/PDM-2017). M.: IPU RAN, 2017, pp. 296-300. Available at: https://elibrary.ru/item.asp?id=32807232 (accessed 20.08.2018). (In Russian)
[29] Rozhnov A.V., Lobanov I.A., Skorik N.A., Cypelev V.V. O nechyotkoj strategii integracii komponentov v interesah nakopleniya opyta ehvolyucionnogo modelirovaniya problemno-orientirovannoj sistemy upravleniya na nachal'nyh ehtapah zhiznennogo cikla. Sistemy proektirovaniya, tekhnologicheskoj podgotovki proizvodstva i upravleniya ehtapami zhiznennogo cikla promyshlennogo produkta (CAD/CAM/PDM-2015). M.: OOO "Analitik", 2015, pp. 345-348. Available at: https://elibrary.ru/item.asp?id=25421572 (accessed 20.08.2018). (In Russian)
[30] Rozhnov A.V., Lobanov I.A. Intellektualizaciya sredstv uhoda ot konfliktov pri pereklyuchenii rezhimov upravleniya LA s primeneniem yazykovogo formalizma «skhem radikalov» v predmetnoj oblasti «Smart Intelligent Aircraft Structure». Materialy XI Mezhdunarodnoj konferencii po Neravnovesnym processam v soplah i struyah (NPNJ'2016). M.: MAI, 2016, pp. 439-441. Available at: https://elibrary.ru/item.asp?id=27460403 (accessed 20.08.2018). (In Russian)
[31] Ryvkin S., Rozhnov A., Lychev A., Lobanov I., Fateeva Y. Multiaspect modeling of infrastructure solutions at energy landscape as virtual semantic environment. Proceedings of 2017 International Conference on Optimization of Electrical and Electronic Equipment (OPTIM) & 2017 Intl Aegean Conference on Electrical Machines and Power Electronics (ACEMP). Brasov, 2017, pp. 935-940. DOI: 10.1109/OPTIM.2017.7975090
[32] Gudov G.N., Rozhnov A.V., Lobanov I.A. Analiz praktik «postkiberatak» v kriticheskih segmentah infrastruktury ehlektroehnergetiki. Problemy upravleniya bezopasnost'yu slozhnyh sistem. M.: RGGU, 2017, pp. 401-405. Available at: https://elibrary.ru/item.asp?id=32245162 (accessed 20.08.2018). (In Russian)
[33] Rozhnov A.V., Lobanov I.A. K voprosu formalizovannogo opisaniya obshchego semanticheskogo polya smeshannyh robototekhnicheskih gruppirovok. Upravlenie razvitiem krupnomasshtabnyh sistem (MLSD'2017). M.: IPU RAN, 2017. Vol. 2, pp. 368-371. Available at: https://elibrary.ru/item.asp?id=32598843 (accessed 20.08.2018). (In Russian)
[34] Rozhnov A.V., Lobanov I.A. Investigation of the joint semantic environment for heterogeneous robotics. Proceedings of 2017 Tenth International Conference Management of Large-Scale System Development (MLSD). Moscow, 2017, pp. 1-5. DOI: 10.1109/MLSD.2017.8109678
This work is licensed under a Creative Commons Attribution 4.0 International License.
Publication policy of the journal is based on traditional ethical principles of the Russian scientific periodicals and is built in terms of ethical norms of editors and publishers work stated in Code of Conduct and Best Practice Guidelines for Journal Editors and Code of Conduct for Journal Publishers, developed by the Committee on Publication Ethics (COPE). In the course of publishing editorial board of the journal is led by international rules for copyright protection, statutory regulations of the Russian Federation as well as international standards of publishing.
Authors publishing articles in this journal agree to the following: They retain copyright and grant the journal right of first publication of the work, which is automatically licensed under the Creative Commons Attribution License (CC BY license). Users can use, reuse and build upon the material published in this journal provided that such uses are fully attributed.
