Methodology for Generating Mathematical Problems with Non-Standard Elements
Abstract
This paper presents a methodology for generating mathematical problems at the olympiads level that include non-standard elements (heuristic techniques, interdisciplinary and game-based components, elements of uncertainty, etc.). The relevance of this work lies in the need to foster students’ creative and analytical skills and to increase the effectiveness of training for competitions and olympiads. The authors review current approaches to problem generation, including template-based methods and neural network solutions, and highlight their limitations, particularly the insufficient consideration of knowledge structures and the systematic integration of "non-standardness". To address these challenges, an ontological model is proposed that describes not only the topic, difficulty level, and solution method but also the types of non-standard elements in a problem statement. Based on this model, a rule-driven generation algorithm has been developed. The system creates tasks considering the learner’s profile, the correctness of the problem statement, and the required level of difficulty. The methodology involves collaboration between an expert, who defines parameters (key skills, desired elements, difficulty level), and an AI module, which combines ontological concepts and verifies logical consistency. The prospects for expanding the model include covering additional areas of mathematics and generating not only problem statements but also step-by-step solutions. The authors emphasize that the integration of ontological representation and AI makes it possible to go beyond standard exercises, stimulate creative thinking, and significantly improve personalized olympiads preparation.
References
2. du Plooy E., et al. Personalized adaptive learning in higher education: A scoping review of key characteristics and impact on academic performance and engagement. Heliyon. 2024;10(21):e39630. https://doi.org/10.1016/j.heliyon.2024.e39630
3. Konovalov Ya.Yu., Sobolev S.K., Ermolaeva M.A. Methodological aspects of automatic generating problems on linear algebra. Engineering Journal: Science and Innovation. 2013;(5):8. (In Russ., abstract in Eng.) EDN: RHAKUF
4. Kruchinin V., Kuzovkin V. Overview of Existing Methods for Automatic Generation of Tasks with Conditions in Natural Language. Computer Tools in Education. 2022;(1):85-96. (In Russ., abstract in Eng.) https://doi.org/10.32603/2071-2340-2022-1-85-96
5. Liu S., Feng J., Yang Z., Luo Y., Wan Q., Shen X., Sun J. COMET: “cone of experience” enhanced large multimodal model for mathematical problem generation. Science China Information Sciences. 2024;67:220108. https://doi.org/10.1007/s11432-024-4242-0
6. Lu Z., et al. MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs. arXiv:2402.16352. 2024. https://doi.org/10.48550/arXiv.2402.16352
7. Škultéty M., Pastor K. Problems in Solving Non-Standard Mathematical Tasks. ICERI2020 Proceedings. 2020. p. 1018-1022. https://doi.org/10.21125/iceri.2020.0291
8. Xu Y., Smeets R., Bidarra R. Procedural generation of problems for elementary math education. International Journal of Serious Games. 2021;8:49-66. https://doi.org/10.17083/ijsg.v8i2.396
9. Wang Z., Lan A., Baraniuk R. Math Word Problem Generation with Mathematical Consistency and Problem Context Constraints. arXiv:2109.04546. 2021. https://doi.org/10.48550/arXiv.2109.04546
10. Shah V., et al. AI-Assisted Generation of Difficult Math Questions. arXiv:2407.21009. 2024. https://doi.org/10.48550/arXiv.2407.21009
11. Zhou Q., Huang D. Towards Generating Math Word Problems from Equations and Topics. In: Proceedings of the 12th International Conference on Natural Language Generation. Tokyo, Japan: Association for Computational Linguistics; 2019. p. 494-503. https://doi.org/10.18653/v1/W19-8661
12. Liyanage V., Ranathunga S. Multi-lingual Mathematical Word Problem Generation using Long Short Term Memory Networks with Enhanced Input Features. In: Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020). European Language Resources Association; 2020. p. 4709-4716. Available at: https://mro.massey.ac.nz/items/04e912d5-80e0-4328-9225-2d6449a0c462 (accessed 29.03.2025).
13. Nuyakshin M.G. Ontological model of problems for preparation for mathematical olympiads. Modern Science: actual problems of theory and practice. 2024;(10-2):68-73. (In Russ., abstract in Eng.) https://doi.org/10.37882/2223-2966.2024.10-2.18
14. George G., Lal A.M. Review of ontology-based recommender systems in e-learning. Computers & Education. 2019;142:103642. https://doi.org/10.1016/j.compedu.2019.103642
15. Nevzorova O.A., Gizatullin B.T. A system for automatic construction of knowledge graphs of mathematical documents. Uchenye Zapiski Kazanskogo Universiteta. Seriya Fiziko-Matematicheskie Nauki. 2023;165(3):264-281. (In Russ., abstract in Eng.) https://doi.org/10.26907/2541-7746.2023.3.264-281
16. Kirillovich A., Nevzorova O., Falileeva M., Lipachev E., Shakirova L. OntoMath: A Linguistically Grounded Educational Mathematical Ontology. In: Benzmüller C., Miller B. (eds.) Intelligent Computer Mathematics. CICM 2020. Lecture Notes in Computer Science. Vol. 12236. Cham: Springer; 2020. p. 157-172. https://doi.org/10.1007/978-3-030-53518-6_10
17. Kostenko K.I., Lebedeva A.P. The Formalized Mathematical Content Cognitive Management. Modern Information Technologies and IT-Education. 2018;14(3):616-625. (In Russ., abstract in Eng.) https://doi.org/10.25559/SITITO.14.201803.616-625
18. Balashova I.Yu., Volynskaya K.I., Makarychev P.P. Methods and means of generation of test item from natural language texts. Models, Systems, Networks in Economics, Engineering, Nature and Society. 2016;(1):195-202. (In Russ., abstract in Eng.) EDN: VTYLVX
19. Sheveleva O.E., Dobrynin V.N., Goncharova Ya.A. Ontological Model as a Means of Implementation of Competency Assessment System. Modern Information Technologies and IT-Education. 2023;19(2):460-468. (In Russ., abstract in Eng.) https://doi.org/10.25559/SITITO.019.202302.460-468
20. Kumar S., Kumar P.S. OLGA: An Ontology and LSTM-based approach for generating Arithmetic Word Problems (AWPs) of transfer type. arXiv:2211.12164. 2022. https://doi.org/10.48550/arXiv.2211.12164
21. Kumar S., Kumar P.S. Generating and Solving Complex Transfer Type Arithmetic Word Problems: An Ontological Approach. Semantic Web. 2023;0(0):1-20. Available at: https://www.semantic-web-journal.net/system/files/swj3722.pdf (accessed 29.03.2025).
22. Rostovtsev A.S. Developing mathematical creativity in high school students based on a multi-level system of non-standard mathematical problems. Modern Pedagogical Education. 2019;(9):113-117. (In Russ., abstract in Eng.) EDN: BLZOQV
23. Kolobov A.N. Features of teaching solving olympiad problems in the school course of mathematics. The world of science, culture and education. 2022;(4):18-21. (In Russ., abstract in Eng.) https://doi.org/10.24412/1991-5497-2022-495-18-21
24. Menkova S.V. Mathematical tasks as an effective means to form critical thinking of students. Modern problems of science and education. 2022;(5):24. (In Russ., abstract in Eng.) https://doi.org/10.17513/spno.32055
25. de Losada M.F., Taylor P.J. Perspectives on mathematics competitions and their relationship with mathematics education. ZDM Mathematics Education. 2022;54:941-959. https://doi.org/10.1007/s11858-022-01404-z

This work is licensed under a Creative Commons Attribution 4.0 International License.
Publication policy of the journal is based on traditional ethical principles of the Russian scientific periodicals and is built in terms of ethical norms of editors and publishers work stated in Code of Conduct and Best Practice Guidelines for Journal Editors and Code of Conduct for Journal Publishers, developed by the Committee on Publication Ethics (COPE). In the course of publishing editorial board of the journal is led by international rules for copyright protection, statutory regulations of the Russian Federation as well as international standards of publishing.
Authors publishing articles in this journal agree to the following: They retain copyright and grant the journal right of first publication of the work, which is automatically licensed under the Creative Commons Attribution License (CC BY license). Users can use, reuse and build upon the material published in this journal provided that such uses are fully attributed.
