Variational problem of adaptive optimal control. Theoretical and applied computer analysis

The problem of adaptive optimal control of a dynamical system, which belongs to the class of conditional variational problems with moving boundaries, is considered. A variational and computer study of the controlled adaptive motion of a material point is carried out for the problem of the energy quality functional minimizing with a moving, not predetermined right transboundary and in the case when the mass of the point changes depending on the unfixed final time. The problem is solved using the schemes and procedures of the classical calculus of variations, as well as adaptive estimation techniques, including the derivation of the variation of the auxiliary quality functional, the corresponding Euler equations, and the adaptive estimation algorithm. When solving a general conditional variational problem, the obtained closed system of differential equations was studied for the formation of an adaptive optimal control system for a dynamic plant with a given performance functional. The results of the unconditional formulation of the problem are generalized to the case of additional differential (nonholonomic) and holonomic constraints. In a variational adaptive optimal control problem, the transversality condition is formulated in terms of the local programming condition. The developed variational scheme of adaptive optimal synthesis can be used in the calculation and design of controlled dynamic systems. This optimization scheme is also promising for use in systems where operating time is non-fixed in advance. The results achieved in this paper concern obtaining specific equations, expressions, and formulas relative to the model example under study and finding graphs of the main time functions that determine the nature of the movement of the control object and the quality of the corresponding transients. The proposed adaptive optimal control algorithms for purposeful movement of the studied material point were tested in digital mode and showed their effectiveness which makes them promising for further use in more complex nonlinear adaptive systems of dynamic optimal control.

1. Bliss G.A. Lectures on the Calculus of Variations. Chicago, Illinois, University of Chicago Press, 1946, 292 p.

2. Gel’fand I.M., Fomin S.V. Calculus of Variations. Moscow, Fizmatgiz Publ., 1961, 228 p. (in Russian)

3. El’sgol’ts L.E. Differential Equations and Calculus of Variations. Moscow, Nauka Publ., 1969, 424 p. (in Russian)

4. Yang L. Lectures on Calculus of Variations and Optimal Control Theory. Moscow, Mir Publ., 1974, 488 p. (in Russian)

5. Alekseev V.M., Tikhomirov V.M., Fomin S.V. Optimal Control. Moscow, Nauka Publ., 1979, 429 p. (in Russian)

6. Boltianskii V.G. Mathematical Methods of the Optimal Control. Moscow, Nauka Publ., 1969, 408 p. (in Russian)

7. Dikusar V.V., Miliutin A.A. Qualitative and Numerical Methods in the Maximum Principle. Moscow, Nauka, 1989, 143 p. (in Russian)

8. Krotov V.F., Gurman V.I. Methods and Problems of the Optimal Control. Moscow, Nauka Publ., 1973, 446 p. (in Russian)

9. Subbotin A.I. Minimax Inequations and Hamilton-Jacobi Equations. Moscow, Nauka Publ., 1991, 215 p. (in Russian)

10. Tertychny-Dauri V.Yu. Galamech. Vol. 4. Optimum Mechanics. Moscow, Fizmatlit Publ., 2019, 608 p. (in Russian)

11. Fomin V.N., Fradkov A.L., Iakubovich V.A. Adaptive Control of the Dynamic Objects. Moscow, Nauka Publ., 1981, 448 p. (in Russian)

12. Vedyakov A.A., Milovanovich E.V., Tertychny-Dauri V.Yu., Timofeeva G.V. Optimal control as conditional variational problem with variable right endpoint. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2019, vol. 19, no. 1, pp. 59–66. (in Russian). https://doi.org/10.17586/2226-1494-2019-19-1-59-66

13. Degtyarev G.L. Synthesis of optimal control in systems with distributed parameters using Lyapunov functions. Direct Method in Stability Theory and its Applications. Novosibirsk, Nauka Publ., 1981, pp. 75–83. (in Russian)

14. Matveev A.S. Variational analysis in optimization problems of systems with distributed parameters and set vector functions. Siberian Mathematical Journal, 1990, vol. 31, no. 6, pp. 127–141. (in Russian)

15. Panchenkov A.N. Extreme problems of motion control with local functionals. Problems of Motion Stability, Analytical Mechanics and Motion Control. Novosibirsk, Nauka Publ., 1979, pp. 190–202. (in Russian)

16. Tertychny-Dauri V.Yu. Galamech. Vol. 1. Adaptive Mechanics. Moscow, Fizmatlit Publ., 2019, 544 p. (in Russian)

17. Kamke E. Differentialgleichungen Lösungsmethoden und Lösungen. Springer-Verlag, 1977, 670 p. (in German). https://doi.org/10.1007/978-3-663-05925-7

18. Fomin V.N. Mathematical Theory of the Learnable Identification Systems. Leningrad, Leningrad State University Publ., 1976, 236 p. (in Russian)

19. Tertychny-Dauri V.Yu. Adaptive Mechanics. Moscow, Faktorial Press, 2003, 464 p. (in Russian)

20. Tsypkin Ya.Z. Optimal parameter estimation algorithms in identification problem. Automation and Remote Control, 1982, vol. 43, no.12, pp. 1505–1517.

21. Tsypkin Ya.Z., Optimal adaptive control systems. Doklady Akademii nauk SSSR, 1984, vol. 277, no. 5, pp. 1091–1096. (in Russian)

22. Tertychny-Dauri V.Yu. Solution of variational dynamic problems under parametric uncertainty. Problems of Information Transmission, 2005, vol. 41, no. 1, pp. 45–58. (in Russian). https://doi.org/10.1007/s11122-005-0009-3

23. Tertychny-Dauri V.Yu. Variational dynamic problems with parameters and their adaptive interpretation. Automation and Remote Control, 2005, vol. 66, no. 9, pp. 1465–1477. https://doi.org/10.1007/s10513-005-0185-z

24. Tertychnyi-Dauri V.Yu. A conditional optimal control problem and its adaptive solution method. Automation and Remote Control, 2006, vol. 67, no. 3, pp. 393 – 404. https: //doi.org/10.1134/s0005117906030040

25. Anderson B., Moore J. Optimal Control: Linear Quadratic Methods. N.Y., Prentice-Hall Inc., 1990, 352 p.

26. Leitmann G. The Calculus of Variations and Optimal Control. NY, Plenum Press, 1981, 312 p. https://doi.org/10.1007/978-1-4899-0333-4

27. Landau I.D. Adaptive Control Systems: The Model Reference Approach. N.Y., Marcel Dekker, 1979, 406 p.

28. Blatt J.M., Lyness J.N. The practical use of variation principles in non-linear mechanics. Journal of the Australian Mathematical Society, 1962, vol. 2, no. 3, pp. 357. https://doi.org/10.1017/s144678870002694x

29. Mayne D.Q., Polak E. First-order strong variation algorithms for optimal control problems with terminal inequality constraints. Journal of Optimization Theory and Applications, 1975, vol. 16, no. 3-4, pp. 277–301. https://doi.org/10.1007/bf01262938

30. Trullson E., Ljung L. Adaptive control based on explicit criterion minimization. Automatica, 1985, vol. 21, no. 4, pp. 385–399. https://doi.org/10.1016/0005-1098(85)90075-5

31. Hestenes M.R. On variational theory and optimal control theory. Journal of the Society for Industrial and Applied Mathematics Series A Control, 1965, vol. 3, no. 1, pp. 23–48. https://doi.org/10.1137/0303003

32. McShane E.Y. Relaxed controls and variational problems. SIAM Journal on Control, 1967, vol. 5, no. 3, pp. 438–485. https://doi.org/10.1137/0305027.