Course detail
Optimal Control and Identification
FIT-ORIDAcad. year: 2020/2021
The "Optimal Control and Identification" is suitable for students of IT and related fields and its goal is to explain the principles of automatic control in a suitable way. The course does not intend to train specialists in controller design but rather to exlpain to the graduates of the course what control means and how to approach various tasks of automatic control.
Doctoral state exam - topics:
- Tasks of optimal control, static and dynamic optimization of deterministic, stochastic and adaptive control.
- Dynamac optimization, forms of loss functions, border conditions, Euler-Lagrange equation.
- Limitation of shapes of control non-equations and Pontrjagin principle of minimum.
- Dynamic programming, design of loss functions, Hamiltona-Jakobiho-Bellman equation.
- Linear controller, design of loss function, Riccati equation.
- Repeating of characteristics of random processes, mean values, dispersion, correlation, covariation, Wiener-Chincin relationships, Parceval theorem, while and "color" noise, transformation of random signals in linear system.
- Overview of Bayesovs estimations, loss and risk functions, general principle of dynamic filtration.
- Linear dynamic (Kalman) filter, its design, conversion to discrete filter, generalization of dynamic filter, Wiener filter.
- Parallel identification of system and trajectory as well as generalized state vector, linearized Kalman filter, contruction of selected non-linear filters.
- Stochastic control, linear quadratic Gauss problem, continuous and discrete stochastic state regulator and servo mechanism.
- Adaptive systems, parallel identification of status, parameters, and control, most frequent structures of adaptive systems.
- Classic methods of regulations.
Language of instruction
Mode of study
Learning outcomes of the course unit
Prerequisites
Co-requisites
Planned learning activities and teaching methods
Assesment methods and criteria linked to learning outcomes
Course curriculum
Work placements
Aims
Specification of controlled education, way of implementation and compensation for absences
Recommended optional programme components
Prerequisites and corequisites
Basic literature
Recommended reading
Dimitri Bertsekas. Dynamic Programming and Optimal Control. Athena Scientific, 4th Ed., 2017.
Dimitri Bertsekas. Reinforcement Learning and Optimal Control. Athena Scientific, 1st Ed., 2019.
E.B. Lee and L. Markus, Foundations of Optimal Control Theory, Wiley, New York 1967.
Fleming W. H., Rishel R. W.: Deterministic and Stochastic Optimal Control. Springer, New York, 1975, sec. edition 2001.
Frank L. Lewis, Draguna Vrabie, Vassilis L. Syrmos. Optimal Control. Wiley, 3rd Ed., 2012.
Sage, A.P.: Estimation Theory with Application to Communication and control. N.Y. 1972.
Sage, A.P.: Optimum Systems Control. New Jersey 1982.
Classification of course in study plans
- Programme CSE-PHD-4 Doctoral
branch DVI4 , 0 year of study, winter semester, elective
- Programme CSE-PHD-4 Doctoral
branch DVI4 , 0 year of study, winter semester, elective
- Programme CSE-PHD-4 Doctoral
branch DVI4 , 0 year of study, winter semester, elective
- Programme CSE-PHD-4 Doctoral
branch DVI4 , 0 year of study, winter semester, elective
Type of course unit
Lecture
Teacher / Lecturer
Syllabus
The indicative outline of the course is shown below. The topics of the lectures will be adjusted based in the initial knowledge of students. The end of the course is expected in a form of seminars and individual presentations.
- Tasks of optimal control, static and dynamic optimization of deterministic, stochastic and adaptive control.
- Dynamac optimization, forms of loss functions, border conditions, Euler-Lagrange equation.
- Limitation of shapes of control non-equations and Pontrjagin principle of minimum.
- Dynamic programming, design of loss functions, Hamiltona-Jakobiho-Bellman equation.
- Linear controller, design of loss function, Riccati equation.
- Repeating of characteristics of random processes, mean values, dispersion, correlation, covariation, Wiener-Chincin relationships, Parceval theorem, while and "color" noise, transformation of random signals in linear system.
- Overview of Bayesovs estimations, loss and risk functions, general principle of dynamic filtration.
- Linear dynamic (Kalman) filter, its design, conversion to discrete filter, generalization of dynamic filter, Wiener filter.
- Parallel identification of system and trajectory as well as generalized state vector, linearized Kalman filter, contruction of selected non-linear filters.
- Stochastic control, linear quadratic Gauss problem, continuous and discrete stochastic state regulator and servo mechanism.
- Adaptive systems, parallel identification of status, parameters, and control, most frequent structures of adaptive systems.
Project
Teacher / Lecturer
Syllabus
Guided consultation in combined form of studies
Teacher / Lecturer