Controller Design (From Scratch) Using Approximate Dynamic Programming
Published In
IEEE International Symposium on Intelligent Control - Proceedings
Document Type
Citation
Publication Date
12-1-2000
Abstract
Selected Adaptive Critic (AC) methods are known to implement approximate Dynamic Programming for determining (approximately) optimal control policies for non-linear plants. The present research focuses on an AC method known as Dual Heuristic Programming. There are many issues related to stability that are yet to be addressed for the case of on-line training of controllers. Nevertheless, now that the operational aspects of the DHP method are becoming refined and better understood, it is instructive to carry out empirical research with the method, to inform theoretical research being carried out in parallel. In particular, it is seen as useful to explore the important correspondences between the form of a Utility function and the resulting controllers designed by the DHP method. The task of designing a steering controller for a 2-axle, terrestrial, autonomous vehicle is the basis of the empirical work reported here. Three different Utility functions are crafted, each incorporating additional control objectives. The controllers designed by the DHP method are correspondingly different - but in each case, the resulting controllers have responses that 'look and feel' like ones a human designer might have designed.
Locate the Document
https://doi.org/10.1109/ISIC.2000.882895
DOI
10.1109/ISIC.2000.882895
Persistent Identifier
https://archives.pdx.edu/ds/psu/37278
Citation Details
Lendaris, G. G., & Schultz, L. J. (2000, July). Controller design (from scratch) using approximate dynamic programming. In Proceedings of the 2000 IEEE International Symposium on Intelligent Control. Held jointly with the 8th IEEE Mediterranean Conference on Control and Automation (Cat. No. 00CH37147) (pp. 31-36). IEEE.