Explorations on System Identification via Higher-Level Application of Adaptive-Critic Approximate Dynamic Programming

Published In

Proceedings of the International Joint Conference on Neural Networks

ISBN

9781457710865

Document Type

Citation

Publication Date

10-24-2011

Abstract

In previous work it was shown that Adaptive- Critic-type Approximate Dynamic Programming could be applied in a "higher-level" way to create autonomous agents capable of using experience to discern context and select optimal, context-dependent control policies. Early experiments with this approach were based on full a priori knowledge of the system being monitored. The experiments reported in this paper, using small neural networks representing families of mappings, were designed to explore what happens when knowledge of the system is less precise. Results of these experiments show that agents trained with this approach perform well when subject to even large amounts of noise or when employing (slightly) imperfect models. The results also suggest that aspects of this method of context discernment are consistent with our intuition about human learning. The insights gained from these explorations can be used to guide further efforts for developing this approach into a general methodology for solving arbitrary identification and control problems. © 2011 IEEE.

Locate the Document

https://doi.org/10.1109/ijcnn.2006.247279

DOI

10.1109/IJCNN.2011.6033281

Persistent Identifier

https://archives.pdx.edu/ds/psu/37286

Share

COinS