Transfer of Human Control Strategy Based on Similarity Measure

J. Song, Y. Xu, M. C. Nechyba and Y. Yam
Abstract
In this paper, we address the problem of transferring human control strategies (HCS) from an expert model to an apprentice model. The proposed algorithm allows us to develop useful apprentice models that nevertheless incorporate some of the robust aspects of the expert HCS models. We first describe our experimental platform - a real-time graphich driving simulator - for collecting and modeling human control strategies. Then, we discuss an adaptive neural network learning architecture for abstracting HCS models. Next, we define a hidden Markov model (HMM) based similarity measure which allows us to compare different human control strategies. This similarity measure is combined subsequently with simultaneously perturbed stochastic approximation to develop our proposed transfer learning algorithm. In this algorithm, an expert HCS model influences both the structure and the parametric representation of the eventual apprentice HCS model. Finally, we describe some experimental results of the proposed algorithm.
J. Song, Y. Xu, M. C. Nechyba and Y. Yam, "Transfer of Human Control Strategy Based on Similarity Measure," Proc. IEEE Int. Conf. on Robotics and Automation, vol. 4, pp. 3134-9, 1999 (516 kb).