On Learning Discontinuous Human Control Strategies

M. C. Nechyba and Y. Xu
Abstract
Models of human control strategy (HCS), which accurately emulate dynamic human behavior, have far reaching potential in areas ranging from robotics to virtual reality to the intelligent vehicle highway project. A number of learning algorithms, including fuzzy logic, neural networks, and locally weighted regression exist for modeling continuous human control strategies. These algorithms, however, may not be well suited for modeling discontinuous human control strategies. Therefore, we propose a new stochastic, discontinuous modeling framework, for abstracting human control strategies, based on Hidden Markov Models. In this paper, we first describe the real-time driving simulator which we have developed for investigating human control strategies. Next, we demonstrate the shortcomings of a typical continuous modeling approach in modeling discontinuous human control strategies. We then propose an HMM-based method for modeling discontinuous human control strategies. The proposed controller overcomes these shortcomings and demonstrates greater fidelity to the human training data. We conclude the paper with further comparisons between the two competing modeling approaches and propose avenues for future research.
M. C. Nechyba and Y. Xu, "On Learning Discontinuous Human Control Strategies,"International Journal Of Intelligent Systems, vol. 16, no. 4, pp. 547-70, 2001 (500 kb).