Hidden Markov Models as a Process Monitor in Robotic AssemblyAuthors: Geir E. Hovland and Brenan J. McCarragherAffiliation: ABB Corporate Research (Billingstad) and the Australian National University (Canberra) Reference: 1999, Vol 20, No. 4, pp. 201-223. |
Keywords: Discrete event systems, sensory perception, robotic assembly
Abstract: A process monitor for robotic assembly based on hidden Markov models (HMMs) is presented. The HMM process monitor is based on the dynamic force/torque signals arising from interaction between the workpiece and the environment. The HMMs represent a stochastic, knowledge-based system in which the models are trained off-line with the Baum-Welch reestimation algorithm. The assembly task is modeled as a discrete event dynamic system in which a discrete event is defined as a change in contact state between the workpiece and the environment. Our method (1) allows for dynamic motions of the workpiece, (2) accounts for sensor noise and friction, and (3) exploits the fact that the amount of force information is large when there is a sudden change of discrete state in robotic assembly. After the HMMs have been trained, the authors use them on-line in a 2D experimental setup to recognize discrete events as they occur. Successful event recognition with an accuracy as high as 97with a training set size of only 20 examples for each discrete event.
PDF (3465 Kb)
DOI: 10.4173/mic.1999.4.2
Currently no DOI forward links to this article
References:
[1] ASTUTI, P. (1995). The convergence and control of a class of hybrid dynamic systems. PhD thesis, The Australian National University, Department of Engineering.
[2] BADANO, F. et al (1991). Robotic assembly by slight random movements. Robotica, 9, pp. 23-29, doi:10.1017/S0263574700015538
[3] BICCHI, A., SALISBURY, J.K. and BROCK D.L. (1993). Contact sensing from force measurements. Int. J Robotics Research, 12(3), pp. 249-262, doi:10.1177/027836499301200304
[4] CHIACCHIO, P., et al. (1991). Closed loop inverse kinematics schemes for constrained redundant manipulators with task space augmentation and task priority strategy. Int. Robotics Research, 10(4), pp. 410-425, doi:10.1177/027836499101000409
[5] DONALD, B.R. (1990). Planning multi-step error detection and recovery strategies. Int. J. Robotics Research, 9(1), pp. 3-60, doi:10.1177/027836499000900101
[6] DUTRÉ S., BRUYNINCKX, H. and DE SCHUTTER, J. (1996). (Minneapolis, MN, April 22-28). Contact identification and monitoring based on energy. Proc. 1996 International Conference on Robotics and Automation, pp. 1333-1338.
[7] EBERMAN, B. and SALISBURY, J.K. (1994). Application of change detection to dynamic contact sensing. Int. J. Robotics Research, 13(5), pp. 369-394, doi:10.1177/027836499401300501
[8] HANNAFORD, B. and LEE, P. (1991). Hidden Markov model analysis of force/torque information in telemanipulation. Int. J Robotics Research, 10(5), pp. 528-539, doi:10.1177/027836499101000508
[9] HIRAI, S. (1989). Analysis and planning of manipulation using the theory of polyhedral convex cones. PhD thesis, Kyoto University, Department of Applied Mathematics and Physics.
[10] HOVLAND, G.E. and MCCARRACHER, B. J. (1996). (Adelaide, November 21-22). Sensory perception and dynamic programming. Proc. First Australian Data Fusion Symposium.
[11] HUANG, X.D., ARIKI, Y. and JACK, M.A. (1990). Hidden Markov Models for Speech Recognition. Edinburgh: Edinburgh University Press.
[12] HUO, Q. and CHAN, C. (1993). The gradient projection method for the training of hidden Markov models. Speech Comm., 13, pp. 307-313, doi:10.1016/0167-6393(93)90029-K
[13] JOHANSSON, R.S. (1978). Tactile sensibility in the human hand: receptive field characteristics of mechanoreceptive units in the glabrous skin area. J. Physiology, 281, pp. 101-123.
[14] MCCARRACHER, B. J. (1996). Task primitives for the discrete event modeling and control of 6-DOF assembly tasks. IEEE Trans. Robotics and Automation, 12(2), pp. 280-289, doi:10.1109/70.488947
[15] MCCARRAGHER, B.J. and ASADA, H. (1995a). The discrete event control of robotic assembly tasks. ASME J Dyn. Sys. Meas. Control, 117(3), pp. 384-393, doi:10.1115/1.2799129
[16] MCCARRAGHER, B.J. and ASADA, H. (1995b). The discrete event modelling and trajectory planning of robotic assembly tasks. ASME J. Dyn. Sys. Meas. Control, 117(3), pp. 394-400, doi:10.1115/1.2799130
[17] MCCARRAGHER, B.J. and ASADA, H. (1993). Qualitative template matching using dynamic process models for state transition recognition of robotic assembly. ASME J Dyn. Sys. Meas. Control, 115(2A), pp. 261-269, doi:10.1115/1.2899030
[18] PICONE, J. (1990). Continuous speech recognition using hidden Markov models. IEEE ASSP Magazine, 7(3), pp. 26-41, doi:10.1109/53.54527
[19] RABINER, L.R. and JUANG, B.H. (1986). An introduction to hidden Markov models. IEEE ASSP Magazine, 3(1), pp. 4-16, doi:10.1109/MASSP.1986.1165342
[20] RABINER, L.R. et al. (1985a). Recognition of isolated digits using hidden Markov models with continuous mixture densities. AT&T Technical J., 64(6), pp. 1211-1234.
[21] RABINER, L.R. et al (1985b). Some properties of continuous hidden Markov model representations. AT&T Technical J. 64(6), pp. 1251-1269.
[22] TRINKLE, J.C. and ZENG, D.C. (1995). Prediction of the quasistatic planar motion of a contacted rigid body. IEEE Trans. Robotics and Automation, 11(2), pp. 229-246, doi:10.1109/70.370504
[23] VLONTZOS, L.A. and KUNG, S.Y. (1992). Hidden Markov models for character recognition. IEEE Trans. Image Processing, 1(4), pp. 539-543, doi:10.1109/83.199925
[24] YANG, J., XU, Y. and CHEN, C.S. (1994). Hidden Markov model approach to skill learning and its application to telerobotics. IEEE Trans. Robotics and Automation, 10(5), pp. 621-631, doi:10.1109/70.326567
[25] XU, Y. and YANG, J. (1995). (Nagoya, Japan, May 19-26). Towards Human-Robot Coordination: Skill Modeling and Transferring via Hidden Markov Model. Proceedings of the IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 1906-1911.
[26] ZHU, Q. (1996). Hidden Markov model for dynamic obstacle avoidance of mobile robot navigation. IEEE Trans. Robotics and Automation, 7(3), pp. 390-397, doi:10.1109/70.88149
BibTeX:
@article{MIC-1999-4-2,
title={{Hidden Markov Models as a Process Monitor in Robotic Assembly}},
author={Hovland, Geir E. and McCarragher, Brenan J.},
journal={Modeling, Identification and Control},
volume={20},
number={4},
pages={201--223},
year={1999},
doi={10.4173/mic.1999.4.2},
publisher={Norwegian Society of Automatic Control}
};


