ECS Research
Publications
Intranet Tools
RSS 1.0 Feed
RSS 2.0 Feed
Atom Feed
 

Local and Global Models for Articulated Motion Analysis

Wagg, D. K. (2006) Local and Global Models for Articulated Motion Analysis. PhD thesis, University of Southampton.

Download

[img]
Preview
PDF
9Mb

Abstract

Vision is likely the most important of the senses employed by humans in understanding their environment, but computer systems are still sorely lacking in this respect. The number of potential applications for visually capable computer systems is huge; this thesis focuses on the field of motion capture, in particular dealing with the problems encountered when analysing the motion of articulated or jointed targets, such as people. Joint articulation greatly increases the complexity of a target object, and increases the incidence of self-occlusion (one body part obscuring another). These problems are compounded in typical outdoor scenes by the clutter and noise generated by other objects.
This thesis presents a model-based approach to automated extraction of walking people from video data, under indoor and outdoor capture conditions. Local and global modelling strategies are employed in an iterative process, similar to the Generalised Expectation-Maximisation algorithm. Prior knowledge of human shape, gait motion and self-occlusion is used to guide this extraction process. The extracted shape and motion information is applied to construct a gait signature, sufficient for recognition purposes.
Results are presented demonstrating the success of this approach on the Southampton Gait Database, comprising 4820 sequences from 115 subjects. A recognition rate of 98.6% is achieved on clean indoor data, comparing favourably with other published approaches. This recognition rate is reduced to 87.1% under the more difficult outdoor capture conditions. Additional analyses are presented examining the discriminative potential of model features. It is shown that the majority of discriminative potential is contained within body shape features and gait frequency, although motion dynamics also make a significant contribution.

Creators:David K Wagg
Item Type:Thesis
Keywords:gait, walking, motion capture, biometric
Research Group:Information - Signals, Images, Systems
Deposited On:01 Dec 2006 by Wagg, David
ID Code:13222
Last Modified:06 Jan 2010 20:56
Performance Indicator:EZ~01~01~01

Tools

Metadata

Download Statistics

Last month

Last year

Members of ECS may view the download statistics dashboard for this record.

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in this archive you will be forwarded to the paracite service. Poorly formated references will probably not work.

[Aggarwal 99] J K Aggarwal and Q Cai. “Human Motion Analysis: A Review.” Computer Vision and Image Understanding, 73(3):428-440, 1999.

[Al-Mazeed 03] A H Al-Mazeed, M S Nixon and S R Gunn. “Fusing Complementary Operators to Enhance Foreground/Background Segmentation.” Proc. British Machine Vision Conference, 501-510, 2003.

[Angeloni 94] C Angeloni, P O Riley and E D Krebs. “Frequency Content of Whole Body Gait Kinematic Data.” IEEE Trans. Rehabilitation Engineering, 2(1):40-46, 1994.

[Ayyappa 97] E Ayyappa. “Normal Human Locomotion, Part 1: Basic Concepts and Terminology.” Journal of Prosthetics and Orthotics, 9(1):10-17, 1997.

[Baumberg 94] A Baumberg and D Hogg. “Learning Flexible Models from Image Sequences.” Proc. European Conference on Computer Vision, 299-308, 1994.

[Bazin 05] A I Bazin, L Middleton and M S Nixon. “Probabilistic Fusion of Gait Features for Biometric Verification.” Proc. Information Fusion, 2005.

[BenAbdelkader 02] C BenAbdelkader, R Cutler and L Davis. “Stride and Cadence as a Biometric in Automatic Person Identification and Verification.” Proc. Automatic Face and Gesture Recognition, 372-377, 2002.

[BenAbdelkader04] C BenAbdelkader, R Cutler and L Davis. “Gait Recognition Using Image Self-Similarity.” Applied Signal Processing, 4:1-14, 2004.

[Bregler 04] C Bregler, J Malik and K Pullen. “Twist Based Acquisition and Tracking of Animal and Human Kinematics.” International Journal of Computer Vision, 56(3):179-194, 2004.

[Cheung 05a] G K M Cheung, S Baker and T Kanade. “Shape-From-Silhouette Across Time Part I: Theory and Algorithms.” International Journal of Computer Vision, 62(3):221-247, 2005.

[Cheung 05b] G K M Cheung, S Baker and T Kanade. “Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking.” International Journal of Computer Vision, 63(3):225-245, 2005.

[Collins 02] R T Collins, R Gross and J Shi. “Silhouette-based Human Identification from Body Shape and Gait.” Proc. Automatic Face and Gesture Recognition, 351-356, 2002.

[Cootes 92] T J Cootes, C J Taylor, D H Cooper and J Graham. “Training Models of Shapes From Sets of Examples.” Proc. British Machine Vision Conference, 9-18, 1992.

[Cunado 03] D Cunado, M S Nixon and J N Carter. “Automatic Extraction and Description of Human Gait Models for Recognition Purposes.” Computer Vision and Image Understanding, 90(1):1-41, 2003.

[Cutler 00] R Cutler and L Davis. “Robust Real-Time Periodic Motion Detection, Analysis, and Applications.” IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):781-796, 2000.

[Davison 01] A J Davison, J Deutscher and I D Reid. “Markerless Motion Capture of Complex Full-Body Movement for Character Animation.” Proc. Computer Animation and Simulation, 3-14, 2001.

[Dempster 77] A P Dempster, N M Laird and D B Rubin. “Maximum-likelihood from incomplete data via the EM algorithm.” Journal of the Royal Statistical Society B, 39:1-38, 1977.

[Dontcheva 03] M Dontcheva, G Yngve and Z Popovic. “Layered Acting for Character Animation.” ACM Trans. Graphics, 22(3):409-416, 2003.

[Drummond 02] T Drummond and R Cipolla. “Real-Time Visual Tracking of Complex Structures.” IEEE Trans. Pattern Analysis and Machine Intelligence, 24(7):932-946, 2002.

[Elgammal 02] A Elgammal, R Duraiswami, D Harwood and L S Davis. “Background and Foreground Modeling Using Nonparametric Kernel Density Estimation for Visual Surveillance.” Proceedings of the IEEE, 90(7):1151–1163, 2002.

[Foster 03] J P Foster, M S Nixon and A Prügel-Bennett. “Automatic Gait Recognition using Area-Based Metrics.” Pattern Recognition Letters, 24(14):2489-2497, 2003.

[Fox 97] J Fox. “Applied Regression Analysis, Linear Models and Related Methods.” Sage Publications, 1997.

[Gavrila 96] D Gavrila and L Davis. “3-D Model-based Tracking of Humans in Action: a Multi-view Approach.” Proc. Computer Vision and Pattern Recognition, 73-80, 1996.

[Gavrila 99] D M Gavrila. “The Visual Analysis of Human Movement: A Survey.” Computer Vision and Image Understanding, 73(1):82-98, 1999.

[Han 04] J Han and B Bhanu. “Statistical Feature Fusion for Gait-Based Human Recognition.” Proc. Computer Vision and Pattern Recognition, 842-847, 2004.

[Haritaoglu 00] I Haritaoglu, D Harwood and L S Davis. “W4: Real-Time Surveillance of People and Their Activities.” IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):809-830, 2000.

[Hu 04] W Hu, T Tan, L Wang and S Maybank. “A Survey on Visual Surveillance of Object Motion and Behaviours.” IEEE Trans. Systems, Man and Cybernetics, 34(3):334-352, 2004.

[Hayfron-Acquah 03] J B Hayfron-Acquah, M S Nixon and J N Carter. “Automatic Gait Recognition by Symmetry Analysis.” Pattern Recognition Letters, 24(13):2175-2183, 2003.

[Illingworth 88] J Illingworth and J Kittler. “A Survey of the Hough Transform.” Computer Vision, Graphics and Image Processing, 44:87-116, 1988.

[Inman 81] V T Inman, H J Ralston and F Todd. “Human Walking.” Williams and Wilkins, Baltimore, 1981.

[Isard 98] M Isard and A Blake. “CONDESATION – Conditional Density Propagation for Visual Tracking.” International Journal of Computer Vision, 29(1):5-28, 1998.

[Johannson 73] G Johannson. “Visual perception of biological motion and a model for its analysis.” Perception and Psychophysics, 14:201-211, 1973.

[Kale 04a] A Kale, A K RoyChowdhury and R Chellappa. “Fusion of Gait and Face for Human Identification.” Proc. International Conference on Acoustics, Speech and Signal Processing, 901-904, 2004.

[Kale 04b] A Kale, A Sundaresan, A N Rajagopalan, N P Cuntoor, A K Roy-Chowdhury, V Krüger and R Chellappa. “Identification of Humans Using Gait.” IEEE Trans. Image Processing, 13(9):1163-1173.

[Kass 87] M Kass, A Witkin and D Terzopoulos. “Snakes: Active Contour Models.” International Journal of Computer Vision, 1(4):321-331, 1987.

[Kochanek 84] D Kochanek and R Bartels. “Interpolating Splines with Local Tension, Continuity and Bias Control.” Computer Graphics, 18(3):33-41, 1984.

[Lappas 02] P Lappas, J N Carter and R I Damper. “Robust Evidence-based Object Tracking.” Pattern Recognition Letters, 23:253-260, 2002.

[Larssen 04] A T Larssen. “Physical Computing – Representations of Human Movement in Human-Computer Interactions.” Proc. Asia-Pacific Conference on Human-Computer Interaction, 661-665, 2004.

[Lee 02] L Lee and W E L Grimson. “Gait Analysis for Recognition and Classification.” Proc. Automatic Face and Gesture Recognition, 155-162, 2002.

[Lee 04] C S Lee and A Elgammal. “Gait Style and Gait Content: Bilinear Models for Gait Recognition Using Gait Re-sampling.” Proc. Automatic Face and Gesture Recognition, 147-152, 2004.

[Little 98] J Little and J Boyd. “Recognizing People by Their Gait: The Shape of Motion.” Videre, 1(2):2-32, 1998.

[Liu 04] Z Liu, L Malave, A Osuntugun, P Sudhakar and S Sarkar. “Towards Understanding the Limits of Gait Recognition”, Proc. SPIE Defense and Security Symposium: Biometric Technology for Human Identification, 195-205, 2004.

[MacCormick 00] J MacCormick and A Blake. “A Probabilistic Exclusion Principle for Tracking Multiple Objects.” International Journal of Computer Vision, 39:57-71, 2000.

[McLachlan 92] G J McLachlan. “Discriminant Analysis and Statistical Pattern Recognition.” John Wiley, 1992.

[Meyer 98] D Meyer, J Posl and H Niemann. “Gait Classification with HMMs for Trajectories of Body Parts Extracted by Mixture Densities.” Proc. British Machine Vision Conference, 459-468, 1998.

[Moeslund 01] T B Moeslund and E Granum. “A Survey of Computer Vision-Based Human Motion Capture.” Computer Vision and Image Understanding, 81(3):231-268, 2001.

[Mowbray 04] S D Mowbray and M S Nixon. “Extraction and Recognition of Periodically Deforming Objects by Continuous, Spatio-temporal Shape Description.” Proc. Computer Vision and Pattern Recognition, 895-901, 2004.

[Murray 64] M P Murray, A B Drought and R C Kory. “Walking Patterns of Normal Men.” Journal of Bone and Joint Surgery, 46(A):335-360, 1964.

[Nash 97] J M Nash, J N Carter and M S Nixon. “Dynamic Feature Extraction via the Velocity Hough Transform.” Pattern Recognition Letters, 18:1035–1047, 1997.

[Ning 04a] H Ning, T Tan, L Wang and W Hu. “People Tracking Based on Motion Model and Motion Constraints with Automatic Initialization.” Pattern Recognition, 37:1423-1440, 2004.

[Ning 04b] H Ning, T Tan, L Wang and W Hu. “Kinematics-based Tracking of Human Walking in Monocular Video Sequences.” Image and Vision Computing, 22:429-441, 2004.

[Nixon 99] M S Nixon, J N Carter, D Cunado, P S Huang and S V Stevenage, “Automatic gait recognition.” Biometrics: Personal Identification in a Networked Society, Kluwer Academic Publishing, 11:231-250, 1999.

[Nixon 03] M S Nixon, J N Carter, M G Grant, L G Gordon and J B Hayfron-Acquah. “Automatic Recognition by Gait: Progress and Prospects.” Sensor Review, 23(4):323-331, 2003.

[Novak 87] C L Novak and S A Shafer. “Color Edge Detection.” Proc. DARPA Image Understanding Workshop, 35-37, 1987.

[Perrin 01] D P Perrin and C E Smith. “Rethinking Classical Internal Forces for Active Contour Models.” Proc. Computer Vision and Pattern Recognition, 615-620, 2001.

[Perry 92] J Perry. “Gait Analysis: Normal and Pathological Function.” Slack Incorporated, 1992.

[Phillips 02] P J Phillips, S Sarkar, I Robledo, P Grother and K Bowyer. “The Gait Identification Challenge Problem: Data Sets and Baseline Algorithm.” Proc. International Conference on Pattern Recognition, 385-388, 2002.

[Plänkers 03] R Plänkers and P Fua. “Articulated Soft Objects for Multiview Shape and Motion Capture.” IEEE Trans. Pattern Analysis and Machine Intelligence, 25(9):1182-1187, 2003.

[Prati 01] A Prati, R Cucchiara, I Mikic and M M Trivedi. “Analysis and Detection of Shadows in Video Streams: A Comparative Evaluation.” Proc. Computer Vision and Pattern Recognition, 571-576, 2001.

[Ripley 96] B Ripley. “Pattern Recognition and Neural Networks.” Cambridge University Press, 1996.

[Rosin 91] P L Rosin and T Ellis. “Detecting and Classifying Intruders in Image Sequences.” Proc. British Machine Vision Conference, 293-300, 1991.

[Rosin 95] P L Rosin and T Ellis. “Image Difference Threshold Strategies and Shadow Detection.” Proc. British Machine Vision Conference, 347-356, 1995.

[Sarkar 05] S Sarkar, P J Phillips, Z Liu, I R Vega, P Grother and K Bowyer. “The Human ID Gait Challenge Problem: Data Sets, Performance and Analysis.” IEEE Trans. Pattern Analysis and Machine Intelligence, 27(2):162-177, 2005.

[Shakhnarovich 02] G Shakhnarovich and T Darrell. “On Probabilistic Combination of Face and Gait Cues for Identification.” Proc. Automatic Face and Gesture Recognition, 176-181, 2002.

[Shutler 02] J D Shutler, M G Grant, M S Nixon and J N Carter. “On a Large Sequence Based Human Gait Database.” Proc. Recent Advances in Soft Computing, 66-71, 2002.

[Shutler 06] J D Shutler and M S Nixon. “Zernike Velocity Moments for Sequence-Based Description of Moving Features.” Image and Vision Computing, 24:343-356, 2006.

[Sidenbladh 02] H Sidenbladh, M J Black and L Sigal. “Implicit Probabilistic Models of Human Motion for Synthesis and Tracking.” Proc. European Conference on Computer Vision, 784-800, 2002.

[Sonka 99] M Sonka, V Hlavac and R Boyle. “Image Processing, Analysis and Machine Vision (2nd Edition).” PWS Publishing, 1999.

[Sony 05] Sony Computer Entertainment Inc. http://www.eyetoy.com

[Stauffer 00] C Stauffer and W Grimson. “Learning Patterns of Activity Using Real-time Tracking.” IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):747–757, 2000.

[Stevenage 99] S V Stevenage, M S Nixon and K Vince. “Visual Analysis of Gait as a Cue to Identity.” Applied Cognitive Psychology, 13(6):513-526, 1999.

[Tanawongsuwan 03] R Tanawongsuwan and Aaron Bobick. “Modelling the Effects of Walking Speed on Appearance-Based Gait Recognition.” Proc. Computer Vision and Pattern Recognition, 783-790, 2003.

[Tolliver 03] D Tolliver and R T Collins. “Gait Shape Estimation for Identification.” Proc. Audio- and Video-Based Biometric Person Authentication, 734-742, 2003.

[Urtasun 04a] R Urtasun and P Fua. “3D Human Body Tracking using Deterministic Temporal Motion Models.” Proc. European Conference on Computer Vision, 92-107, 2004.

[Urtasun 04b] R Urtasun and P Fua. “3D Tracking for Gait Characterization and Recognition.” Proc. Automatic Face and Gesture Recognition, 17-22, 2004.

[Veeraraghavan 04] A Veeraraghavan, A R Chowdhury and R Chellappa. “Role of Shape and Kinematics in Human Movement Analysis.” Proc. Computer Vision and Pattern Recognition, 730-737, 2004.

[Vegas 03] I R Vega and S Sarkar. “Statistical Motion Model Based on the Change of Feature Relationships: Human Gait-Based Recognition.” IEEE Trans. Pattern Analysis and Machine Intelligence, 25(10):1323-1328, 2003.

[Veres 04] G V Veres, L Gordon, J N Carter, M S Nixon. “What Image Information is Important in Silhouette-Based Gait Recognition?” Proc. Computer Vision and Pattern Recognition, 776-782, 2004.

[Veres 05] G V Veres, M S Nixon, L Middleton and J N Carter. “Fusion of Dynamic and Static Features for Gait Recognition over Time.” Proc. International Conference on Information Fusion, 2005.

[Wagg 03] D K Wagg and M S Nixon. “Model-Based Gait Enrolment in Real-World Imagery.” Proc. Multimodal User Authentication, 189-195, 2003.

[Wagg 04a] D K Wagg and M S Nixon. “On Automated Model-Based Gait Extraction and Analysis.” Proc. Automatic Face and Gesture Recognition, 11-16, 2004.

[Wagg 04b] D K Wagg and M S Nixon. “Automated Markerless Extraction of Walking People Using Deformable Contour Models.” Computer Animation and Virtual Worlds, 15(3-4):399-406, 2004. Given as an oral presentation at Computer Animation and Social Agents, 2004.

[Wang 03a] L Wang, W Hu and T Tan. “Recent Developments in Human Motion Analysis.” Pattern Recognition, 36(3):585-601, 2003.

[Wang 03b] L Wang, T Tan, H Ning and W Hu. “Silhouette Analysis-Based Gait Recognition for Human Identification.” IEEE Trans. Pattern Analysis and Machine Intelligence, 25(12):1505-1518, 2003.

[Wang 04] L Wang, H Ning, T Tan and W Hu. “Fusion of Static and Dynamic Body Biometrics for Gait Recognition.” IEEE Trans. Circuits and Systems for Video Technology, 14(2):149-158, 2004.

[Whittle 99] M W Whittle and D Levine. “Three-dimensional Relationships between the Movements of the Pelvis and Lumbar Spine during Normal Gait.” Human Movement Science, 18:681-692, 1999.

[Williams 92] D J Williams and M Shah. “A Fast Algorithm for Active Contours and Curvature Estimation.” Computer Vision, Graphics and Image Processing: Image Understanding, 55(1):14-26, 1992.

[Winter 90] D A Winter. “Biomechanics and Motor Control of Human Movement (2nd Edition).” John Wiley and Sons, 1990.

[Winter 91] D A Winter. “The Biomechanics and Motor Control of Human Gait: Normal, Elderly and Pathological.” University of Waterloo press, Ontario. 1991.

[Wu 83] C F J Wu. “On the Convergence Properties of the EM Algorithm.” Annals of Statistics, 11(1):95-103, 1983.

[Yam 04] C Yam, M S Nixon and J N Carter. “Automated Person Recognition by Walking and Running via Model-Based Approaches.” Pattern Recognition, 37(5):1057-1072, 2004.

[Yang 92] Y H Yang and M D Levine. “The Background Primal Sketch: An Approach for Tracking Moving Objects.” Machine Vision Applications, 5:17–34, 1992.

[Yoo 03] J Yoo and M S Nixon. “On Laboratory Gait analysis via Computer Vision.” Proc. Biologically Inspired Machine Vision, Theory and Application, 109-113, 2003.

[Zhang 04] J Zhang, R Collins, Y Liu. “Representation and Matching of Articulated Shapes.” Proc. Computer Vision and Pattern Recognition, 342-349, 2004.

[Zhao 04] T Zhao and R Nevatia. “Tracking Multiple Humans in Complex Situations.” IEEE Trans. Pattern Analysis and Machine Intelligence, 26(9):1208-1221, 2004.

[Zhou 05] X Zhou, B Bhanu and J Han. “Human Recognition at a Distance in Video by Integrating Face Profile and Gait.” Proc. Audio- and Video-based Biometric Person Authentication, 533-543, 2005.

Corrections

Repository Staff Only: item control page

   Welcome from Deputy Head of School (Research) Research Prospectus Industrial Partnerships New Research Students Notes for Guidance New Research Students Notes for Guidance
The ECS EPrints Repository supports OAI 2.0 with a base URL of http://eprints.ecs.soton.ac.uk/cgi/oai2

EPrints is free software developed by the University of Southampton to facilitate Open Access to research.		 EPrints