[논문]ML-HDP: A Hierarchical Bayesian Nonparametric Model for Recognizing Human Actions in Video

Tu, Nguyen Anh; Huynh-The, Thien; Khan, Kifayat Ullah; Lee, Young-Koo

doi:10.1109/tcsvt.2018.2816960

[해외논문] ML-HDP: A Hierarchical Bayesian Nonparametric Model for Recognizing Human Actions in Video

IEEE transactions on circuits and systems for video technology : a publication of the Circuits and Systems Society, v.29 no.3, 2019년, pp.800 - 814

Tu, Nguyen Anh (Department of Computer Science and Engineering, Kyung Hee University (Global Campus), Seoul, South Korea) , Huynh-The, Thien (Department of Computer Science and Engineering, Kyung Hee University (Global Campus), Seoul, South Korea) , Khan, Kifayat Ullah (Department of Computer Science and Engineering, Kyung Hee University (Global Campus), Seoul, South Korea) , Lee, Young-Koo (Department of Computer Science and Engineering, Kyung Hee University (Global Campus), Seoul, South Korea)

Abstract ▼ AI-Helper

Action recognition from videos is an important area of computer vision research due to its various applications, ranging from visual surveillance to human–computer interaction. To address action recognition problems, this paper presents a framework that jointly models multiple complex actions and motion units at different hierarchical levels. We achieve this by proposing a generative topic model, namely, multi-label hierarchical Dirichlet process (ML-HDP). The ML-HDP model formulates the co-occurrence relationship of actions and motion units, and enables highly accurate recognition. In particular, our topic model possesses the three-level representation in action understanding, where low-level local features are connected to high-level actions via mid-level atomic actions. This allows the recognition model to work discriminatively. In our ML-HDP, atomic actions are treated as latent topics and automatically discovered from data. In addition, we incorporate the notion of class labels into our model in a semi-supervised fashion to effectively learn and infer multi-labeled videos. Using discovered topics and inferred labels, which are jointly assigned to local features, we present the straightforward methods to perform three recognition tasks including action classification, joint classification and segmentation of continuous actions, and spatiotemporal action localization. In experiments, we explore the use of three different features and demonstrate the effectiveness of our proposed approach for these tasks on four public datasets: KTH, MSR-II, Hollywood2, and UCF101.

참고문헌 (61)

Wang, J., Liu, P., She, M.F.H., Kouzani, A., Nahavandi, S.. Supervised learning probabilistic Latent Semantic Analysis for human motion analysis. Neurocomputing, vol.100, 134-143.

상세보기
10.5244/C.24.8
Tu, N.A., Dinh, D.L., Rasel, M.K., Lee, Y.K.. Topic modeling and improvement of image representation for large-scale image retrieval. Information sciences, vol.366, 99-120.

상세보기
Rasiwasia, N., Vasconcelos, N.. Latent Dirichlet Allocation Models for Image Classification. IEEE transactions on pattern analysis and machine intelligence, vol.35, no.11, 2665-2679.

상세보기
10.1109/ICCV.2007.4408872
Proc 15th Conf Uncertainty Artif Intell Probabilistic latent semantic analysis hofmann 1999 289
Yang Wang, Mori, G.. Human Action Recognition by Semilatent Topic Models. IEEE transactions on pattern analysis and machine intelligence, vol.31, no.10, 1762-1774.

상세보기
Niebles, Juan Carlos, Wang, Hongcheng, Fei-Fei, Li. Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words. International journal of computer vision, vol.79, no.3, 299-318.

상세보기
SENSORS Traffic behavior recognition using the pachinko allocation model thien 2015 10.3390/s150716040 15 16040

상세보기
10.1109/CVPR.2007.383072
Peng, X., Zou, C., Qiao, Y., Peng, Q.. Action Recognition with Stacked Fisher Vectors. Lecture notes in computer science, vol.8693, 581-595.

상세보기
Sekma, M., Mejdoub, M., Ben Amar, C.. Human action recognition based on multi-layer Fisher vector encoding method. Pattern recognition letters, vol.65, 37-43.

상세보기
10.1109/CVPR.2015.7298735
10.1109/CVPR.2014.100
10.5244/C.29.177
10.1109/CVPR.2008.4587756
Laptev, Ivan. On Space-Time Interest Points. International journal of computer vision, vol.64, no.2, 107-123.

상세보기
Peng, X., Wang, L., Qiao, Y., Peng, Q.. Boosting VLAD with Supervised Dictionary Learning and High-Order Statistics. Lecture notes in computer science, vol.8691, 660-674.

상세보기
10.1109/CVPR.2012.6247807
Limin Wang, Yu Qiao, Xiaoou Tang. Latent Hierarchical Model of Temporal Structure for Complex Activity Classification. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society, vol.23, no.2, 810-822.

상세보기
Borzeshi, Ehsan Zare, Perez Concha, Oscar, Xu, Richard Yi Da, Piccardi, Massimo. Joint Action Segmentation and Classification by an Extended Hidden Markov Model. IEEE signal processing letters, vol.20, no.12, 1207-1210.

상세보기
Shi, Qinfeng, Cheng, Li, Wang, Li, Smola, Alex. Human Action Segmentation and Recognition Using Discriminative Semi-Markov Models. International journal of computer vision, vol.93, no.1, 22-32.

상세보기
10.1109/CVPR.2013.341
Kulkarni, Kaustubh, Evangelidis, Georgios, Cech, Jan, Horaud, Radu. Continuous Action Recognition Based on Sequence Alignment. International journal of computer vision, vol.112, no.1, 90-114.

상세보기
10.1109/CVPR.2015.7299059
10.1007/978-3-319-46493-0_45
J Mach Learn Res Distributed algorithms for topic models newman 2009 10 1801

상세보기
J Mach Learn Res MedLDA: Maximum margin supervised topic models zhu 2012 13 2237

상세보기
Very Deep Convolutional Networks for Large-scale Image Recognition simonyan 2014
UCF101: A dataset of 101 human actions classes from videos in the wild soomro 2012
10.1109/CVPR.2009.5206557
Proc IEEE Int Conf Pattern Recognit Workshops UT-interaction dataset, ICPR contest on semantic description of human activities (SDHA) ryoo 2010 2 4
10.1109/CVPR.2014.83
10.5244/C.30.58
J Mach Learn Res Latent Dirichlet allocation blei 2003 3 993
Teh, Yee Whye, Jordan, Michael I, Beal, Matthew J, Blei, David M. Hierarchical Dirichlet Processes. Journal of the American Statistical Association, vol.101, no.476, 1566-1581.

상세보기
Andrieu, Christophe; de Freitas, Nando etc. "An Introduction to MCMC for Machine Learning." Machine learning, v.50 no.1/2 (2003), pp. 5-43, doi:10.1023/A:1020281327116.
10.1017/CBO9780511802478.006
10.1109/ICPR.2004.1334462
10.1109/CVPR.2010.5539875
10.1109/ICCV.2003.1238663
10.1109/CVPR.2006.68
10.1109/VSPETS.2005.1570899
Jegou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., Schmid, C.. Aggregating Local Image Descriptors into Compact Codes. IEEE transactions on pattern analysis and machine intelligence, vol.34, no.9, 1704-1716.

상세보기
Sánchez, Jorge, Perronnin, Florent, Mensink, Thomas, Verbeek, Jakob. Image Classification with the Fisher Vector: Theory and Practice. International journal of computer vision, vol.105, no.3, 222-245.

상세보기
Wang, Heng, Kläser, Alexander, Schmid, Cordelia, Liu, Cheng-Lin. Dense Trajectories and Motion Boundary Descriptors for Action Recognition. International journal of computer vision, vol.103, no.1, 60-79.

상세보기
Wang, Heng, Oneata, Dan, Verbeek, Jakob, Schmid, Cordelia. A Robust and Efficient Video Representation for Action Recognition. International journal of computer vision, vol.119, no.3, 219-238.

상세보기
10.1109/ICCV.2009.5459279
10.5244/C.23.124
10.1109/CVPR.2011.5995470
Niebles, J.C., Chen, C.-W., Fei-Fei, L.. Modeling Temporal Structure of Decomposable Motion Segments for Activity Classification. Lecture notes in computer science, vol.6312, 392-405.

상세보기
10.1109/CVPR.2015.7298599
Proc IEEE Int Conf Comput Vis Pattern Recognit Discriminative subvolume search for efficient action detection yuan 2009 2442
10.1109/CVPR.2012.6247806
Sapienza, Michael, Cuzzolin, Fabio, Torr, Philip H.S.. Learning Discriminative Space-Time Action Parts from Weakly Labelled Videos. International journal of computer vision, vol.110, no.1, 30-47.

상세보기
10.1109/CVPR.2016.212
10.1109/CVPR.2016.215
Proc IEEE Int Conf Comput Vis Beyond Gaussian pyramid: Multi-skip feature stacking for action recognition lan 2015 204
Gilbert, A, Illingworth, J, Bowden, R. Action Recognition Using Mined Hierarchical Compound Features. IEEE transactions on pattern analysis and machine intelligence, vol.33, no.5, 883-897.

상세보기
Hou, R., Zamir, A.R., Sukthankar, R., Shah, M.. DaMN - Discriminative and Mutually Nearest: Exploiting Pairwise Category Proximity for Video Action Recognition. Lecture notes in computer science, vol.8691, 721-736.

상세보기
Tran, Du, Torresani, Lorenzo. EXMOVES: Mid-level Features for Efficient Action Recognition and Video Analysis. International journal of computer vision, vol.119, no.3, 239-253.

상세보기

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

[해외논문] ML-HDP: A Hierarchical Bayesian Nonparametric Model for Recognizing Human Actions in Video

Abstract ▼ AI-Helper

참고문헌 (61)

이 논문을 인용한 문헌

연구과제 타임라인

활용도 분석정보

활용도 Top5 논문

관련 콘텐츠

원문 URL 링크

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

연합인증

[해외논문] ML-HDP: A Hierarchical Bayesian Nonparametric Model for Recognizing Human Actions in Video

Abstract ▼ AI-Helper

참고문헌 (61)

이 논문을 인용한 문헌

연구과제 타임라인

전체(0) 논문(0) 특허(0) 보고서(0)

전체(0) 논문(0) 특허(0) 보고서(0)

활용도 분석정보

활용도 Top5 논문 더보기

관련 콘텐츠

원문 URL 링크

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

활용도 Top5 논문