[논문]Motion recommendation for online character control

Cho, Kyungmin; Kim, Chaelin; Park, Jungjin; Park, Joonkyu; Noh, Junyong

doi:10.1145/3478513.3480512

[해외논문] Motion recommendation for online character control

ACM transactions on graphics, v.40 no.6, 2021년, pp.1 - 16

Cho, Kyungmin (KAIST, South Korea) , Kim, Chaelin (KAIST, South Korea) , Park, Jungjin (KAIST, South Korea) , Park, Joonkyu (KAIST, South Korea) , Noh, Junyong (KAIST, South Korea)

Abstract ▼ AI-Helper

Reinforcement learning (RL) has been proven effective in many scenarios, including environment exploration and motion planning. However, its application in data-driven character control has produced relatively simple motion results compared to recent approaches that have used large complex motion data without RL. In this paper, we provide a real-time motion control method that can generate high-quality and complex motion results from various sets of unstructured data while retaining the advantage of using RL, which is the discovery of optimal behaviors by trial and error. We demonstrate the results for a character achieving different tasks, from simple direction control to complex avoidance of moving obstacles. Our system works equally well on biped/quadruped characters, with motion data ranging from 1 to 48 minutes, without any manual intervention. To achieve this, we exploit a finite set of discrete actions, where each action represents full-body future motion features. We first define a subset of actions that can be selected in each state and store these pieces of information in databases during the preprocessing step. The use of this subset of actions enables the effective learning of control policy even from a large set of motion data. To achieve interactive performance at run-time, we adopt a proposal network and a k-nearest neighbor action sampler.

참고문헌 (56)

Deep Reinforcement Learning for Navigation in AAA Video Games. arXiv preprint arXiv:2011.04764 Alonso Eloi 2020 Eloi Alonso , Maxim Peter , David Goumard , and Joshua Romoff . 2020. Deep Reinforcement Learning for Navigation in AAA Video Games. arXiv preprint arXiv:2011.04764 ( 2020 ). Eloi Alonso, Maxim Peter, David Goumard, and Joshua Romoff. 2020. Deep Reinforcement Learning for Navigation in AAA Video Games. arXiv preprint arXiv:2011.04764 (2020).
Arikan, Okan, Forsyth, D. A.. Interactive motion generation from examples. ACM transactions on graphics, vol.21, no.3, 483-490.

상세보기
Miles Brundage, and Anil Anthony Bharath. Arulkumaran Kai 2017 Kai Arulkumaran , Marc Peter Deisenroth , Miles Brundage, and Anil Anthony Bharath. 2017 . A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017). Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. A brief survey of deep reinforcement learning. arXiv preprint arXiv:1708.05866 (2017).
Bergamin, Kevin, Clavet, Simon, Holden, Daniel, Forbes, James Richard. DReCon : data-driven responsive control of physics-based characters. ACM transactions on graphics, vol.38, no.6, 1-11.

상세보기
Proc. of GDC 2018 Bollo David 2016 David Bollo . 2016 . Inertialization: High-Performance Animation Transitions in'Gears of War '. Proc. of GDC 2018 (2016). David Bollo. 2016. Inertialization: High-Performance Animation Transitions in'Gears of War'. Proc. of GDC 2018 (2016).
10.1145/3084363.3085069
Openai gym. arXiv preprint arXiv:1606.01540 Brockman Greg 2016 Greg Brockman , Vicki Cheung , Ludwig Pettersson , Jonas Schneider , John Schulman , Jie Tang , and Wojciech Zaremba . 2016. Openai gym. arXiv preprint arXiv:1606.01540 ( 2016 ). Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. Openai gym. arXiv preprint arXiv:1606.01540 (2016).
Proc. of Nucl. ai Büttner Michael 2015 Michael Büttner and Simon Clavet . 2015 . Motion Matching-The Road to Next Gen Animation . Proc. of Nucl. ai (2015). Michael Büttner and Simon Clavet. 2015. Motion Matching-The Road to Next Gen Animation. Proc. of Nucl. ai (2015).
10.1145/3274247.3274506
Deep reinforcement learning in large discrete action spaces. arXiv preprint arXiv:1512.07679 Dulac-Arnold Gabriel 2015 Gabriel Dulac-Arnold , Richard Evans , Hado van Hasselt , Peter Sunehag , Timothy Lillicrap , Jonathan Hunt , Timothy Mann , Theophane Weber , Thomas Degris , and Ben Coppin . 2015. Deep reinforcement learning in large discrete action spaces. arXiv preprint arXiv:1512.07679 ( 2015 ). Gabriel Dulac-Arnold, Richard Evans, Hado van Hasselt, Peter Sunehag, Timothy Lillicrap, Jonathan Hunt, Timothy Mann, Theophane Weber, Thomas Degris, and Ben Coppin. 2015. Deep reinforcement learning in large discrete action spaces. arXiv preprint arXiv:1512.07679 (2015).
Robust Motion In-Betweening. 39, 4 Harvey Félix G. 2020 Félix G. Harvey , Mike Yurick , Derek Nowrouzezahrai , and Christopher Pal . 2020. Robust Motion In-Betweening. 39, 4 ( 2020 ). Félix G. Harvey, Mike Yurick, Derek Nowrouzezahrai, and Christopher Pal. 2020. Robust Motion In-Betweening. 39, 4 (2020).
10.1145/1230100.1230123
Nicolas Heess Dhruva TB Srinivasan Sriram Jay Lemmon Josh Merel Greg Wayne Yuval Tassa Tom Erez Ziyu Wang SM Eslami etal 2017. Emergence of locomotion behaviours in rich environments. arXiv preprint arXiv:1707.02286 (2017). Nicolas Heess Dhruva TB Srinivasan Sriram Jay Lemmon Josh Merel Greg Wayne Yuval Tassa Tom Erez Ziyu Wang SM Eslami et al. 2017. Emergence of locomotion behaviours in rich environments. arXiv preprint arXiv:1707.02286 (2017).
Holden, Daniel, Kanoun, Oussama, Perepichka, Maksym, Popa, Tiberiu. Learned motion matching. ACM transactions on graphics, vol.39, no.4,

상세보기
Holden, Daniel, Komura, Taku, Saito, Jun. Phase-functioned neural networks for character control. ACM transactions on graphics, vol.36, no.4, 1-13.

상세보기
Holden, Daniel, Saito, Jun, Komura, Taku. A deep learning framework for character motion synthesis and editing. ACM transactions on graphics, vol.35, no.4, 1-11.

상세보기
10.1145/2820903.2820918
Jiang, Yifeng, Van Wouwe, Tom, De Groote, Friedl, Liu, C. Karen. Synthesis of biologically realistic human motion using joint torque actuation. ACM transactions on graphics, vol.38, no.4, 1-12.

상세보기
10.1145/1186562.1015760
Kovar, Lucas, Gleicher, Michael, Pighin, Frédéric. Motion graphs. ACM transactions on graphics, vol.21, no.3, 473-482.

상세보기
Lee, Jehee, Chai, Jinxiang, Reitsma, Paul S. A., Hodgins, Jessica K., Pollard, Nancy S.. Interactive control of avatars animated with human motion data. ACM transactions on graphics, vol.21, no.3, 491-500.

상세보기
Lee, Jehee, Lee, Kang Hoon. Precomputing avatar behavior from human motion data. Graphical models, vol.68, no.2, 158-174.

상세보기
Lee, Seunghwan, Park, Moonseok, Lee, Kyoungmin, Lee, Jehee. Scalable muscle-actuated human simulation and control. ACM transactions on graphics, vol.38, no.4, 1-13.

상세보기
10.1145/1661412.1618515
10.1145/1866158.1866160
Levine, Sergey, Lee, Yongjoon, Koltun, Vladlen, Popović, Zoran. Space-time planning with parameterized locomotion controllers. ACM transactions on graphics, vol.30, no.3, 1-11.

상세보기
Levine, Sergey, Wang, Jack M., Haraux, Alexis, Popović, Zoran, Koltun, Vladlen. Continuous character control with low-dimensional embeddings. ACM transactions on graphics, vol.31, no.4, 1-10.

상세보기
Ling, Hung Yu, Zinno, Fabio, Cheng, George, Van De Panne, Michiel. Character controllers using motion VAEs. ACM transactions on graphics, vol.39, no.4,

상세보기
Liu, Libin, Panne, Michiel Van De, Yin, Kangkang. Guided Learning of Control Graphs for Physics-Based Characters. ACM transactions on graphics, vol.35, no.3, 1-14.

상세보기
10.1145/1833349.1778865
Luo, Ying-Sheng, Soeseno, Jonathan Hans, Chen, Trista Pei-Chun, Chen, Wei-Chao. CARL : controllable agent with reinforcement learning for quadruped locomotion. ACM transactions on graphics, vol.39, no.4,

상세보기
McCann, James, Pollard, Nancy. Responsive characters from motion fragments. ACM transactions on graphics, vol.26, no.3, 6-.

상세보기
Hierarchical Visuomotor Control of Humanoids. In International Conference on Learning Representations. https://openreview.net/forum?id=BJfYvo09Y7 Merel Josh 2019 Josh Merel , Arun Ahuja , Vu Pham , Saran Tunyasuvunakool , Siqi Liu , Dhruva Tirumala , Nicolas Heess , and Greg Wayne . 2019 a. Hierarchical Visuomotor Control of Humanoids. In International Conference on Learning Representations. https://openreview.net/forum?id=BJfYvo09Y7 Josh Merel, Arun Ahuja, Vu Pham, Saran Tunyasuvunakool, Siqi Liu, Dhruva Tirumala, Nicolas Heess, and Greg Wayne. 2019a. Hierarchical Visuomotor Control of Humanoids. In International Conference on Learning Representations. https://openreview.net/forum?id=BJfYvo09Y7
Neural Probabilistic Motor Primitives for Humanoid Control. In International Conference on Learning Representations. https://openreview.net/forum?id=BJl6TjRcY7 Merel Josh 2019 Josh Merel , Leonard Hasenclever , Alexandre Galashov , Arun Ahuja , Vu Pham , Greg Wayne , Yee Whye Teh , and Nicolas Heess . 2019 b. Neural Probabilistic Motor Primitives for Humanoid Control. In International Conference on Learning Representations. https://openreview.net/forum?id=BJl6TjRcY7 Josh Merel, Leonard Hasenclever, Alexandre Galashov, Arun Ahuja, Vu Pham, Greg Wayne, Yee Whye Teh, and Nicolas Heess. 2019b. Neural Probabilistic Motor Primitives for Humanoid Control. In International Conference on Learning Representations. https://openreview.net/forum?id=BJl6TjRcY7
Min, Jianyuan, Chai, Jinxiang. Motion graphs++ : a compact generative model for semantic motion analysis and synthesis. ACM transactions on graphics, vol.31, no.6, 1-12.

상세보기
Min, Jianyuan, Chen, Yen-Lin, Chai, Jinxiang. Interactive generation of human animation with deformable motion models. ACM transactions on graphics, vol.29, no.1, 1-12.

상세보기
Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 Mnih Volodymyr 2013 Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Alex Graves , Ioannis Antonoglou , Daan Wierstra , and Martin Riedmiller . 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 ( 2013 ). Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602 (2013).
Neural discrete representation learning. arXiv preprint arXiv:1711.00937 van den Oord Aaron 2017 Aaron van den Oord , Oriol Vinyals , and Koray Kavukcuoglu . 2017. Neural discrete representation learning. arXiv preprint arXiv:1711.00937 ( 2017 ). Aaron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu. 2017. Neural discrete representation learning. arXiv preprint arXiv:1711.00937 (2017).
Park, Soohwan, Ryu, Hoseok, Lee, Seyoung, Lee, Sunmin, Lee, Jehee. Learning predict-and-simulate policies from unorganized human motion data. ACM transactions on graphics, vol.38, no.6, 1-11.

상세보기
Peng, Xue Bin, Abbeel, Pieter, Levine, Sergey, van de Panne, Michiel. DeepMimic : example-guided deep reinforcement learning of physics-based character skills. ACM transactions on graphics, vol.37, no.4, 1-14.

상세보기
Peng, Xue Bin, Berseth, Glen, van de Panne, Michiel. Terrain-adaptive locomotion skills using deep reinforcement learning. ACM transactions on graphics, vol.35, no.4, 1-12.

상세보기
Peng, Xue Bin, Berseth, Glen, Yin, Kangkang, Van De Panne, Michiel. DeepLoco : dynamic locomotion skills using hierarchical deep reinforcement learning. ACM transactions on graphics, vol.36, no.4, 1-13.

상세보기
Safonova, Alla, Hodgins, Jessica K.. Construction and optimal search of interpolated motion graphs. ACM transactions on graphics, vol.26, no.3, 106-.

상세보기
Starke, Sebastian, Zhang, He, Komura, Taku, Saito, Jun. Neural state machine for character-scene interactions. ACM transactions on graphics, vol.38, no.6, 1-14.

상세보기
Starke, Sebastian, Zhao, Yiwei, Komura, Taku, Zaman, Kazi. Local motion phases for learning multi-contact character movements. ACM transactions on graphics, vol.39, no.4,

상세보기
Treuille, Adrien, Lee, Yongjoon, Popović, Zoran. Near-optimal character animation with continuous control. ACM transactions on graphics, vol.26, no.3, 7-.

상세보기
Q-Learning in enormous action spaces via amortized approximate maximization. arXiv preprint arXiv:2001.08116 de Wiele Tom Van 2020 Tom Van de Wiele , David Warde-Farley , Andriy Mnih , and Volodymyr Mnih . 2020. Q-Learning in enormous action spaces via amortized approximate maximization. arXiv preprint arXiv:2001.08116 ( 2020 ). Tom Van de Wiele, David Warde-Farley, Andriy Mnih, and Volodymyr Mnih. 2020. Q-Learning in enormous action spaces via amortized approximate maximization. arXiv preprint arXiv:2001.08116 (2020).
10.5555/3016100.3016191
UniCon: Universal Neural Controller For Physics-based Character Motion. arXiv preprint arXiv:2011.15119 Wang Tingwu 2020 Tingwu Wang , Yunrong Guo , Maria Shugrina , and Sanja Fidler . 2020. UniCon: Universal Neural Controller For Physics-based Character Motion. arXiv preprint arXiv:2011.15119 ( 2020 ). Tingwu Wang, Yunrong Guo, Maria Shugrina, and Sanja Fidler. 2020. UniCon: Universal Neural Controller For Physics-based Character Motion. arXiv preprint arXiv:2011.15119 (2020).
Won, Jungdam, Lee, Jehee. Learning body shape variation in physics-based characters. ACM transactions on graphics, vol.38, no.6, 1-12.

상세보기
Won, Jungdam, Park, Jongho, Kim, Kwanyu, Lee, Jehee. How to train your dragon : example-guided control of flapping flight. ACM transactions on graphics, vol.36, no.6, 1-13.

상세보기
Won, Jungdam, Park, Jungnam, Lee, Jehee. Aerobatics control of flying creatures via self-regulated learning. ACM transactions on graphics, vol.37, no.6, 1-10.

상세보기
Xie, Zhaoming, Ling, Hung Yu, Kim, Nam Hee, van de Panne, Michiel. ALLSTEPS: Curriculum‐driven Learning of Stepping Stone Skills. Computer graphics forum : journal of the European Association for Computer Graphics, vol.39, no.8, 213-224.

상세보기
Yu, Wenhao, Turk, Greg, Liu, C. Karen. Learning symmetric and low-energy locomotion. ACM transactions on graphics, vol.37, no.4, 1-12.

상세보기
Zhang, He, Starke, Sebastian, Komura, Taku, Saito, Jun. Mode-adaptive neural networks for quadruped motion control. ACM transactions on graphics, vol.37, no.4, 1-11.

상세보기
Zhao, L., Safonova, A.. Achieving good connectivity in motion graphs. Graphical models, vol.71, no.4, 139-152.

상세보기

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증