about

All Posts

NEURAL MARIONETTE: A Transformer-based Multi-action Human Motion Synthesis System

Weiqiang Wang 1* , Xuefei Zhe 2* , Huan Chen 3 , Di Kang 2 , Tingguang Li 4 , Ruizhi Chen 1 , Linchao Bao 2
1LIESMARS, Wuhan University, 2Tencent AI Lab,
3Shenzhen International Graduate School, Tsinghua University, 4Tencent Robotics X
* Equal contribution
code[coming soon!] paper
Abstract ​ We present a neural network-based system for long-term, multi-action human motion synthesis. The system, dubbed as NEURAL MARIONETTE, can produce high-quality and meaningful motions with smooth transitions from simple user input, including a sequence of action tags with expected action duration, and optionally a hand-drawn moving trajectory if the user specifies. The core of our system is a novel Transformer based motion generation model, namely MARIONET, which can generate diverse …
Read More…