Human Motion Prediction via Dual-Attention and Multi-Granularity Temporal Convolutional Networks.

attention mechanism human motion prediction multi-granularity temporal convolutional networks

Journal

Sensors (Basel, Switzerland)
ISSN: 1424-8220
Titre abrégé: Sensors (Basel)
Pays: Switzerland
ID NLM: 101204366

Informations de publication

Date de publication:
16 Jun 2023
Historique:
received: 17 05 2023
revised: 12 06 2023
accepted: 14 06 2023
medline: 10 7 2023
pubmed: 8 7 2023
entrez: 8 7 2023
Statut: epublish

Résumé

Intelligent devices, which significantly improve the quality of life and work efficiency, are now widely integrated into people's daily lives and work. A precise understanding and analysis of human motion is essential for achieving harmonious coexistence and efficient interaction between intelligent devices and humans. However, existing human motion prediction methods often fail to fully exploit the dynamic spatial correlations and temporal dependencies inherent in motion sequence data, which leads to unsatisfactory prediction results. To address this issue, we proposed a novel human motion prediction method that utilizes dual-attention and multi-granularity temporal convolutional networks (DA-MgTCNs). Firstly, we designed a unique dual-attention (DA) model that combines joint attention and channel attention to extract spatial features from both joint and 3D coordinate dimensions. Next, we designed a multi-granularity temporal convolutional networks (MgTCNs) model with varying receptive fields to flexibly capture complex temporal dependencies. Finally, the experimental results from two benchmark datasets, Human3.6M and CMU-Mocap, demonstrated that our proposed method significantly outperformed other methods in both short-term and long-term prediction, thereby verifying the effectiveness of our algorithm.

Identifiants

pubmed: 37420819
pii: s23125653
doi: 10.3390/s23125653
pmc: PMC10304512
pii:
doi:

Types de publication

Journal Article

Langues

eng

Sous-ensembles de citation

IM

Subventions

Organisme : National Natural Science Foundation of China
ID : 62233003
Organisme : National Natural Science Foundation of China
ID : 62073072
Organisme : Key Projects of Key R&D Program of Jiangsu Province
ID : BE2020006
Organisme : Key Projects of Key R&D Program of Jiangsu Province
ID : BE2020006-1
Organisme : Shenzhen Natural Science Foundation Grant
ID : JCYJ20210324132202005
Organisme : Shenzhen Natural Science Foundation Grant
ID : JCYJ20220818101206014

Références

IEEE Trans Image Process. 2015 Apr;24(4):1315-29
pubmed: 25643407
IEEE Trans Pattern Anal Mach Intell. 2014 Jul;36(7):1325-39
pubmed: 26353306
IEEE Trans Pattern Anal Mach Intell. 2022 Jun;44(6):3300-3315
pubmed: 33434123
IEEE Trans Pattern Anal Mach Intell. 2016 Jan;38(1):14-29
pubmed: 26656575
IEEE Trans Pattern Anal Mach Intell. 2008 Feb;30(2):283-98
pubmed: 18084059
IEEE Trans Pattern Anal Mach Intell. 2023 Jan;45(1):681-697
pubmed: 34982672
IEEE Trans Pattern Anal Mach Intell. 2022 Jun;44(6):3316-3333
pubmed: 33481706

Auteurs

Biaozhang Huang (B)

Key Laboratory Measurement and Control of CSE Ministry of Education, School of Automation, Southeast University, Nanjing 210002, China.
Nanjing Center for Applied Mathematics, Nanjing 211135, China.

Xinde Li (X)

Key Laboratory Measurement and Control of CSE Ministry of Education, School of Automation, Southeast University, Nanjing 210002, China.
Nanjing Center for Applied Mathematics, Nanjing 211135, China.

Articles similaires

[Redispensing of expensive oral anticancer medicines: a practical application].

Lisanne N van Merendonk, Kübra Akgöl, Bastiaan Nuijen
1.00
Humans Antineoplastic Agents Administration, Oral Drug Costs Counterfeit Drugs

Smoking Cessation and Incident Cardiovascular Disease.

Jun Hwan Cho, Seung Yong Shin, Hoseob Kim et al.
1.00
Humans Male Smoking Cessation Cardiovascular Diseases Female
Humans United States Aged Cross-Sectional Studies Medicare Part C
1.00
Humans Yoga Low Back Pain Female Male

Classifications MeSH