Multi-animal pose estimation, identification and tracking with DeepLabCut.
Journal
Nature methods
ISSN: 1548-7105
Titre abrégé: Nat Methods
Pays: United States
ID NLM: 101215604
Informations de publication
Date de publication:
04 2022
04 2022
Historique:
received:
23
04
2021
accepted:
04
03
2022
pubmed:
14
4
2022
medline:
16
4
2022
entrez:
13
4
2022
Statut:
ppublish
Résumé
Estimating the pose of multiple animals is a challenging computer vision problem: frequent interactions cause occlusions and complicate the association of detected keypoints to the correct individuals, as well as having highly similar looking animals that interact more closely than in typical multi-human scenarios. To take up this challenge, we build on DeepLabCut, an open-source pose estimation toolbox, and provide high-performance animal assembly and tracking-features required for multi-animal scenarios. Furthermore, we integrate the ability to predict an animal's identity to assist tracking (in case of occlusions). We illustrate the power of this framework with four datasets varying in complexity, which we release to serve as a benchmark for future algorithm development.
Identifiants
pubmed: 35414125
doi: 10.1038/s41592-022-01443-0
pii: 10.1038/s41592-022-01443-0
pmc: PMC9007739
doi:
Types de publication
Journal Article
Research Support, U.S. Gov't, Non-P.H.S.
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
496-504Subventions
Organisme : Howard Hughes Medical Institute
Pays : United States
Commentaires et corrections
Type : CommentIn
Informations de copyright
© 2022. The Author(s).
Références
Sci Adv. 2019 Sep 04;5(9):eaaw0736
pubmed: 31517043
Front Behav Neurosci. 2023 May 30;17:1111908
pubmed: 37324523
Integr Comp Biol. 2021 Oct 4;61(3):900-916
pubmed: 34050741
Nature. 2018 Apr;556(7701):326-331
pubmed: 29643503
Science. 2000 Dec 22;290(5500):2319-23
pubmed: 11125149
IEEE Trans Pattern Anal Mach Intell. 2013 Dec;35(12):2878-90
pubmed: 24136428
Nat Methods. 2011 Sep 11;8(10):871-8
pubmed: 21909102
Science. 2015 Jun 12;348(6240):aaa2478
pubmed: 26068858
Nat Neurosci. 2018 Sep;21(9):1281-1289
pubmed: 30127430
Nature. 2014 May 15;509(7500):325-30
pubmed: 24828191
J Exp Biol. 2017 Feb 15;220(Pt 4):705-712
pubmed: 27965272
Nat Neurosci. 2020 Dec;23(12):1537-1549
pubmed: 33169033
Elife. 2020 Dec 08;9:
pubmed: 33289631
Neuron. 2019 Oct 9;104(1):11-24
pubmed: 31600508
Curr Opin Neurobiol. 2020 Feb;60:1-11
pubmed: 31791006
Proc Natl Acad Sci U S A. 2018 Jun 19;115(25):E5716-E5725
pubmed: 29871948
Elife. 2021 Nov 30;10:
pubmed: 34846301
Nat Methods. 2019 Feb;16(2):179-182
pubmed: 30643215
Neuron. 2020 Oct 14;108(1):44-65
pubmed: 33058765
Nat Protoc. 2019 Jul;14(7):2152-2176
pubmed: 31227823