Detection and annotation of plant organs from digitised herbarium scans using deep learning.

convolutional neural networks deep learning digitisation herbarium specimens image annotation object detection and localisation plant organ detection

Journal

Biodiversity data journal
ISSN: 1314-2828
Titre abrégé: Biodivers Data J
Pays: Bulgaria
ID NLM: 101619899

Informations de publication

Date de publication:
2020
Historique:
received: 01 08 2020
accepted: 16 11 2020
entrez: 21 12 2020
pubmed: 22 12 2020
medline: 22 12 2020
Statut: epublish

Résumé

As herbarium specimens are increasingly becoming digitised and accessible in online repositories, advanced computer vision techniques are being used to extract information from them. The presence of certain plant organs on herbarium sheets is useful information in various scientific contexts and automatic recognition of these organs will help mobilise such information. In our study, we use deep learning to detect plant organs on digitised herbarium specimens with Faster R-CNN. For our experiment, we manually annotated hundreds of herbarium scans with thousands of bounding boxes for six types of plant organs and used them for training and evaluating the plant organ detection model. The model worked particularly well on leaves and stems, while flowers were also present in large numbers in the sheets, but were not equally well recognised.

Identifiants

pubmed: 33343217
doi: 10.3897/BDJ.8.e57090
pii: 57090
pmc: PMC7746675
doi:

Types de publication

Journal Article

Langues

eng

Pagination

e57090

Informations de copyright

Sohaib Younis, Marco Schmidt, Claus Weiland, Stefan Dressler, Bernhard Seeger, Thomas Hickler.

Références

Sensors (Basel). 2016 Aug 03;16(8):
pubmed: 27527168
Front Plant Sci. 2016 Sep 22;7:1419
pubmed: 27713752
Sci Data. 2017 Feb 14;4:170016
pubmed: 28195585
IEEE Trans Neural Netw Learn Syst. 2019 Nov;30(11):3212-3232
pubmed: 30703038
Appl Plant Sci. 2019 Feb 28;7(4):e01223
pubmed: 31024779
BMC Evol Biol. 2017 Aug 11;17(1):181
pubmed: 28797242
Neural Netw. 2019 May;113:54-71
pubmed: 30780045
Sensors (Basel). 2016 Nov 15;16(11):
pubmed: 27854271
Appl Plant Sci. 2020 Jun 26;8(6):e11351
pubmed: 32626606
Plant Methods. 2019 Nov 23;15:141
pubmed: 31768186
New Phytol. 2019 Jan;221(1):110-122
pubmed: 30160314
Appl Plant Sci. 2020 Jul 01;8(6):e11367
pubmed: 32626609
Trends Ecol Evol. 2017 Jul;32(7):531-546
pubmed: 28465044

Auteurs

Sohaib Younis (S)

Senckenberg Biodiversity and Climate Research Centre (SBiK-F), Frankfurt am Main, Germany Senckenberg Biodiversity and Climate Research Centre (SBiK-F) Frankfurt am Main Germany.
Department of Mathematics and Computer Science, Philipps-University Marburg, Marburg, Germany Department of Mathematics and Computer Science, Philipps-University Marburg Marburg Germany.

Marco Schmidt (M)

Palmengarten der Stadt Frankfurt, Frankfurt am Main, Germany Palmengarten der Stadt Frankfurt Frankfurt am Main Germany.
Senckenberg Biodiversity and Climate Research Centre (SBiK-F), Frankfurt am Main, Germany Senckenberg Biodiversity and Climate Research Centre (SBiK-F) Frankfurt am Main Germany.

Claus Weiland (C)

Senckenberg Biodiversity and Climate Research Centre (SBiK-F), Frankfurt am Main, Germany Senckenberg Biodiversity and Climate Research Centre (SBiK-F) Frankfurt am Main Germany.

Stefan Dressler (S)

Senckenberg Research Institute and Natural History Museum, Frankfurt am Main, Germany Senckenberg Research Institute and Natural History Museum Frankfurt am Main Germany.

Bernhard Seeger (B)

Department of Mathematics and Computer Science, Philipps-University Marburg, Marburg, Germany Department of Mathematics and Computer Science, Philipps-University Marburg Marburg Germany.

Thomas Hickler (T)

Senckenberg Biodiversity and Climate Research Centre (SBiK-F), Frankfurt am Main, Germany Senckenberg Biodiversity and Climate Research Centre (SBiK-F) Frankfurt am Main Germany.

Classifications MeSH