FathomNet: A global image database for enabling artificial intelligence in the ocean.


Journal

Scientific reports
ISSN: 2045-2322
Titre abrégé: Sci Rep
Pays: England
ID NLM: 101563288

Informations de publication

Date de publication:
23 09 2022
Historique:
received: 10 05 2022
accepted: 06 09 2022
pubmed: 24 9 2022
medline: 28 9 2022
entrez: 23 9 2022
Statut: epublish

Résumé

The ocean is experiencing unprecedented rapid change, and visually monitoring marine biota at the spatiotemporal scales needed for responsible stewardship is a formidable task. As baselines are sought by the research community, the volume and rate of this required data collection rapidly outpaces our abilities to process and analyze them. Recent advances in machine learning enables fast, sophisticated analysis of visual data, but have had limited success in the ocean due to lack of data standardization, insufficient formatting, and demand for large, labeled datasets. To address this need, we built FathomNet, an open-source image database that standardizes and aggregates expertly curated labeled data. FathomNet has been seeded with existing iconic and non-iconic imagery of marine animals, underwater equipment, debris, and other concepts, and allows for future contributions from distributed data sources. We demonstrate how FathomNet data can be used to train and deploy models on other institutional video to reduce annotation effort, and enable automated tracking of underwater concepts when integrated with robotic vehicles. As FathomNet continues to grow and incorporate more labeled data from the community, we can accelerate the processing of visual data to achieve a healthy and sustainable global ocean.

Identifiants

pubmed: 36151130
doi: 10.1038/s41598-022-19939-2
pii: 10.1038/s41598-022-19939-2
pmc: PMC9508077
doi:

Types de publication

Journal Article Research Support, Non-U.S. Gov't Research Support, U.S. Gov't, Non-P.H.S.

Langues

eng

Sous-ensembles de citation

IM

Pagination

15914

Informations de copyright

© 2022. The Author(s).

Références

Sci Adv. 2017 May 03;3(5):e1602374
pubmed: 28508058
Sci Robot. 2021 Jun 16;6(55):
pubmed: 34135116
Nature. 2015 May 28;521(7553):436-44
pubmed: 26017442
Sci Data. 2016 Mar 15;3:160018
pubmed: 26978244
Nat Methods. 2018 Aug;15(8):587-590
pubmed: 30065368
Nature. 2010 Sep 9;467(7312):154-5
pubmed: 20829777
Ann Rev Mar Sci. 2020 Jan 3;12:23-48
pubmed: 31433959
PLoS One. 2013;8(1):e51629
pubmed: 23505408
PLoS One. 2019 Dec 31;14(12):e0218904
pubmed: 31891586
Sensors (Basel). 2018 Jan 02;18(1):
pubmed: 29301318
Ann Rev Mar Sci. 2016;8:463-90
pubmed: 26515810
Biodivers Data J. 2017 Jan 09;(5):e10989
pubmed: 28325978
Nat Biotechnol. 2020 Oct;38(10):1124-1126
pubmed: 32973359
PLoS One. 2015 Oct 28;10(10):e0141039
pubmed: 26509918
Soc Stud Sci. 2018 Feb;48(1):57-79
pubmed: 29199547
Ann Rev Mar Sci. 2022 Jan 3;14:277-301
pubmed: 34460314
PLoS One. 2012;7(1):e29715
pubmed: 22238640
Curr Biol. 2012 Dec 4;22(23):2189-202
pubmed: 23159596

Auteurs

Kakani Katija (K)

Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, 95039, USA. kakani@mbari.org.
California Institute of Technology, Graduate Aerospace Laboratories, Pasadena, 91125, USA. kakani@mbari.org.
Smithsonian Institution, National Museum of Natural History, Washington, DC, 37012, USA. kakani@mbari.org.

Eric Orenstein (E)

Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, 95039, USA.

Brian Schlining (B)

Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, 95039, USA.

Lonny Lundsten (L)

Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, 95039, USA.

Kevin Barnard (K)

Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, 95039, USA.

Giovanna Sainz (G)

Monterey Bay Aquarium Research Institute, Research and Development, Moss Landing, 95039, USA.

Oceane Boulais (O)

NOAA, Southeast Fisheries Science Center, Key Biscayne, 33149, USA.

Megan Cromwell (M)

NOAA, National Centers for Environmental Information, Stennis Space Center, St. Louis, 39529, USA.

Erin Butler (E)

CVision AI Inc., Research and Development, Medford, 02155, USA.

Benjamin Woodward (B)

CVision AI Inc., Research and Development, Medford, 02155, USA.

Katherine L C Bell (KLC)

Ocean Discovery League, Saunderstown, 02874, USA.

Articles similaires

Robotic Surgical Procedures Animals Humans Telemedicine Models, Animal

Odour generalisation and detection dog training.

Lyn Caldicott, Thomas W Pike, Helen E Zulch et al.
1.00
Animals Odorants Dogs Generalization, Psychological Smell
Animals TOR Serine-Threonine Kinases Colorectal Neoplasms Colitis Mice
Animals Tail Swine Behavior, Animal Animal Husbandry

Classifications MeSH