Semantic enhanced for out-of-distribution detection.

deep learning label smoothing multi-perspective out-of-distribution detection semantic enhancement

Journal

Frontiers in neurorobotics
ISSN: 1662-5218
Titre abrégé: Front Neurorobot
Pays: Switzerland
ID NLM: 101477958

Informations de publication

Date de publication:
2022
Historique:
received: 13 08 2022
accepted: 11 10 2022
entrez: 21 11 2022
pubmed: 22 11 2022
medline: 22 11 2022
Statut: epublish

Résumé

While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to learn effective and comprehensive in-distribution (ID) semantic features. In this paper, two strategies are proposed to improve the generalization ability of the model to OOD data. Firstly, the original samples are replaced by features extracted from multiple "semantic perspectives" to obtain a comprehensive semantics of the samples; Second, the mean and variance of the batch samples are perturbed in the inference stage to improve the sensitivity of the model to the OOD data. The method we propose does not employ OOD samples, uses no pre-trained models in training, and does not require pre-processing of samples during inference. Experimental results show that our method enhances the semantic representation of ID data, surpasses state-of-the-art detection results on the OOD benchmark dataset, and significantly improves the performance of the model in detecting the SMOOD data.

Identifiants

pubmed: 36406952
doi: 10.3389/fnbot.2022.1018383
pmc: PMC9670166
doi:

Types de publication

Journal Article

Langues

eng

Pagination

1018383

Informations de copyright

Copyright © 2022 Jiang and Yu.

Déclaration de conflit d'intérêts

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Références

Science. 2015 Dec 11;350(6266):1332-8
pubmed: 26659050

Auteurs

Weijie Jiang (W)

College of Computer and Data Science, Fuzhou University, Fuzhou, China.

Yuanlong Yu (Y)

College of Computer and Data Science, Fuzhou University, Fuzhou, China.

Classifications MeSH