Semantic enhanced for out-of-distribution detection.
deep learning
label smoothing
multi-perspective
out-of-distribution detection
semantic enhancement
Journal
Frontiers in neurorobotics
ISSN: 1662-5218
Titre abrégé: Front Neurorobot
Pays: Switzerland
ID NLM: 101477958
Informations de publication
Date de publication:
2022
2022
Historique:
received:
13
08
2022
accepted:
11
10
2022
entrez:
21
11
2022
pubmed:
22
11
2022
medline:
22
11
2022
Statut:
epublish
Résumé
While improving the performance on the out-of-distribution (OOD) benchmark dataset, the existing approach misses a portion of the valid discriminative information such that it reduces the performance on the same manifold OOD (SMOOD) data. The key to addressing this problem is to prompt the model to learn effective and comprehensive in-distribution (ID) semantic features. In this paper, two strategies are proposed to improve the generalization ability of the model to OOD data. Firstly, the original samples are replaced by features extracted from multiple "semantic perspectives" to obtain a comprehensive semantics of the samples; Second, the mean and variance of the batch samples are perturbed in the inference stage to improve the sensitivity of the model to the OOD data. The method we propose does not employ OOD samples, uses no pre-trained models in training, and does not require pre-processing of samples during inference. Experimental results show that our method enhances the semantic representation of ID data, surpasses state-of-the-art detection results on the OOD benchmark dataset, and significantly improves the performance of the model in detecting the SMOOD data.
Identifiants
pubmed: 36406952
doi: 10.3389/fnbot.2022.1018383
pmc: PMC9670166
doi:
Types de publication
Journal Article
Langues
eng
Pagination
1018383Informations de copyright
Copyright © 2022 Jiang and Yu.
Déclaration de conflit d'intérêts
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Références
Science. 2015 Dec 11;350(6266):1332-8
pubmed: 26659050