Small Network for Lightweight Task in Computer Vision: A Pruning Method Based on Feature Representation.
Journal
Computational intelligence and neuroscience
ISSN: 1687-5273
Titre abrégé: Comput Intell Neurosci
Pays: United States
ID NLM: 101279357
Informations de publication
Date de publication:
2021
2021
Historique:
received:
03
02
2021
revised:
20
03
2021
accepted:
08
04
2021
entrez:
7
5
2021
pubmed:
8
5
2021
medline:
29
7
2021
Statut:
epublish
Résumé
Many current convolutional neural networks are hard to meet the practical application requirement because of the enormous network parameters. For accelerating the inference speed of networks, more and more attention has been paid to network compression. Network pruning is one of the most efficient and simplest ways to compress and speed up the networks. In this paper, a pruning algorithm for the lightweight task is proposed, and a pruning strategy based on feature representation is investigated. Different from other pruning approaches, the proposed strategy is guided by the practical task and eliminates the irrelevant filters in the network. After pruning, the network is compacted to a smaller size and is easy to recover accuracy with fine-tuning. The performance of the proposed pruning algorithm is validated on the acknowledged image datasets, and the experimental results prove that the proposed algorithm is more suitable to prune the irrelevant filters for the fine-tuning dataset.
Identifiants
pubmed: 33959156
doi: 10.1155/2021/5531023
pmc: PMC8075670
doi:
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
5531023Informations de copyright
Copyright © 2021 Yisu Ge et al.
Déclaration de conflit d'intérêts
The authors declare that they have no conflicts of interest regarding this work.
Références
IEEE Trans Pattern Anal Mach Intell. 2019 Dec;41(12):3048-3056
pubmed: 30296213