Метаевристичнi алгоритми для обрiзки нейронних мереж
Loading...
Date
2025
Authors
Котляренко, Анастасiя
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This work studies neural network pruning with metaheuristic optimization methods. Pruning was formulated as an optimization problem with a target function that is a weighted sum of neural network accuracy and sparsity. This problem was solved with stochastic metaheuristic methods (Genetic Algorithm and Particle Swarm Optimization) that generate binary masks. Obtained results demonstrate that pruning with metaheuristic methods is comparative with 𝐿2 pruning when finetuning is possible and is significantly more performant when no post-pruning finetuning is available.
Description
Keywords
neural networks, pruning, metaheuristic, Genetic Algorithm, Particle Swarm Optimization, 𝐿2 pruning, bachelor`s thesis