Techniques For Increasing Activation Sparsity In Artificial Neural Networks

/Techniques For Increasing Activation Sparsity In Artificial Neural Networks

Abstract

A method for implementing an artificial neural network in a computing system that comprises performing a compute operation using an input activation and a weight to generate an output activation, and modifying the output activation using a noise value to increase activation sparsity.