Jimmie Butler
Jimmie's Mostly Tech Blog

Jimmie's Mostly Tech Blog

Series

ML


Articles in this series

ML Experiment Log: Squaring as activation layer

Oct 8, 20224 min read

The purpose of an activation layer is to add some non-linearity to the network. This allows expressing much more complex tasks with our networks. But...

On the fly expansion of linear layers