Jimmie Butler
Jimmie's Mostly Tech Blog

Jimmie's Mostly Tech Blog

Follow
Jimmie Butler

Jimmie Butler

2 followers

Developer with around 10 years experience. Full stack developer, with experience in dev-ops, and interest in machine learning.

Available for work.

ML Experiment Log: Squaring as activation layer

Oct 8, 20224 min read

The purpose of an activation layer is to add some non-linearity to the network. This allows expressing much more complex tasks with our networks. But...

On the fly expansion of linear layers