Dr. rer. nat.
Now showing 1 - 1 of 1
Publicationtanh Neurons are Bayesian Decision Makers( 2021)
; ;The hyperbolic tangent (tanh) is a traditional choice for the activation function of the neurons of an artificial neural network. Here, we go through a simple calculation that shows that this modeling choice is linked to Bayesian decision theory. Our brief, tutorial-like discussion is intended as a reference to an observation rarely mentioned in standard textbooks.