Viewing a single comment thread. View all comments

jesuslop t1_iqmbdpg wrote

Reply to comment by seba07 in [D] Why is the machine learning community obsessed with the logistic distribution? by cthorrez

Genuine interest, How frequently would you say new projects/libraries use ReLU activations nowadays? (as oposed to other activations)

EDIT: reformultated

3

cthorrez OP t1_iqmvcze wrote

Exactly, lots of people use gelu now. (A more expensive version which utilizes a Gaussian distribution...)

5