About activation functions

Hi, Pierre.

There’s a brilliant thread related to your query where the same topic has been discussed.

Besides, you can check this as well.

If you still face any doubt, you are welcome!