Artificial Neural network

What exactly is a neuron in an AI neural network made up of? Is it a software? Is it a code - maybe in Python, C, etc. or is it something else? It has to be made of something by someone.

Hello, @faisal_chawdhary,

For a neuron in a “Dense Layer”, mathematically speaking, it is

z = f( wx + b )

where
x is the input to the neuron;
z is the output of the neuron;
w and b are trainable parameters of the neuron - they together specify the behavior of that neuron;
f(...) denotes the activation function for the neuron

The neuron takes the input and modify it with some trainable parameters and the activation function before it produces an output to the next neuron (if any).

Certainly, we need to code it for it to run on a computer, but the math is what lies behind the code.

Cheers,
Raymond

1 Like

Why don’t you go through the Machine Learning and Deep Learning Specializations that they have here. It will give you a lot of information regarding your understanding of AI and neural networks.

1 Like