Enjoy a diagram of a 3-leyer feedforward neural network

[dtonhofer]

I like to have maps of what’s going on … so here is one!

Nothing complex. But creating the diagram was as astonishingly nonevident and I had to redo it probably three times until satisifed (I used yEd, which is a very simple programme with limited capabilites. It works, but can be a cow)

The image and graphml file can be found at

diagrams/neural_networks at master · dtonhofer/diagrams

[rmwkwok]

Hello @dtonhofer,

Thanks for sharing the diagram! I enjoy reading it, too. For those who is going to read it, I recommend to go to the git repo for full resolution of the diagram.

@dtonhofer, in case it may help perfect something, I like to share what I happen to see, and for your already very well prepared diagram, there are three very small things:

For the following one, I can understand what message you are delivering, only a very slight confusion I myself might have. (plus a spelling )

Onwards!

Cheers,
Raymond

[dtonhofer]

Thank you Raymond! I will fix those, and yes, … it’s the “label”.

(I was actually calling J the ERROR right until the end … sometimes I just confuse names of elements … that’s why I like maps)

[dtonhofer]

Updated now! Thank you again. As before, the latest version is at:

diagrams/neural_networks at master · dtonhofer/diagrams

[rmwkwok]

Hello, @dtonhofer!

Thanks for the update! I like maps, too! When I was at secondary school, there was a time I tried to put the Physics and Chemistry I learned on papers pieced together with tapes. At that time, my plan was to stick it on the wall in my room after I finished it, but the final product turned out to be not quite the way I had first imagined, so I turned to making notes and ended up with something over 100 pages. There were other more successful maps, but I always think of this one because I had put a lot more energy into it.

Still, I love maps!

Cheers,
Raymond

By the way:

[dtonhofer]

Ahh … fixed!

And if only yEd supported MathJax. The tool is “too simple”.

All right, the latest version is on github.

Thank you for the detailed scrutiny. I would not have noticed…

– David

[dtonhofer]

All right, I just uploaded the latest slightly changed version. Now for the backpropagation diagrams.

[rmwkwok]

I literally clapped hands seeing you stuck it on the wall. Looking at my wall, I start to think what I can put on!!

By the way, looking forward to your next diagram!

Cheers,
Raymond

[dtonhofer]

The feed-forward diagram has been updated a bit:

Hopefully back-propagation diagrams will be in acceptable shape soon. They are quite a bit more complicated to get right or readable.

And I have to get back to the course, too