Neural Network Size

[Christian_Simonis]

@Chiang_Yuhan

I have found my signal is steady state although it is excited by random forces.

Ok, very good. Then the Fourier transform can be a powerful tool for feature engineering.

@Chiang_Yuhan

I’m relatively new to deep learning, so if you have more to share about feature engineering, please give me some sources that I could look into in the future. It would be greatly appreciated.

Here some threads that might be interesting for you:

• Can we start with the circle equation as decision boundary? - #12 by Christian_Simonis
• Question on Linear and logistic regression - #3 by Christian_Simonis

In the 2nd link, also a residual analysis (per feature) is described. Often this makes sense to evaluate whether or not you still have systematic patterns left that you could potentially exploit in your feature engineering: In a perfect world you would just see some random (Gaussian) distribution in your residua and no systematic patterns.

Also a feature importance analysis like SHAP (SHapley Additive exPlanations) can be a powerful tool in your feature engineering process.

Happy learning and good luck with your project!

Best regards
Christian