Why Do We Need Neural Networks with Hidden Layers?
This text was inspired by the section "Activation functions" in Google's Machine Learning Crash Course and a blog post mentioned in that section. I decided to explain the rationale of all this to myself.
Let's say we have a number of features and a binary classification task (e.g. whether a house will be sold, based on two features: its price and area).