An interactive explainer

A neural network never has an insight. It rolls downhill.

Strip the word 'learning' of its mystique and one small loop remains: measure how wrong you are, find which way is downhill, take a tiny step, repeat a million times. Watch that loop invented, broken, and pushed off a cliff — every frame here comes from the real math, not choreography.

Gradient descent · Neural network training · Learning rate

AI & Machine Learning · Intermediate · 10 min · How gradient descent makes machines learn — an interactive explainer on ViLearn, with a simulation and a knowledge check. All explainers.

Related: Why sending the model more can make the answer worse · How mixture of experts makes giant models affordable · How an LLM picks the next word