I implement multi-layer neural networks from scratch on the CIFAR-10 image classification dataset, to understand the fundamentals of neural networks and backpropagation. I implement 2 layer and 3 layer NN using SGD and ADAM optimizers.