Loss function
A mathematical function measuring the difference between predicted and true outputs
It is used to evaluate the performance of the model by evaluating how good our choice of trainable parameters are at fitting the data
Training a model consists of finding the best values for the trainable parameters, which means we are trying to minimise the loss function.