Picture generated by Dall-e Just a few phrases on thresholding, the softmax activation operate, introducing an…