Iterations

Iterations are the number of steps through batches of the training data needed to complete one epoch.

For better understanding, consider the following example:

• The total training set of images = 5000
• Batch Size = 64

From the above values, 64 samples will be taken each time through the neural network forward and backward. This constitutes one iteration.

Therefore, if you are loading 64 images at a time (in one batch), to go through all 5000 images, you will need 5000 / 64 = about 78 iterations.