Variance

Variance measures the average value of the squared deviation from the mean. The instance with the lowest Variance is considered the most informative. Therefore, labeling this instance can be very useful to our model.

  • If the Variance is 0, then the model doesn’t have a clue about the correct label. 
  • If the Variance is 1, then the model has a clear “belief” about the correct label.
Source

Imagine we have only 2 instances – A and B –, and the model has to decide which of them to suggest for annotation. It has made the following class predictions:

  • Instance A: “cat” – 0.5, “milkshake” – 0.45, “cloud” – 0.05.
  • Instance B: “cat” – 0.4, “milkshake” – 0.3, “cloud” – 0.3.

In this case, our model will choose instance B over A, as 0.0067 is less than 0.0406:

Learn more about the other heuristics:

Last updated on Aug 08, 2022

Get to production reliably.

Hasty is a unified agile ML platform for your entire Vision AI pipeline — with minimal integration effort for you.