Active Learning is an iterative algorithm that detects the most informative images in the project and suggests them for labeling first. The more uncertain the model is about the image's labels, the more informative it is considered, and therefore, the higher rank it receives. Labeling the high-ranking images first might notably increase the model’s performance and lead to faster model development.
You can use the Active Learning feature in two possible ways: Auto-generated ranks and Ranks on demand. We will talk about both cases in detail below.
Auto-generated ranks are a default Hasty feature that automatically suggests you the best images for labeling. You do not need to enable it since Auto-generated ranks are already available when you create the project.
The feature is linked to the following AI-assistants:
This means that, as you start annotating the images and hence training the corresponding AI-assistants, the feature will automatically generate image ranks for labeling.
The ranks are updated every time the assistant is trained. Therefore, the suggestions made by the Auto-generated ranks feature will improve as you label more images and train the AI-assistants. When the image ranks change, you will receive a corresponding notification.
The default heuristic for each family model is Margin. However, you can easily change it and select different heuristics for each model. Currently, the heuristics provided by Hasty include:
You can also select the “None” option to not use any heuristics for specific model families. In this case, you will not see image ranks for the respective model family unless you generate Ranks on demand. Instead, you will see the default alphabetical sorting of the images in your project.
To tweak Auto-generated ranks parameters, please go to the Active Learning settings in the lower left corner.
The alternative to Auto-generated ranks is the Ranks on demand feature. It allows you to generate a certain amount of image ranks whenever needed, not automatically. For example, you could use this feature to label 100 images from your project.
This feature allows you to customize the Active Learning process by giving you control over the number of images you want to rank and the sources of these images (selected datasets).
To access it, you should go to Active Learning settings in the lower left corner and manually select it.
Press the New rank button to generate a rank on demand. For each run, you will need to specify:
After you create a run, you can view it in the Active Learning tab of the Project Dashboard. You will receive a notification when the run is completed.
In general, no option is inherently better than another. The Auto-generated ranks are convenient since they do not require much supervision and are updated automatically when your AI-assistant updates.
However, you might opt for the Ranks on demand when:
Apart from using Active Learning heuristics directly, you can go for other options:
To switch to one of these options, go to the Active Learning settings in the lower left corner.
Speaking about the further steps, you have various options. For example, you can use Automated labeling to annotate the suggested images automatically and then run AI Consensus Scoring to review the existing labels.
To learn more about the general Active Learning concept, please check out our article.
If you have questions or suggestions, please don't hesitate to contact us. Happy training!