AI Consensus Scoring (AI CS) is one of Hasty’s key features offering an AI-powered Quality assurance solution. Initially, AI CS supported Class, Object Detection, and Instance Segmentation reviews. However, you can now use it to evaluate your Image Tags annotations. This is precisely what we are going to cover on this page.
Let’s jump in.
AI CS for Image Tags is another option in the AI Consensus Scoring environment. So, to schedule the corresponding run, you need to:
4. Click on the “Create new run button“ and choose “Tag review” as the run type.
5. Once the run is complete, click on its name in the AI CS environment to see the suggestions.
Tag review focuses on identifying the following mistakes:
Misclassification:
For a single-choice tag group, if AI CS disagrees that your tag is correct;
Missing tag:
For multiple-choice tag groups or default tags;
For a single-choice tag group, if the original annotation misses any choice for it;
Extra tag:
For multiple-choice tag groups or default tags.
As of today, the suggestions are displayed in the following fashion:
You see the whole image with all the tags (original and suggested) on the thumbnail card;
You can accept or reject all the suggestions in one click by clicking on the “Accept all” / “Reject all” options on the thumbnail card. Additionally, paying attention to the colors displayed after a user’s action might be worth it. The bright blue one means that the tag was added to the image and the transparent one signalizes that after user action (could be both accept or reject depending on the type of error), the tag was not added to the image;
You can also accept or reject suggestions one by one on the thumbnail card;
By clicking on an image, you get a more detailed overview with an additional option of adding a missing tag directly from the AI CS environment through a dropdown menu.
As you may have noticed, AI CS results are not divided by error types. Instead, you can see all potential tag errors per image. Still, if you want to use the filter by error type options, you can easily do so via the topbar options.
80% of vision AI teams don’t make it to production because of bad or insufficient data. Hasty solves removes that risk.