The origins of Box to
Instance were a couple of companies coming to us and saying they had
large datasets with bounding boxes that they needed to convert to
instances. This seemed like a reasonable request to us, so we created a
specific tool to help.
The tool can be selected by pressing the icon:
...in the toolbar, or by pressing “O”.
It works by first taking any bounding boxes on an image, and then
using them as anchor boxes in which an AI model looks for instance
shapes. The most likely shape is then presented to the user.
To accept a single prediction, move your mouse over the suggested instance, and left-click on it.
If you have an image with multiple bounding boxes, BTI will give you suggestions for every single one. Here's an example:
From here, you can either accept suggestions one by one by moving
your mouse over the suggested instance and left-clicking - or by
pressing "Enter" to accept all suggestions.
Underneath the hood
Box to instance is a tool that is directly available when creating a
new project or after having imported an existing project. However, it
does get smarter over time. For the first ten images, you will have a
pre-trained model assisting you when using the tool. After 10 images, we
switch to the custom-trained model IS model that you've trained.
This threshold controls the threshold of how strict the model should
be to give you a suggestion. BTI always gives you a maximum of one
suggestion per bounding box, but with this, you can control how strict
the tool should be with the suggestions it generates. As an example -
here we have the same image with two different thresholds: