×

back Annotation assistance requests

Learn how to ask any person for advice on the label of an image annotation.

Sometimes while annotating images, you may not be sure which label is correct for a particular object or region on the image. Although you are certain that the object or region is of interest, you can't decide between a few candidate labels or can't identify it at all but you know just the right expert who might help you. This is where annotation assistance requests come in. With an annotation assistance request you can ask any person for help with a particular image annotation. BIIGLE handles all the details to make the information exchange efficient and easy. Annotation assistance requests are not available for video annotations.

Annotation assistance requests (or just "assistance requests") can be created by project editors, experts or admins. To do so, open the annotations tab in the image annotation tool and then select an annotation. At the bottom of the annotations tab, you will now see the active button . Click this button to create a new assistance request for the selected annotation. An annotation assistance request can only be created for a single annotation. If the annotation is deleted, the assistance request is deleted, too.

Each new assistance request requires a short text to describe your request or ask questions. Be sure not to write too much, so the receiver of your request does not have to spend too much time with it. If the receiver of the request should be another BIIGLE user, you can choose them here, too. Optionally, you can select one or more candidate labels to suggest to the receiver of the assistance request. This makes it even easier for them to respond, as they only have to select a candidate label and then submit the response. Be careful not to select too many candidate labels here, as well. Finally, click and you will be redirected to the new assistance request.

Each user can only create one annotation assistance request per minute. Be conservative when you send assistance requests to not overwhelm and annoy the people you are asking for help. If you have a few annotations with an uncertain label but which display the same thing, only send a single assistance request. Once you know the correct label you can attach it to the rest of the annotations yourself.

To respond to a new assistance request, the receiver needs a unique link to the response website for the request. If the receiver of the assistance request was a BIIGLE user, they will be automatically notified and receive this link in the notification. If somebody else should be the receiver of the assistance request, you have to copy and send the link to them manually. The link is displayed in the sidebar of the assistance request page and looks similar to this one:

https://biigle.de/annotation-assistance-requests/respond/a721d8260353032666cb0cc3c7950e3bd99aaa3984343198dce85246181fccf0 

The response website displays the image and the annotation that are associated with the assistance request, as well as your request text and suggested labels. The receiver of the assistance request is then asked to either pick one of the suggested labels, enter a response text or both. Once they responded to the assistance request, you will get a notification in your notification center. The assistance request is now Closed and the unique link for the receiver of the assistance request is no longer valid.

You can view a list of all your annotation assistance requests in the Assistance requests tab of your notification center. Click on an assistance request to view its details. If an assistance request is still Open (i.e. has no response yet) only the first of the two tabs in the sidebar, showing the request information, is active. Once the assistance request is closed, the response information tab will be activated, showing you the response text and/or the selected label of the receiver of the request.

You can delete an assistance request at any time. Note that any notification to a BIIGLE user is still sent but the link to respond to the assistance request will no longer work.

If you suggested one or more labels to the receiver of the assistance request and they chose one of them, the button is displayed. Use this button to instantly attach the chosen label to the annotation. If you already attached the label or the label has been deleted in the meantime, the button will not be shown.

If the receiver of the assistance request only responded with text, use the button to open the annotation tool. You can then modify the labels of the annotation there.

Go ahead and send an annotation assistance request to yourself, to see the whole process in action.