Check out release 1.6 with Video Object Tracking


Quick Start

Response Selection

If you want to refine the best response for a conversational AI use case, you can provide already-generated responses to annotators and have them choose the best one.

Use this template to provide a section of dialogue and three text responses to the dialogue. Annotators then select the choice that corresponds with the best-fitting text response.

Interactive Template Preview

Labeling Configuration

<View>  
  <Paragraphs name="prg" value="$dialogue" layout="dialogue" />
  <Header value="Choose a response" />
  <View style="display: flex">
    <View>
    <Text name="resp1" value="$respone" />
    <Text name="resp2" value="$resptwo" />
    <Text name="resp3" value="$respthree" />
    </View>
    <View style="padding: 50px;">
    <Choices name="resp" toName="prg" required="true">
      <Choice value="One" />
      <Choice value="Two" />
  	  <Choice value="Three" />
    </Choices>
    </View>
  </View>
</View>

About the labeling configuration

All labeling configurations must be wrapped in View tags.

Use the Paragraphs object tag to display dialogue to annotators:

<Paragraphs name="prg" value="$dialogue" layout="dialogue" />

You can add a header to provide instructions to the annotator:

<Header value="Choose a response" />

Use a new View tag to control the dsiplay of text and choices on the labeling interface:

<View style="display: flex">

Use the Text object tag to display 3 different text samples, specified with variables in the value parameter:

<View>
    <Text name="resp1" value="$respone" />
    <Text name="resp2" value="$resptwo" />
    <Text name="resp3" value="$respthree" />
</View>

Style the View tag that wraps the choices to make sure there is space between the text samples and the corresponding choices:

<View style="padding: 50px;">
<Choices name="resp" toName="prg" required="true">
  <Choice value="One" />
  <Choice value="Two" />
 <Choice value="Three" />
</Choices>
</View>

Use the Choices control tag to allow annotators to choose which text sample is the best response to the dialogue.