templates
- Template Gallery
- Get Started with Templates
Computer Vision
- Semantic Segmentation with Polygons
- Semantic Segmentation with Masks
- Object Detection with Bounding Boxes
- Keypoint Labeling
- Image Captioning
- Optical Character Recognition (OCR)
- Image Classification
- Visual Question Answering
- Object Detection with Ellipses
- Multi-Image Classification
- Multi-page Document Annotation
- Inventory Tracking
- Visual Genome
Natural Language Processing
- Question Answering
- Sentiment Analysis Text Classification
- Named Entity Recognition
- Taxonomy
- Relation Extraction
- Text Summarization
- Machine Translation
Audio/Speech Processing
- Automatic Speech Recognition
- Sound Event Detection
- Automatic Speech Recognition using Segments
- Signal Quality Detection
- Speaker Diarization
- Dialogue Analysis
- Intent Classification
- Audio Classification
- Audio Classification with Segments
- Voice Activity Detection
Conversational AI
- Response Generation
- Response Selection
- Coreference Resolution and Entity Linking
- Slot Filling and Intent Classification
Ranking and Scoring
- Pairwise Regression
- Document Retrieval
- Pairwise Classification
- Content-based Image Retrieval
- Website Rating
- ASR Hypotheses Selection
- Text-to-Image Generation
- Search Page Ranking
Structured Data Parsing
- Freeform Metadata
- PDF Classification
- Tabular Data
- HTML Entity Recognition
- HTML Classification
Time Series Analysis
- Time Series Forecasting
- Change Point Detection
- Activity Recognition
- Signal Quality
- Outliers and Anomaly Detection
- Time Series Classification
- Time Series Labeling
Videos
- Video Classification
- Video Timeline Segmentation
- Video Object Detection and Tracking
Template Galleries
- Template Gallery - Computer Vision
- Template Gallery - Natural Language Processing
- Template Gallery - Audio/Speech Processing
- Template Gallery - Conversational AI
- Template Gallery - Ranking & Scoring
- Template Gallery - Structured Data Parsing
- Template Gallery - Time Series Analysis
- Template Gallery - Videos
- Template Gallery - Dynamic Labels
Response Selection

If you want to refine the best response for a conversational AI use case, you can provide already-generated responses to annotators and have them choose the best one.
Use this template to provide a section of dialogue and three text responses to the dialogue. Annotators then select the choice that corresponds with the best-fitting text response.
Interactive Template Preview
Labeling Configuration
<View>
<Paragraphs name="prg" value="$dialogue" layout="dialogue" />
<Header value="Choose a response" />
<View style="display: flex">
<View>
<Text name="resp1" value="$respone" />
<Text name="resp2" value="$resptwo" />
<Text name="resp3" value="$respthree" />
</View>
<View style="padding: 50px;">
<Choices name="resp" toName="prg" required="true">
<Choice value="One" />
<Choice value="Two" />
<Choice value="Three" />
</Choices>
</View>
</View>
</View>
About the labeling configuration
All labeling configurations must be wrapped in View tags.
Use the Paragraphs object tag to display dialogue to annotators:
<Paragraphs name="prg" value="$dialogue" layout="dialogue" />
You can add a header to provide instructions to the annotator:
<Header value="Choose a response" />
Use a new View tag to control the dsiplay of text and choices on the labeling interface:
<View style="display: flex">
Use the Text object tag to display 3 different text samples, specified with variables in the value
parameter:
<View>
<Text name="resp1" value="$respone" />
<Text name="resp2" value="$resptwo" />
<Text name="resp3" value="$respthree" />
</View>
Style the View tag that wraps the choices to make sure there is space between the text samples and the corresponding choices:
<View style="padding: 50px;">
<Choices name="resp" toName="prg" required="true">
<Choice value="One" />
<Choice value="Two" />
<Choice value="Three" />
</Choices>
</View>
Use the Choices control tag to allow annotators to choose which text sample is the best response to the dialogue.
Related Tags

If you found an error, you can file an issue on GitHub!