Check out Check out release 1.7 with Improved Audio Labeling


Quick Start

Ranker

The Ranker tag is used to rank the results from models. This tag uses the “prediction” field from a labeling task instead of the “data” field to display content for labeling on the interface. Carefully structure your labeling tasks to work with this tag. See import pre-annotated data.

Use with the following data types: text.

The Ranker tag renders a given list of strings and allows you to drag and reorder them.
To see this tag in action:

  1. Save the example JSON below as a file called example_ranker_tag.json.
  2. Upload it as a task on the Label Studio UI.
  3. Set up a project with the given labeling configuration.

Parameters

Param Type Default Description
name string Name of group
[axis] y | x y Whether to use a vertical or horizantal axis direction for ranking
lockAxis x | y Lock axis
sortedHighlightColor string Sorted color in HTML color name

Example

Labeling configuration for ranking predicted text output from a model

<View>
  <Text name="txt-1" value="$text"></Text>
  <Ranker name="ranker-1" toName="txt-1" ranked="true" sortedHighlightColor="red"></Ranker>
</View>

Example

Example JSON task to use to see the Ranker tag in action

[{
  "data": {
    "text": "Some text for the ranker tag"
  },
  "predictions": [{
    "model_version": "1564027355",
    "result": [{
      "from_name": "ranker-1",
      "to_name": "ranker-1",
      "type": "ranker",
      "value": {
        "items": ["abc", "def", "ghk", "more more more", "really long text"],
        "weights": [1.00, 0.78, 0.75, 0.74, 0.74],
        "selected": [false, false, false, false, false]
      }
    }],
    "score": 1.0
  }]
}]