Open Source
Data Labeling
Platform
The most flexible data labeling platform to fine-tune LLMs, prepare training data or validate AI models.
Last Commit:
Latest version:
# Install the package
# into python virtual environmentpip install -U label-studio
# Launch it!
label-studio
# Install the cask
brew install humansignal/tap/label-studio
# Launch it!
label-studio
# clone repo
git clone https://github.com/HumanSignal/label-studio.git
# install dependencies
cd label-studio
pip install poetry
poetry install# apply db migrations
poetry run python label_studio/manage.py migrate
# collect static files
poetry run python label_studio/manage.py collectstatic
# launch
poetry run python label_studio/manage.py runserver
# Run latest Docker version
docker run -it -p 8080:8080 -v `pwd`/mydata:/label-studio/data heartexlabs/label-studio:latest
# Now visit http://localhost:8080/
Label every data type.
GenAI
LLM Fine-Tuning
Label data for supervised fine-tuning or refine models using RLHF
LLM Evaluations
Response moderation, grading, and side-by-side comparison
RAG Evaluation
Use Ragas scores and human feedback
Quick StartComputer Vision
Image Classification
Put images into categories
Object Detection
Detect objects on image, boxes, polygons, circular, and keypoints supported
Semantic Segmentation
Partition image into multiple segments. Use ML models to pre-label and optimize the process
Quick StartAudio & Speech Applications
Classification
Put audio into categories
Speaker Diarization
Partition an input audio stream into homogeneous segments according to the speaker identity
Emotion Recognition
Tag and identify emotion from the audio
Audio Transcription
Write down verbal communication in text
Quick StartNLP, Documents, Chatbots, Transcripts
Classification
Classify document into one or multiple categories. Use taxonomies of up to 10000 classes
Named Entity
Extract and put relevant bits of information into pre-defined categories
Question Answering
Answer questions based on context
Sentiment Analysis
Determine whether a document is positive, negative or neutral
Quick StartRobots, Sensors, IoT Devices
Classification
Put time series into categories
Segmentation
Identify regions relevant to the activity type you're building your ML algorithm for
Event Recognition
Label single events on plots of time series data
Quick StartMulti-Domain Applications
Dialogue Processing
Call center recording can be simultaneously transcribed and processed as text
Optical Character Recognition
Put an image and text right next to each other
Time Series with Reference
Use video or audio streams to easier segment time series data
Quick StartVideo
Classification
Put videos into categories
Object Tracking
Label and track multiple objects frame-by-frame
Assisted Labeling
Add keyframes and automatically interpolate bounding boxes between keyframes
Quick StartFlexible and configurable
Configurable layouts and templates adapt to your dataset and workflow.
Integrate with your ML/AI pipeline
Webhooks, Python SDK and API allow you to authenticate, create projects, import tasks, manage model predictions, and more.
ML-assisted labeling
Save time by using predictions to assist your labeling process with ML backend integration.
Connect your cloud storage
Connect to cloud object storage and label data there directly with S3 and GCP.
Explore & understand your data
Prepare and manage your dataset in our Data Manager using advanced filters.
Multiple projects and users
Support multiple projects, use cases and data types in one platform.
From the Blog
View All Articles-
Monitor & Evaluate Models in Production with Label Studio
Understanding how your production model is performing is the most crucial yet most challenging step in the Machine Learning pipeline. This tutorial gives you an easy way to keep a pulse on what is really happening in production.
Micaela Kaplan
December 4, 2024
-
Why Humans Still Matter in the World of GenAI
While data annotation for LLMs may look and feel somewhat different than the data annotation of the past, it’s still a crucial step of the machine learning process.
Micaela Kaplan
November 13, 2024
-
Announcing Label Studio 1.14.0 With Video Frame Classification
We’re excited to announce the 1.14.0 release of Label Studio! This release includes many improvements and a powerful new video annotation feature: Video Frame Classification.
Micaela Kaplan
November 4, 2024
Trusted by companies large and small
Global Community
Join the largest community of Data Scientists working on enhancing their models.