NEWLabel Studio 1.20.0 Now Available: Spectrograms, Time Series Sync, and more!

Guide

Guide

In the Loop: Hidden Markov Models (pt 2)
Guide

In the Loop: Markov Models part 1
Guide

In the Loop: Reinforcement Learning and Robotics
Guide

In the Loop: LLM-as-a-Judge
Guide

In the Loop: The Model Context Protocol (MCP)
Guide

In the Loop: Krippendorff's Alpha
Guide

In the Loop: Cohen and Fleiss' Kappas
Guide

In the Loop: What is Annotator Agreement?

In this episode of In The Loop, ML Evangelist Micaela Kaplan explains annotator agreement—why it matters, how to measure it, and how it impacts data quality. Learn the basics of pairwise and aggregate agreement to evaluate annotator consistency and improve your labeling workflows.
Never miss an update.

Subscribe to our newsletter.
Guide

In the Loop: How RAG Fails, and How to Fix it