Label Studio

NewAdvanced PDF + OCR Interface for Document AI Open SourceData Labeling Platform The most flexible data labeling platform to fine-tune LLMs, prepare training data, or evaluate AI systems. Download OSSFree Cloud Trial Last Commit: March 26, 2026 Latest version: 1.23.0 Quick Start PIP Brew Git Docker # Install the package# into python virtual environment pip install -U label-studio# Launch it!label-studio # Install the caskbrew install humansignal/tap/label-studio# Launch it!label-studio # clone repo git clone https://github.com/HumanSignal/label-studio.git # install dependencies cd label-studiopip install poetrypoetry install # apply db migrationspoetry run python label_studio/manage.py migrate# collect static files poetry run python label_studio/manage.py collectstatic # launchpoetry run python label_studio/manage.py runserver # Run latest Docker version docker run -it -p 8080:8080 -v `pwd`/mydata:/label-studio/data heartexlabs/label-studio:latest # Now visit http://localhost:8080/ GenAI Images Audio Text Time series Multi-Domain Video GenAILLM Fine-TuningLabel data for supervised fine-tuning or refine models using RLHFLLM EvaluationsResponse moderation, grading, and side-by-side comparisonRAG EvaluationUse Ragas scores and human feedback Quick Start Computer VisionImage ClassificationPut images into categoriesObject DetectionDetect objects on image, boxes, polygons, circular, and keypoints supportedSemantic SegmentationPartition image into multiple segments. Use ML models to pre-label and optimize the process Quick Start Audio & Speech ApplicationsClassificationPut audio into categoriesSpeaker DiarizationPartition an input audio stream into homogeneous segments according to the speaker identityEmotion RecognitionTag and identify emotion from the audioAudio TranscriptionWrite down verbal communication in text Quick Start NLP, Documents, Chatbots, TranscriptsClassificationClassify document into one or multiple categories. Use taxonomies of up to 10000 classesNamed EntityExtract and put relevant bits of information into pre-defined categoriesQuestion AnsweringAnswer questions based on contextSentiment AnalysisDetermine whether a document is positive, negative or neutral Quick Start Robots, Sensors, IoT DevicesClassificationPut time series into categoriesSegmentationIdentify regions relevant to the activity type you're building your ML algorithm forEvent RecognitionLabel single events on plots of time series data Quick Start Multi-Domain ApplicationsDialogue ProcessingCall center recording can be simultaneously transcribed and processed as textOptical Character RecognitionPut an image and text right next to each otherTime Series with ReferenceUse video or audio streams to easier segment time series data Quick Start VideoClassificationPut videos into categoriesObject TrackingLabel and track multiple objects frame-by-frameAssisted LabelingAdd keyframes and automatically interpolate bounding boxes between keyframes Quick Start Flexible and configurable Configurable layouts and templates adapt to your dataset and workflow. Integrate with your ML/AI pipeline Webhooks, Python SDK and API allow you to authenticate, create projects, import tasks, manage model predictions, and more. ML-assisted labeling Save time by using predictions to assist your labeling process with ML backend integration. Connect your cloud storage Connect to cloud object storage and label data there directly with S3 and GCP. Explore & understand your data Prepare and manage your dataset in our Data Manager using advanced filters. Multiple projects and users Support multiple projects, use cases and data types in one platform. From the Blog View All Articles Release notes Label Studio 1.23: Vector Annotation, Interactive Task Source, and Data Manager Improvements Vector annotation, an interactive task source viewer, and workflow improvements across the Data Manager and Template Builder. Label Studio Team March 13, 2026 Guide Scaling AI Data Quality: Best Practices for Onboarding and Evaluating Annotators A practical workflow for onboarding and evaluating annotators with clear instructions, calibration, quality gates, reviewer feedback, and dashboards that keep labeling consistent as volume grows. Alec Harris March 12, 2026 Tutorials Building A Labeling Config in Label Studio Enterprise How do you build the right labeling interface in Label Studio? This video walks through a practical progression: start with templates, customize with XML tags, extend with React Code, and standardize workflows with plugins. Trusted by companies large and small Millions of data items labeled 20,000+ Slack members 26,845 GitHub stars Thanks to our Core Contributors @nick-skriabin @hakan458 @KonstantinKorotaev @triklozoid @juliosgarbi @matt-bernstein Join Community --- New Advanced PDF + OCR Interface for Document AI Choose annotation template Basic config examples Audio classification Emotion segmentation Speaker diarization Transcription per region Transcription whole audio Image classification Bbox object detection Brush segmentation Circular object detector Keypoints and landmarks Polygon segmentation Multi-image classification Text classification Multi classification Named entity recognition Text summarization Word alignment HTML classification HTML NER tagging Dialogs & conversations Rate PDF Rate website Video classifier Time Series classification Import CSV Import JSON Segmentation extended Multi-step annotation Advanced config templates Filtering long labels list Long text with scrollbar Pretty choices Sticky header Sticky left column Three columns Two columns Conditional classification Three level classification Two level classification Audio regions labeling Image bboxes labeling Text spans labeling Image & Audio & Text Pairwise comparison Relations among entities Table with key-value Table with text fields Video timeline segmentation Import CSV no time Import CSV headless Relations between channels Relations with text Want to put these templates into practice? Install Open Source Compare Versions Designed for teams of all sizes Compare Versions --- New Advanced PDF + OCR Interface for Document AI Template Gallery Get Started with Label Studio Templates Computer Vision Semantic Segmentation with Polygons Semantic Segmentation with Masks Object Detection with Bounding Boxes Object Detection with Ellipses Keypoint Labeling Optical Character Recognition (OCR) OCR Labeling for PDFs 🔒 Multi-Page Document Annotation Image Captioning Image Classification Multi-Image Classification Visual Question Answering Inventory Tracking Visual Genome Medical Image Classification with Bounding Boxes Natural Language Processing Named Entity Recognition Sentiment Analysis Text Classification Taxonomy Relation Extraction Text Summarization Machine Translation Question Answering Content Moderation Audio/Speech Processing Contextual Scrolling Automatic Speech Recognition Automatic Speech Recognition using Segments Signal Quality Detection Sound Event Detection Voice Activity Detection Speaker Diarization Audio Classification Audio Classification with Segments Intent Classification Programmable Interfaces Spreadsheet Editor 🔒 Multi-Channel Audio Transcription 🔒 Agentic Tracing for Claims 🔒 Ranking and Scoring Visual Ranker Search Page Ranking Website Rating Pairwise Regression Pairwise Classification Content-based Image Retrieval Document Retrieval Text-to-Image Generation ASR Hypotheses Selection Structured Data Parsing Freeform Metadata Tabular Data PDF Classification HTML Entity Recognition HTML Classification Time Series Analysis Time Series Labeling Time Series Classification Time Series Forecasting Time Series Labeling with Audio and Video Synchronization Change Point Detection Activity Recognition Signal Quality Outliers and Anomaly Detection Videos Video Classification Video Frame Classification Video Timeline Segmentation Video Object Detection and Tracking Conversational AI Response Generation Response Selection Coreference Resolution and Entity Linking Dialogue Analysis Slot Filling and Intent Classification Chat Chatbot Evaluation 🔒 Fine-Tune an Agent with an LLM 🔒 Fine-tune an Agent without an LLM 🔒 Red-Teaming in Chat 🔒 Evaluate Production Conversations for RLHF 🔒 LLM Fine-tuning Supervised LLM Fine-Tuning Human Preferences collection for RLHF RAG Retrieval LLM Evaluations LLM Response Moderation LLM Response Grading Side-by-Side LLM Output Comparison Evaluate RAG with Human Feedback Evaluate RAG with Ragas Multi-Turn Chat Evaluation Community Contributions Breast Cancer Mammogram Classification HTML NER Tagging NER Tagging for Invoices (BIO Format) OCR Invoices Pre-NER BIO Format Two-Level Sentiment Analysis of X / Twitter posts Template Galleries Computer Vision Natural Language Processing Audio/Speech Processing Ranking & Scoring Structured Data Parsing Time Series Analysis Videos Programmable Interfaces with ReactCode Conversational AI Chat LLM Fine-tuning LLM Evaluations Community Contributions Dynamic Labels Support Troubleshooting GitHub Issues Join Slack Ask on Discourse Contact Sales What's New Release notes Template Gallery Computer Vision object detection, semantic segmentation, image classification Dynamic Labels object detection, semantic segmentation, image classification Natural Language Processing named entity recognition, text classification, relation extraction Audio/Speech Processing automatic speech recognition, speaker segmentation, intent classification Ranking & Scoring pairwise classification, document retrieval Structured Data Parsing freeform metadata, tabular data, pdf classification Time Series Analysis activity recognition, forecasting, outliers and anomaly detection Videos video classification, timeline segmentation Programmable Interfaces with ReactCode ReactCode, Programmable interface Conversational AI natural language understanding, chatbot response generation, slot filling Chat natural language understanding, chatbot response generation, LLM fine-tuning, LLM evaluation LLM Fine-tuning generative ai, llm LLM Evaluations generative ai, llm Community Contributions community templates Share Your Label Studio Configs! Inspire the community by sharing your unique Label Studio configurations in the Awesome Label Studio Configs repository! Contribute now! --- NewAdvanced PDF + OCR Interface for Document AI Blog NewslettersGuideInsightsGenAIRAGIntegrationsDocumentationRelease notesCompanyProduct UpdatesCase StudiesBenchmarksCommunityTutorials Benchmarks Why Benchmarks Matter for Evaluating LLMs (and Why Most Miss the Mark) Custom AI benchmarks play a crucial role in the success and scalability of AI systems by providing a standardized approach to running AI evaluations. Sheree Zhang July 8, 2025 Most Popular Product Updates Building the New Human Evaluation Layer for AI and Agentic systems Michael Malyuk January 14, 2026 Product Updates Label Studio Wrapped 2025: Inside the Workflows Powering Today’s AI Teams Label Studio Team December 11, 2025 Guide SAM2 vs YOLO for Bounding Box Labeling: Which Should You Use? Micaela Kaplan August 14, 2025 Release notes Label Studio 1.23: Vector Annotation, Interactive Task Source, and Data Manager Improvements Vector annotation, an interactive task source viewer, and workflow improvements across the Data Manager and Template Builder. Label Studio Team March 13, 2026 Guide Scaling AI Data Quality: Best Practices for Onboarding and Evaluating Annotators A practical workflow for onboarding and evaluating annotators with clear instructions, calibration, quality gates, reviewer feedback, and dashboards that keep labeling consistent as volume grows. Alec Harris March 12, 2026 Tutorials Use YOLO26 with Label Studio Learn how to connect YOLO26 to a Label Studio project using the YOLO ML Backend so annotators can start from model predictions and focus on review and correction instead of drawing boxes from scratch. Micaela Kaplan February 12, 2026 Guide How to Scale Evaluation for RAG and Agent Workflows A practical workflow for evaluating RAG and agent systems consistently through prompt, model, and workflow changes. HumanSignal Team January 23, 2026 Product Updates Building the New Human Evaluation Layer for AI and Agentic systems Programmable. Embeddable. Multimodal. Meet the new evaluation engine powering custom interfaces for AI and agentic systems. Michael Malyuk January 14, 2026 Benchmarks The Five Stages to Keeping Benchmarks Useful as Models Evolve A practical maturity model for taking benchmarks from proof-of-concept to versioned, continuously evolving evaluation that keeps up with models, prompts, and agent workflows. HumanSignal Team January 7, 2026 Benchmarks Building a Quality Estimation Benchmark: The impact of relying on AI judges What happens when you let AI judge AI? A pioneer benchmark for quality estimation in machine translation. Sheree Zhang December 22, 2025 Product Updates Label Studio Wrapped 2025: Inside the Workflows Powering Today’s AI Teams See how Label Studio evolved in 2025 to support richer labeling, measurable quality, and deeper analytics for real-world AI systems. Label Studio Team December 11, 2025 Never miss an update. Subscribe to our newsletter. Email*UTM Campaign Company HumanSignal acquires Erud AI to build the world’s frontier data lab AI has outgrown the open web. HumanSignal Services is creating multimodal data from scratch for frontier AI labs, with Label Studio as the backbone. Michael Malyuk November 5, 2025 GenAI Generative AI Templates for Reinforcement Learning with Verifiable Rewards Label Studio turns human judgments into structured rewards with ready-made and custom templates, so you can collect preference data and fine-tune models such as a math tutor bot for better answers Label Studio Team October 9, 2025 Insights The Last Mile of AI: Agent Evaluation with Domain Experts Observability shows what happened; domain experts explain why, and their structured reviews turn raw traces into targeted fixes that finally close the last mile. Nikolai Liubimov October 9, 2025 Release notes Label Studio 1.21.0: Pixel Perfect Annotation, Custom Hotkeys, and Smarter Audio/Video Tools Label Studio 1.21 delivers pixel-perfect annotation, custom hotkeys, and smarter audio/video tools to help teams work faster and with greater accuracy. Label Studio Team September 30, 2025 Insights All Model Training Is Adversarial Now Once deployed, every AI model becomes an attack surface, learn why adversarial training and continuous retraining are now essential for resilience. David Hayes September 17, 2025 Guide How Legalbenchmarks.ai Built a Domain-Specific AI Benchmark See how Legalbenchmarks.ai built a custom contract-drafting AI benchmark using an SME-first, human-in-the-loop framework with rubric-based scoring and LLM judges. Sheree Zhang September 15, 2025 Insights Build vs. Buy in the Age of Generative AI: Lessons from MIT’s 95% Failure Stat 95% of GenAI pilots fail not from bad models, but from bad strategy. The winners know when to buy copilots and when to build the feedback loops that make AI reliable. Michael Malyuk August 29, 2025 Documentation Label Studio SDK 2.0.0: Your Migration Guide We’ve released Label Studio SDK 2.0.0, bringing expanded project settings, new Enterprise endpoints, and improved documentation. Here’s what’s new and how to upgrade. HumanSignal Team August 21, 2025 Guide SAM2 vs YOLO for Bounding Box Labeling: Which Should You Use? A practical comparison of SAM2 and YOLO for bounding box labeling, with pros, cons, and how to use each model in Label Studio. Micaela Kaplan August 14, 2025 Guide 9 Criteria for Successful AI Projects Most AI projects fail from unclear goals and poor alignment. These nine criteria show how to build systems that scale, adapt, and deliver value. David Hayes August 12, 2025 Benchmarks Evaluating the GPT-5 Series on Custom Benchmarks GPT-5 is out now -- but how good is it, really? In this post, we'll show you how we created our own custom Benchmark to evaluate GPT-5. Sheree Zhang August 8, 2025 Guide The Virtuous Cycle of Using Your Brain Alongside GenAI - A Case Study This case study shows how human oversight turns AI missteps into opportunities for better systems, documentation, and long-term reliability. Alec Harris July 30, 2025 Guide Operationalizing Compliance with the EU AI Act’s High-Risk Requirements The EU AI Act brings enforceable demands for transparency, oversight, and auditability, this guide shows how AI teams can meet them through robust infrastructure. HumanSignal Team July 25, 2025 Case Studies How Mind Moves and HumanSignal Brought Trust to AI in Healthcare To evaluate a GenAI health assistant in a high-stakes setting, Mind Moves used Label Studio to build a scalable, human-in-the-loop pipeline rooted in trust and rigor. HumanSignal Team July 23, 2025 Benchmarks How to Build AI Benchmarks that Evolve with your Models Designing effective LLM benchmarks means going beyond static tests, this guide walks through scoring methods, strategy evolution, and how to evaluate models as they scale. Micaela Kaplan July 21, 2025 Guide What Is a Spectrogram? Understanding Sound Beyond the Waveform In this post, we explore how spectrograms work and why they’re essential for analyzing speech, music, and machine learning audio data. Micaela Kaplan July 17, 2025 Guide Intro to Hidden Markov Models: When the State Is Hidden but the Signal Isn't This blog introduces the core components and algorithms behind HMMs, from decoding hidden states to calculating sequence likelihoods. Micaela Kaplan July 8, 2025 Benchmarks Why Benchmarks Matter for Evaluating LLMs (and Why Most Miss the Mark) Custom AI benchmarks play a crucial role in the success and scalability of AI systems by providing a standardized approach to running AI evaluations. Sheree Zhang July 8, 2025 Tutorials How to Label Multichannel Time Series Data for AI Models Learn how to visualize and annotate complex sensor or signal time series data across multiple channels within the Label Studio interface. Label Studio Team July 2, 2025 Guide Data Labeling with GPT-4 in Label Studio: ML Backend Integration This blog shows how to integrate GPT-4 with Label Studio to shift from manual labeling to faster label review. Use OpenAI’s API and the ML Backend to streamline text annotation and accelerate NLP workflows. Jimmy Whitaker July 2, 2025 Release notes Label Studio 1.20.0: Spectrograms, Time Series Sync, Playground 2.0, and JSONL Support Label Studio 1.20.0 introduces major upgrades for audio, video, and time series labeling, including spectrogram support, stream synchronization, and easier data imports. Label Studio Team July 1, 2025 Guide How to Label Spectrograms for AI Models You can now label audio data for training or fine-tuning AI models using spectrograms. This blog outlines why you might use spectrograms and how to use them in Label Studio. Micaela Kaplan June 30, 2025 Guide Markov Models: Chains to Choices This post breaks down Markov Chains and Markov Decision Processes with intuitive examples and a video walkthrough. Micaela Kaplan June 24, 2025 Guide Your Data Engine Is the Moat – Here’s How to Own It. Model weights can be rented, but your feedback loop is the moat. This blog explains how leading AI teams are reclaiming control over labeling, evaluation, and iteration, without sacrificing speed. Michael Malyuk June 23, 2025 Guide The Rise of Real-World Robotics—and the Data Behind It Robots need labeled data to navigate the real world. This blog explores why robotics annotation is uniquely complex and how teams can get it right. HumanSignal Team June 11, 2025 Release notes Label Studio 1.19: MajorCloud Storage Updates and More Community-Driven Fixes Label Studio 1.19 tackles key open source pain points with easier cloud imports, CORS proxy support, and new features like multi-task JSON and KeyPointLabel export. Label Studio Team June 10, 2025 Documentation Integrating Label Studio with Model Context Protocol (MCP) Large language models can reason and plan but they can’t act. Learn how to integrate Model Context Protocol (MCP) with Label Studio to automate and simplify your annotation workflows. Jimmy Whitaker June 2, 2025 Guide Who Watches the Watchdogs? Evaluating LLM-as-a-Judge Measure annotator agreement with Krippendorff’s alpha,even on incomplete data. This guide walks through a real example and explains what the results mean. Micaela Kaplan May 21, 2025 Guide How to Use Krippendorff’s Alpha to Measure Annotation Agreement Learn how to calculate Krippendorff’s alpha to measure annotator agreement, even with missing data. This guide walks through a real example step by step. Micaela Kaplan May 19, 2025 Release notes Dark Mode is Here in Label Studio 1.18 The 1.18.0 release includes the much anticipated Dark Mode setting, the ability to export polygons in COCO format, and a bunch of usability improvements for annotators. Label Studio Team May 14, 2025 Benchmarks Everybody Is (Unintentionally) Cheating AI benchmarks are breaking under pressure. This blog explores four ways to rebuild trust, governance, transparency, better metrics, and centralized oversight. Nikolai Liubimov May 13, 2025 Insights How Model Context Protocol Connects LLMs to the Real World The latest In the Loop episode breaks down the Model Context Protocol (MCP)—a new standard for connecting LLMs to tools, data, and real-world actions. Learn how MCP enables practical, production-ready AI. Micaela Kaplan May 8, 2025 Guide 3 Annotation Team Playbooks to Boost Label Quality and Speed Not every ML team looks the same and your labeling workflow shouldn’t either. In this guide, we break down three common annotation team setups and how to tailor your tools and processes to boost quality, speed, and scale. Alec Harris May 7, 2025 Tutorials How to Generate Synthetic Data with Prompts in Label Studio Kickstart LLM training or RAG pipelines with model-generated data. This guide shows how to create a project, write prompts, and review outputs step by step. Micaela Kaplan April 23, 2025 RAG Why Human Review is Essential for Better RAG Systems Learn how to prioritize weak responses, streamline human-in-the-loop review, and use feedback to iteratively improve your retrieval, prompts, and models. Jimmy Whitaker April 11, 2025 Documentation Building a RAG System with Label Studio In this post, we share how we used Label Studio and its Prompts feature to break down tasks, synthesize QA pairs, and build a reliable RAG assistant. Max Tkachenko April 10, 2025 Release notes Label Studio 1.17 Introduces a New Home Page and Deep Links This release includes a new home page, deep links, and personal access tokens for APIs. Learn about usability improvements and contributions from the community! Label Studio Team April 8, 2025 Tutorials How to Evaluate and Compare LLMs Using Prompts in Label Studio Using LLMs to label data is fast—but is it accurate? This post shows two ways to evaluate model performance in Label Studio, with or without ground truth. Learn how to compare outputs, track accuracy and cost, and choose the right model for your workflow. Micaela Kaplan April 2, 2025 Tutorials Craft the Greatest GPTs 😸 In this post, we walk through a creative use case for Label Studio’s AI Assistant and Prompts: generating rich, image-based narratives. Follow along to see how you can build a project that combines structured labeling with a touch of storytelling. Sheree Zhang April 1, 2025 Case Studies Tales from Our Community: Stop the Traffik When Stop the Traffik lost years of labeled data, they needed a faster, smarter way to rebuild. With Label Studio, they transformed their approach—bringing structure to messy reports, integrating AI for pre-labeling, and uncovering trafficking patterns hidden in plain sight. HumanSignal Team March 27, 2025 Guide Seven Ways Your RAG System Could be Failing and How to Fix Them This post explores seven common RAG failured, from missing top-ranked documents to incorrect formatting, and provides practical solutions to improve retrieval accuracy, ranking, and response quality. Micaela Kaplan March 19, 2025 Tutorials Testing SmolDocling with Label Studio: Evaluating OCR for Document Conversion SmolDocling is designed for end-to-end document conversion, extracting text, tables, and layout with high efficiency. But how well does it perform on real documents? In this post, we walk through testing SmolDocling’s OCR capabilities using Label Studio and a step-by-step notebook to help you evaluate its accuracy. Micaela Kaplan March 19, 2025 Guide Evaluating Mistral OCR with Label Studio Mistral OCR is setting a new standard for document understanding, but how well does it perform on your data? Using Label Studio, you can evaluate its accuracy, compare outputs, and fine-tune results. In this post, we walk through the process and share a hands-on handbook to get started. Micaela Kaplan March 14, 2025 RAG How Human Oversight Solves RAG’s Biggest Challenges for Business Success RAG is transforming how businesses use AI, but without human oversight, its accuracy and reliability suffer. This blog explores the biggest challenges in RAG implementation and how human expertise improves data quality, retrieval relevance, and AI-driven decision-making. Nikolai Liubimov March 6, 2025 Community Tales from our Community: Empowering NLP in Low-Resource Languages Shamsuddeen Hassan Muhammad and his team are advancing African NLP by building language resources for low-resource languages like Hausa. With Label Studio, they scale their efforts to create high-quality datasets for sentiment analysis, hate speech detection, and emotion recognition, making AI more inclusive. Micaela Kaplan February 27, 2025 RAG RAG: Fundamentals, Challenges, and Advanced Techniques Explore the fundamentals of RAG, its advantages over fine-tuning, and the challenges of implementation. Jimmy Whitaker February 26, 2025 Release notes Announcing Label Studio 1.16.0 We’re excited to announce the 1.16.0 release of Label Studio! In this release we have included a number of awesome new features, some critical security updates, and other improvements and bug fixes. Label Studio Team February 12, 2025 Guide Reinforcement Learning from Verifiable Rewards Learn about Reinforcement Learning with Verifiable Rewards, one of the leading training strategies for injecting learning signals into LLMs, successfully employed by models such as DeepSeek R1 and Tülu 3. Nikolai Liubimov February 7, 2025 Insights Top 5 Most Successful Data Curation Strategies in DeepSeek Learn the data curation and human supervision techniques that we believe are crucial to DeepSeek’s success by examining technical reports from DeepSeek-R1, DeepSeek-V3, and its predecessors. Nikolai Liubimov January 30, 2025 Guide Content Moderation Labeling with Label Studio Get started with content moderation labeling to classify potentially harmful data for training purposes, or evaluate the output of a model you already have in place. Micaela Kaplan January 28, 2025 Guide Evaluating Multi-Turn LLM Chat Conversations Using Label Studio Evaluating multi-turn conversations with Label Studio helps identify performance gaps, refine responses, and improve user experience for a more effective virtual assistant. Jimmy Whitaker January 21, 2025 Tutorials How to do Medical Image Labeling with Label Studio In this tutorial, we'll learn how to efficiently label medical images using Label Studio, from setting up your project to drawing bounding boxes and configuring classification tags. Micaela Kaplan January 16, 2025 Product Updates Reflecting on an Exciting Year for Label Studio Let’s dive into the highlights of 2024—from groundbreaking feature releases to engaging content that inspired and informed. Michael Malyuk December 17, 2024 Release notes New in Label Studio 1.15: Fundamental Tools for PDF Labeling We’re excited to introduce Paginated Multi-Image Labeling! This new tag provides the fundamental tools for PDF labeling, which has been a popular request amongst our user community. Micaela Kaplan December 12, 2024 Tutorials Monitor & Evaluate Models in Production with Label Studio Understanding how your production model is performing is the most crucial yet most challenging step in the Machine Learning pipeline. This tutorial gives you an easy way to keep a pulse on what is really happening in production. Micaela Kaplan December 4, 2024 Insights Why Humans Still Matter in the World of GenAI While data annotation for LLMs may look and feel somewhat different than the data annotation of the past, it’s still a crucial step of the machine learning process. Micaela Kaplan November 13, 2024 Product Updates Announcing Label Studio 1.14.0 With Video Frame Classification We’re excited to announce the 1.14.0 release of Label Studio! This release includes many improvements and a powerful new video annotation feature: Video Frame Classification. Micaela Kaplan November 4, 2024 Guide Fine-Tuning OpenAI Models: A Guide with Wikipedia Data Go through the entire fine-tuning process on OpenAI’s platform—from preparing recently-posted Wikipedia data to estimating costs and deploying your fine-tuned model. Jimmy Whitaker October 29, 2024 Community Ameru: Labeling for a Greener World Learn how Ameru is using Label Studio to power their smart garbage bins as they work to accelerate an economically sustainable zero-waste future. Micaela Kaplan October 8, 2024 Guide Webhooks in Label Studio: When And How To Use Them Learn when you should use webhooks vs. the API in Label Studio, and see examples of what you can do with webhooks. Caitlin Wheeless October 1, 2024 Guide Object Detection With Ultralytics YOLOv8 Learn how to use Ultralytics YOLOv8 object detection model with Label Studio. HumanSignal Team September 26, 2024 Tutorials OpenAI Structured Outputs with Label Studio OpenAI’s new Structured Outputs feature allows you to ensure outputs conform to a defined JSON structure. In this blog, we’ll explore how to leverage this feature for various labeling tasks. Jimmy Whitaker September 24, 2024 Product Updates New Ultralytics YOLOv8 Integration For Label Studio We’ve released a new version of the Ultralytics YOLO ML backend connector designed for YOLOv8 and YOLO11, which now supports advanced object detection, segmentation, classification, and video object tracking with Label Studio. Label Studio Team September 18, 2024 Guide LLM Evaluations: Techniques, Challenges, and Best Practices Explore the topic of evaluation for LLMs, its importance, and how we should approach it. Learn how integrating systematic evaluations can help teams iteratively refine their models to meet real-world needs. Jimmy Whitaker August 29, 2024 Guide How to Build and Evaluate RAG Applications with Label Studio, OpenAI & Ragas In this tutorial, we'll guide you through the process of setting up and using Label Studio in combination with Ragas (Retrieval-Augmented Generation Answer Scoring) and GPT-4 to build an optimized QA application. Jo Booth August 22, 2024 Guide Key Considerations For Evaluating RAG-Based Systems Implementing RAG-based systems comes with challenges to be aware of, particularly in assessing the quality of generated responses. This article will walk you through some of those challenges. Jo Booth August 20, 2024 Product Updates New LLM Evaluation Templates For Label Studio Evaluate the output of LLMs and RAG pipelines with Label Studio using five new templates designed for human supervision of AI models. Micaela Kaplan July 31, 2024 Product Updates Accelerate Image and Video Labeling with Segment Anything 2 Connect Segment Anything 2 (SAM2) with Label Studio to accelerate image and video data labeling. Label Studio Team July 31, 2024 Product Updates Label Studio 1.13: Refreshed Interface and New GenAI Evaluation Templates We’re excited to announce the 1.13 release of Label Studio! This update includes a refreshed UI and some new Generative AI templates for you to use. Micaela Kaplan July 31, 2024 Guide 3 Ways To Automate Your Labeling With Label Studio Delve into three effective methods to automate your labeling using Label Studio, including examples and resources. Nate Kartchner July 18, 2024 Tutorials Fine-Tuning Llama 3: Enhancing Accuracy in Medical Q&A With LLMs In this article, we want to demonstrate a method of curating large datasets to reduce but not remove the cost for curating a high quality medical Q&A dataset in Label Studio and fine-tuning Llama 3 on this data. Jimmy Whitaker June 11, 2024 Tutorials Improving RAG Document Search Quality with Cohere Re-ranking This article is part of a longer series that will teach you how to develop and optimize a question answering (QA) system using Retrieval-Augmented Generation (RAG) architecture. In this tutorial, we are going to show you how to create a generator that builds responses based on those documents. Max Tkachenko June 6, 2024 Release notes New Release: Major Update To Our SDK A new version the Label Studio SDK is now available with more functions, new docs, and a greatly improved developer experience. Label Studio Team June 6, 2024 Guide LLM Evaluation: Comparing Four Methods to Automatically Detect Errors An ongoing challenge for Large Language Models (LLMs) is their tendency to hallucinate. In this article, we explore four methods to automatically detect these errors. Nikolai Liubimov May 30, 2024 Newsletters May 2024 Community News! Get the latest news on our upcoming event about AI Evaluation, new Discourse forums for community support, and tutorials including importing YOLO images and fine-tuning generalist models for NER. Label Studio Team May 30, 2024 Tutorials Optimizing RAG Pipelines with Label Studio In this introduction to our tutorial series on optimizing RAG pipelines, we'll introduce an example question answering (QA) system leveraging a Retrieval-Augmented Generation (RAG) architecture and outline three methods for optimizing your RAG pipeline utilizing Label Studio. Max Tkachenko May 23, 2024 Guide Do I Need to Build a Ground Truth Dataset? The short answer is: it depends. Read on as we explore this topic further, uncovering the advantages and drawbacks of each approach to help you make an informed decision. Label Studio Team May 21, 2024 Guide Tutorial: Importing Local YOLO Pre-Annotated Images to Label Studio Today, we're diving into Label Studio Format Converter, a handy tool that helps you encode labels into formats compatible with your favorite machine learning libraries, enhancing workflow efficiency. Label Studio Team May 15, 2024 Guide Fine-Tuning Generalist Models for Named Entity Recognition Generalist models, like GLiNER, provide an excellent starting point for the tasks that they aim to solve. Fine-tuning these models offers us a way to improve their performance in the areas that we care about to solve business problems. Micaela Kaplan May 8, 2024 Newsletters April 2024 Community News! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team April 30, 2024 Insights We Need a Better Set of LLM Evaluations Different models are naturally going to excel at different tasks (just like humans). For users — especially those building products — having visibility into those tradeoffs is going to be a critical part of the decision-making process. Label Studio Team April 29, 2024 Guide Strategies for Evaluating LLMs Sure, benchmarks are cool, but they don’t give you the feel or the intuition of how a model actually works. To get that, you’ve got to hack around with the model and throw real-world prompts at it — like you’d do in day-to-day tasks. Label Studio Team April 23, 2024 Release notes Generate predictions & evaluate models using AI workflows—Label Studio 1.12.0 Release Harness GenAI and popular ML models for pre-labeling, interactive labeling, and model evaluation. Advancements to the ML backend and a new examples library makes it easy to create powerful automations for Label Studio workflows. Nikolai Liubimov April 17, 2024 Guide A Step-by-Step Guide to Preparing Data for Labeling In the world of machine learning, data labeling plays a central role in training accurate and reliable models, and properly preparing your data for labeling sets the foundation for the success of your machine learning projects. Label Studio Team March 6, 2024 Guide Interactive Data Labeling with LLMs and Label Studio’s Prompt Interface Learn how to build a prompt-centric workflow in Label Studio, which combines real-time prompt engineering with data labeling. The goal of this prompter is to make working with data and LLMs seamless and dynamic. Jimmy Whitaker February 28, 2024 Newsletters February 2024 Community News! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team February 28, 2024 Integrations Google Space Datasets x Label Studio Zhou Fang February 6, 2024 Newsletters January 2024 Community News! Announcing the latest Label Studio Release, 1.11.0! Label Studio Team January 30, 2024 Product Updates Enhancing OSS Collaboration: Benefits the Label Studio Monorepo With the latest Label Studio release, the Label Studio team is transitioning platform development from a multi-repository system to a monorepo structure. Julio Sgarbi January 30, 2024 Brandon Martel January 30, 2024 Tutorials Interactive OCR with Tesseract and Label Studio Interactively Label Image-to-Text Datasets with Label Studio and Tesseract OCR. Chris Hoge January 29, 2024 Guide 5 Tips and Tricks for Label Studio’s API and SDK These five tips for using Label Studio's API and SDK demonstrate these tools' powerful capabilities and flexibility for managing data labeling projects. From efficient project creation and task imports to advanced configurations and bulk data exports, Label Studio provides a comprehensive and streamlined approach suitable for beginners and advanced users. Jimmy Whitaker January 23, 2024 Guide An Introduction to Retrieval-Augmented Generation (RAG) Get a brief overview of RAG and how it relates to LLMs, learn when you might consider using RAG, and get a summary of some challenges based on current research you should be aware of should you choose to travel down this path. Nate Kartchner January 11, 2024 Release notes Introducing Label Studio 1.10.1! Label Studio 1.10.1 is here, including several image labeling and security improvements. Label Studio Team January 4, 2024 Newsletters December 2023 Community News Grounding Dino, Math Reasoning with Adala, and a recap of 2023! Label Studio Team December 23, 2023 Tutorials Using Text Prompts for Image Annotation with Grounding DINO and Label Studio Pair Grounding Dino or Grounding SAM models with Label Studio to automatically perform object identification and image segmentation tasks using text labels. Chris Hoge December 21, 2023 Mastering Math Reasoning with Adala This example offers a glimpse into the practical utility and impact of Adala in data-guided automation and prompt tuning against a math-solving benchmark. Jimmy Whitaker December 21, 2023 Community Temporary Community Slack Outage Messaging on the Label Studio Community Slack is currently unavailable. We are working to resolve the issue. Label Studio Team December 7, 2023 Newsletters Large Taxonomies in Label Studio 1.10.0 — November 2023 Community Newsletter Label Studio 1.10.0 is here, featuring support for Large-Scale External Taxonomies (beta) and an update to the Ranker interface for fine-tuning LLMs! Label Studio Team November 30, 2023 Tutorials Label Studio x Segment Anything in Hugging Face Spaces Learn how to build an image annotation workflow using Label Studio and Segment Anything in Hugging Face Spaces! Chris Hoge November 21, 2023 Product Updates Adala 0.0.3 Release: More ways to capture feedback, parallel skills execution, and more! The latest release of Adala, an agent framework to automate data processing tasks, including data labeling and data generation, features more ways to capture feedback and parallel skills execution contributed by a community member. Nikolai Liubimov November 16, 2023 Guide Labeling Your Computer Vision Data for Your Next Artificial Intelligence Project With the rise of deep learning and machine learning techniques, computer vision has become essential in various applications. But how do you get that data into your AI model effectively? Label Studio Team November 7, 2023 Product Updates Adala – The First Open Source Data-Labeling Agent Jimmy Whitaker October 30, 2023 Product Updates Our Vision for the Future of Reliable Labeling Agents Introducing a new open source agent framework that can dramatically increase the efficiency of data labeling (and broader application across data processing tasks), with the unique ability to be guided by human signal: Adala. Michael Malyuk October 25, 2023 Guide Building Agents for Data Labeling Exploring how LLMs and agents can be leveraged to transform the annotation workflow, aiming for greater data labeling efficiency, accuracy, and scalability. Jimmy Whitaker October 18, 2023 Release notes Label Studio 1.9.1 Features Enhancements for Image & Video Annotation The Label Studio community is excited to announce the 1.9.1 release of Label Studio. Label Studio Team October 11, 2023 Guide The Future of Data Labeling: Embracing Agents With their dynamic capabilities, agents can potentially adapt to the nuances of different datasets and environments, ensuring that the labeling process remains efficient regardless of the data's nature. Jimmy Whitaker October 4, 2023 Newsletters September 2023 Community News! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team September 28, 2023 Release notes Introducing Label Studio 1.9.0 We’re excited to announce the latest version of Label Studio, which includes labeling configuration autocomplete. Label Studio Team September 28, 2023 Tutorials Five Open Dataset Resources For Fine-Tuning and Training AI Models Dive into the top 5 open dataset resources that could be the key to your next project's success Label Studio Team September 26, 2023 Guide Fine-Tuning an LLM to Create a ChatBot with Enterprise-Specific Data Our Data Scientist in Residence, Jimmy Whitaker, recently outlined how to fine-tune foundation models for AI applications. In case you missed it, here's a quick summary of the workshop. Label Studio Team September 21, 2023 Guide Recap: Accelerate Your Image Annotation Workflow with Label Studio and Segment Anything We recently held a workshop demonstrating the powerful integration between the Segment Anything Model (SAM) and Label Studio. If you missed it, you can get the recap right here. Label Studio Team September 12, 2023 Newsletters August 2023 Community News! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team August 31, 2023 Release notes Introducing Label Studio 1.8.2 We're excited to announce the launch of our latest version of Label Studio, which features contextual scrolling! Label Studio Team August 29, 2023 Getting Started Using Segment Anything with Label Studio Learn how to connect the object selection power of Segment Anything to the annotation power of Label Studio. Chris Hoge August 24, 2023 Guide Intro to Hugging Face: A Valuable Directory of AI Models and Tools Hugging Face is a highly esteemed platform widely recognized as one of the most valuable resources for discovering and utilizing Language Model (LLM) technology. Label Studio Team August 22, 2023 Guide From Foundation Models to Fine-Tuned Applications Using Label Studio We explore how Label Studio can be employed to build a Question-Answering bot trained on domain-specific knowledge. Jimmy Whitaker August 14, 2023 Nikolai Liubimov August 14, 2023 Guide Learning the Lingo of LLM Fine-Tuning Learn the lingo around fine-tuning LLMs. We've compiled a comprehensive glossary of terms that you should know when embarking on your LLM tuning journey. Label Studio Team August 3, 2023 Tutorials How to use our Generative AI Templates With the latest 1.8 release — we launched the all-new Generative AI template library — a set of templates designed for you to work with foundation models and adapt them to your needs, right within Label Studio. Get started with fine-tuning models such as Llama 2, GPT-4, Whisper, Alpaca, and PaLM 2 among others. Erin Mikail Staples July 31, 2023 Guide Data Labeling and Comparative Analysis of Fine-Tuning Methods Out of the box, LLMs can handle general tasks fairly easily. But what fine-tuning methodology should you use when you need to complete tasks that require more specialized knowledge than what LLMs typically have? Label Studio Team July 26, 2023 Newsletters July 2023 Community News! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team July 25, 2023 Guide Kickstart your Label Studio Annotation Project on Hugging Face Spaces With just a few quick configuration changes, you can launch a compact Label Studio production environment for your annotation and labeling projects, all within Hugging Face. Chris Hoge July 24, 2023 Guide Scalable Labeling Systems for Faster LLM Tuning Machine learning models are the race cars of artificial intelligence, designed to deliver fast and accurate results. But just like a race car, they need the right fuel - in this case, high-quality data that has been appropriately prepared. Label Studio Team July 18, 2023 Guide Fine-Tuning LLMs Fine-tuning plays a pivotal role in harnessing LLMs for specific tasks. By exploring the process of fine-tuning and understanding its importance in LLMs, you will gain the knowledge and practical skills needed to optimize LLMs. Label Studio Team July 13, 2023 Tutorials Data Labeling with GPT-4 in Label Studio: ML Backend Integration Learn how to automate labeling tasks using GPT-4 with the Label Studio Machine Learning backend. Jimmy Whitaker July 12, 2023 Guide Make Your Labeling Team More Efficient With Label Studio Learn some advanced techniques to get the most out of Label Studio and drive more efficiencies into your labeling process. Nate Kartchner July 11, 2023 Guide Five Large Language Models You Can Fine-Tune Today Hundreds of thousands of open source LLMs are available, and choosing one is not easy. However, there are a small number of highly capable models that we think are excellent choices today. Nate Kartchner July 6, 2023 Newsletters June 2023 Community News! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team June 29, 2023 Guide Understanding the Label Studio JSON format Ever wonder how our JSON format is generated or how to structure your JSON files to import data, pre-annotate your datasets, or work with the ML backend? Wait no further! We've got you covered with this blog post. Erin Mikail Staples June 28, 2023 Community Heartex is now HumanSignal! HumanSignal is about the signal that humans provide to models, helping them to adapt, learn, and align with the needs of organizations and society at large. Max Tkachenko June 20, 2023 Release notes Introducing Label Studio 1.8.0 — Optimized for fine-tuning LLMs and Foundation Models We're excited to announce the latest version of Label Studio, specifically designed to help create datasets for fine-tuning Large Language Models (LLM) like ChatGPT or LLaMA. Michael Malyuk June 6, 2023 Guide Using the Segment Anything Model Integration Segment Anything is a popular model you can use to accelerate computer vision & image labeling. Learn how to use the Segment Anything integration with Label Studio. Erin Mikail Staples May 25, 2023 Newsletters May 2023 Community News: Machine learning in Label Studio, free RLHF workshop, and more! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team May 25, 2023 Tutorials Introduction to Machine Learning with Label Studio Learn the background knowledge and steps required to integrate Machine Learning models into your Label Studio workflow. Chris Hoge May 24, 2023 Integrations Integration Spotlight: OpenMMLab & Label Studio How to use OpenMMLab with Label Studio's machine learning API to provide semi-automated bounded-box labeling using the mmdetection library. Erin Mikail Staples May 24, 2023 Community Launching the Label Studio Community Support Archives Visit discuss.labelstud.io to see solutions to frequently asked questions, tips and tricks, and helpful discussions across the Label Studio Community. These have all been logged with the help of a new Archivist Bot, which will help log popular threads from within the existing community Slack. Erin Mikail Staples May 15, 2023 Guide Create a High-Quality Dataset for Reinforcement Learning from Human Feedback RLHF has enabled language models trained on a general corpus of text data to be aligned with complex human values. This article details how you can train a reward model for RLHF on your own data. Jimmy Whitaker May 11, 2023 Guide Human Feedback in AI: The Essential Ingredient for Success In this article we explore the profound impact of human feedback on AI and examine how powerful tools like Label Studio are catalyzing a paradigm shift in AI training methodologies. Jimmy Whitaker May 9, 2023 Guide Introduction to Data Labeling To help you get started with data labeling, we've created this guide that outlines the best practices to ensure you label your data accurately. Label Studio Team May 4, 2023 Release notes Introducing Label Studio 1.7.3 We are excited to announce the release of Label Studio 1.7.3, which brings a host of new features and improvements to our open-source data labeling tool. Label Studio Team April 27, 2023 Newsletters April 2023 Community News: Label Studio 1.7.3 released, Three Keys to Data Quality, and more! It's been another exciting month for the Label Studio Community. Read on to see what's been happening! Label Studio Team April 27, 2023 Guide Integrity, Accuracy, Consistency: 3 Keys to Maintaining Data Quality in Machine Learning How do you identify and maintain high-quality data when you’re knee-deep in a project? And what does “data quality” mean in the context of machine learning? Read more to find out! Nikolai Liubimov April 20, 2023 Community AMA Recap: Heartex CEO Michael Malyuk Chats with BentoML’s Community About MLOps and Data Labeling Heartex co-founder and CEO Michael Malyuk recently did an AMA over at BentoML’s Slack community to talk through a variety of questions around data labeling, MLOps, and workflows that combine the two. Label Studio Team April 13, 2023 Guide Getting started with Object Detection In this article, we’ll explore what object detection is, the challenges involved in implementing it, and share a step-by-step breakdown of getting started with this exciting technique. Label Studio Team April 6, 2023 Community Community Feature: Fixing Your Data Quality 10x Faster with Galileo and Label Studio Vikram Chatterji, co-founder of ML data intelligence company Galileo just published a framework for massively increasing the velocity of your ML workflow using a tight integration between Label Studio and Galileo. Label Studio Team March 30, 2023 Newsletters March 2023 Community News: New Integrations Directory, Label Studio in Hugging Face Spaces and more! It’s been a big month for the Label Studio community, full of releases and collaborations with the open source ML community. Here’s a quick recap of the flurry of announcements from this past month, including one that includes some magic that could have a big impact on your annotation workflow! Label Studio Team March 29, 2023 Community Community Town Hall Series Join the Label Studio Community Team for our Community Town Hall Series on April 13th at 12PM ET. We’ll be sharing what’s happening in and around the community including future plans, our latest release, and more! Erin Mikail Staples March 29, 2023 Guide What will the Long-Lasting Impacts of Large Generative Models Be? Evaluating GPT-4’s release through the lens of open source data science leads us to see the possibility and potential for long-term impact — but it also reiterates the underlying importance of dataset development and context provided by human feedback through processes such as reinforcement learning through human feedback (RLHF) or human-in-the-loop processes. Erin Mikail Staples March 21, 2023 Release notes Label Studio 1.7.2 Release - Magic Wand Tool, Multichannel Audio and Long-Duration Audio Support Label Studio 1.7.2 introduces a new Magic Wand tool for image annotation and significant updates to our audio labeling functionality. Label Studio Team March 20, 2023 Integrations Introducing the Label Studio Integrations Directory Check out the new Label Studio Integrations Directory to explore a growing number of integrations and resources, including documentation and links. Label Studio Team March 7, 2023 Integrations Introduction to Data Labeling in Hugging Face Spaces using Label Studio This tutorial is designed to get you started with data annotation using Label Studio inside of Hugging Face Spaces. Erin Mikail Staples March 7, 2023 Chris Hoge March 7, 2023 Integrations Get Started With Label Studio Integrations A complete guide on how to build integrations for Label Studio, including database, storage, machine learning, web front end, and platform integrations. Label Studio Team March 7, 2023 Guide Contribute to the New Label Studio Community Docs The Label Studio docs have a new look; with cleaner information architecture, and more ways to contribute. Chris Hoge March 7, 2023 Integrations Combining the Power of Good Data with Pachyderm’s Versioning Tools The Pachyderm integration with Label Studio makes incorporating data versioning into any data team’s labeling process easier. Jimmy Whitaker March 6, 2023 Integrations How to Integrate Pachyderm with Label Studio Read step-by-step instructions to integrate Label Studio and Pachyderm, including code examples. Jimmy Whitaker March 6, 2023 Newsletters February 2023 Community News: New audio labeling tutorial, Academic Program, and PyCon! Audio labeling tutorial, new academic program, plans for PyCon & PyData Berlin in April, and more! Label Studio Team February 28, 2023 Guide Labeling Audio Data With Label Studio In this guide, you'll learn how to set up an audio labeling project in Label Studio. Then we'll walk you through importing and labeling your data. You'll also see the many different features in Label Studio's audio labeling interface. Erin Mikail Staples February 14, 2023 Community Improving on RLHF with Language Feedback Learn more about recent advances in RLHF, one of the essential training methods for building large generative models like ChatGPT. Chris Hoge February 7, 2023 Tutorials Zero to One: Getting Started with Label Studio Brand new to Label Studio? We’ve created a jam-packed new tutorial with the most important information to get you up and running. Erin Mikail Staples January 30, 2023 Newsletters January 2023 Community News: New tutorials, a call for content, changes to Label Studio Slack, and more! Lots happening in the Label Studio community this month, check out these great resources and opportunities. Label Studio Team January 30, 2023 Community Contribute Content to the Label Studio Community Do you want to share your knowledge with the community? We’d love for you to contribute content! Label Studio Team January 26, 2023 Community Community Feature: How TotalEnergies Uses Label Studio for Anomaly Detection How TotalEnergies gave their oil rig engineers a cutting-edge tool for predicting and preventing critical equipment failures. Label Studio Team January 25, 2023 Release notes Label Studio 1.7 is Here With Improved Audio Labeling! The latest version of Label Studio is here. Significant features include performance improvements to its audio labeling engine and new support for production-ready deployment methods using Terraform scripts or Helm charts. Label Studio Team December 15, 2022 Community Survey Report: How Data-Centric AI is Shaping Technology and Workflow Choices The 2022 Label Studio Community Survey shows how data teams are increasing investment in data preparation and management to achieve better ML/AI outcomes. Label Studio Team December 8, 2022 Guide Machine Learning Bias: What Is It, Why Is It Important, and What Can You Do About It? A machine learning model can send unintended, dangerous conversational responses. Train your models to avoid these outcomes by learning what machine learning bias is and how to minimize it. Label Studio Team November 30, 2022 Guide Implementing Audio Classification for Machine Learning Projects Using Label Studio With this guide, learn how audio classification works and how to implement it when building audio ML projects, so you can optimize your ML models and build a better overall product. Label Studio Team November 23, 2022 Guide Understanding Audio Classification: Everything You Need to Know This article takes a look at audio classification and discusses the various use cases that can benefit from this technique. Label Studio Team November 16, 2022 Guide How To Choose an Open-source Audio Classification Tool and 6 Options To Use When choosing an annotation tool for your audio classification project, you need to carefully study its unique features and ensure that it works well with the rest of your stack. Finding the right tool will give you the best value in your audio classification projects. Label Studio Team November 9, 2022 Guide Getting Started with Image Classification In this guide, we dig into image classification—what it means, how it works, and the main steps to help you get started. Label Studio Team November 2, 2022 Guide The Building Blocks of an Efficient Data Labeling Process Instituting an efficient data labeling process is the key to eliminating inaccuracies in the data fed to machine learning models. Here are some generally applicable principles that can improve the efficiency and accuracy of your data labeling process. Label Studio Team October 26, 2022 Guide Open Source Tools for Sentiment Analysis Some developers and data scientists just want to grab code, download a repo and go. If that’s your style, choosing a fully-featured open source sentiment tool might be right choice for you. Label Studio Team October 13, 2022 Community Take the Label Studio user survey The Label Studio user community survey is now live! Your feedback is critical to improving the product and helping bring new users into the community. Label Studio Team September 29, 2022 Release notes Label Studio 1.6 - Video Object Tracking and New Annotation UI Label Studio 1.6 introduces a new video player that allows for frame-by-frame video object tracking, plus a major update to the annotation UI for improved ergonomics and efficiency. Label Studio Team September 27, 2022 Guide 6 Costly Data Labeling Mistakes and How To Avoid Them Learn six of the most common data labeling mistakes we see in ML projects and the fixes that can help you maintain consistent, accurate training data. Label Studio Team September 9, 2022 Community Celebrating 10,000 GitHub Stars with the Top 10 Label Studio Features From time series to active learning to the Python SDK, check out the top 10 features on the path to 10,000 GitHub stars and growing! Label Studio Team August 17, 2022 Guide Understanding Sentiment Analysis This blog covers the basics of sentiment analysis: key components, use cases, challenges, and solutions. Label Studio Team July 18, 2022 Tutorials Getting Started with Sentiment Analysis Sentiment analysis provides consistent, data-driven insights for businesses looking to better understand their users and products. Here’s how to get started. Label Studio Team July 11, 2022 Release notes Announcing the Label Studio 1.5.0 Features and Release Notes Release notes and information about Label Studio version 1.5.0. Label Studio Team June 16, 2022 Community What's with the Label Studio Opossums? See what data labeling can learn from opossums and what Heidi means to Label Studio. Label Studio Team April 1, 2022 Release notes Announcing the Label Studio SDK with Label Studio 1.4.0 Release notes and information about Label Studio version 1.4.0, announcing the Label Studio SDK to work with the open source data labeling tool Label Studio, or the enterprise version Label Studio Enterprise. Label Studio Team November 22, 2021 Community Introducing Label Studio Champions! Introducing the community reward program for the Label Studio open source data labeling tool! Label Studio Team October 27, 2021 Guide Data Labeling: The Unsung Hero Combating Data Drift Learn how various types of data drift and how data drift impacts model performance, along with several examples of how data labeling can tackle data drift. Label Studio Team October 21, 2021 Release notes Perform Interactive ML-Assisted Labeling with Label Studio 1.3.0 Release notes and information about Label Studio version 1.3.0, featuring ML-assisted labeling. Label Studio Team September 16, 2021 Tutorials From raw data to a trained model: Automate your ML pipeline with Label Studio & Amazon SageMaker Use webhooks from open source data labeling software Label Studio to seamlessly integrate your Amazon SageMaker model development workflow for your machine learning and data science projects using AWS Lambda, Amazon S3, and public domain bird images. Label Studio Team August 26, 2021 Tutorials Quickly Create Datasets for Training YOLO Object Detection with Label Studio Use open source data labeling software Label Studio to quickly create YOLO v3 and v4 compatible datasets for training purposes and image labels for image object detection data science and machine learning projects. Label Studio Team August 23, 2021 Release notes Announcing Label Studio version 1.2.0 with Webhooks! Release notes and information about Label Studio version 1.2.0, featuring event webhook functionality for annotations and tasks. Label Studio Team August 17, 2021 Tutorials Improve OCR quality for receipt processing with Tesseract and Label Studio Use open source data labeling software Label Studio to improve optical character recognition (OCR) results for receipts, invoices, menus, signs, and other important images processed with Tesseract and Python. Label Studio Team July 13, 2021 Release notes Label Studio v1.1 is now available! Release notes and information about Label Studio version 1.1.0, with improved data labeling functionality for image annotations and object character recognition (OCR) labeling for machine learning projects. Label Studio Team June 30, 2021 Guide 10 important considerations for NLP labeling The top 10 important considerations for NLP labeling and functionality in labeling tools for natural language processing machine learning projects. Label Studio Team June 17, 2021 Tutorials Improve Amazon Transcribe Audio Transcriptions with Label Studio Use open source data labeling software Label Studio to improve audio transcriptions of customer support calls, video conference meetings, and other audio recordings. Label Studio Team May 10, 2021 Tutorials Evaluating Named Entity Recognition parsers with spaCy and Label Studio Use Label Studio to evaluate named entity recognition parsers like spaCy and revise predictions by annotating a gold standard dataset for your data science and machine learning projects. Label Studio Team May 3, 2021 Release notes Announcing Label Studio v1.0 Label Studio Release 1.0.0 rewrites Label Studio to support multiple users, projects, and scalable data labeling and annotation for machine learning and data science projects. Label Studio Team March 15, 2021 Release notes Label Studio Release Notes 0.9.0 Label Studio Release 0.9.0 includes improvements to data management to help you explore and improve your datasets for machine learning projects. Label Studio Team January 21, 2021 Release notes Label Studio Release Notes 0.8.0 - Time Series Data Labeling Label Studio Release 0.8.0 includes updates to support data labeling for time series data. Label Studio Team October 26, 2020 Release notes Label Studio Release Notes 0.7.0 - Cloud Storage Enablement Label Studio Release 0.7.0 includes new connectors to integrate Label Studio with cloud storage, including Amazon AWS S3 and Google Cloud Storage. Label Studio Team May 29, 2020 Release notes Label Studio Release Notes 0.6.0 - Nested Data Labeling Label Studio Release 0.6.0 includes nested data labeling, per-region labeling, updates to machine learning backend integration, filtering, and more. Label Studio Team May 8, 2020 Release notes Label Studio Release Notes 0.5.0 Label Studio Release 0.5.0 includes image segmentation, relations labeling, named entity recognition performance, image ellipses labeling, and more. Label Studio Team March 9, 2020 Tutorials How to fine-tune BERT to classify your Slack chats without coding Nikolai Liubimov February 18, 2020 Release notes Introducing Label Studio, a swiss army knife of data labeling Nikolai Liubimov January 28, 2020 Guide Learn faster with smarter data labeling Nikolai Liubimov August 21, 2019