Blog

Company updates, tutorials, research, and more!

Detecting Errors in Numerical Data via any Regression Model

Detecting Errors in Numerical Data via any Regression Model

New algorithms to identify values in a numerical data column that are likely incorrect (eg. due to noise from erroneous sensors, data entry/processing mistakes, imperfect human estimates).

cleanlab now supports all major ML tasks — including Regression, Object Detection, and Image Segmentation

cleanlab now supports all major ML tasks — including Regression, Object Detection, and Image Segmentation

Introducing cleanlab v2.5, the long-awaited release that adds support for practicing Data-Centric AI in ML tasks requested by the most users.

Ensuring Reliable Few-Shot Prompt Selection for LLMs

Ensuring Reliable Few-Shot Prompt Selection for LLMs

Learn data-centric techniques for better few-shot prompting when applying LLMs to noisy real-world data.

The Future of Relevance Determination: Leveraging AI for Enhanced E-Discovery

The Future of Relevance Determination: Leveraging AI for Enhanced E-Discovery

Use AI software to automatically identify mis-categorized legal documents and provide more accurate relevance determination.

Most AI & Analytics are impaired by data issues. Now AI can help you fix them.

Most AI & Analytics are impaired by data issues. Now AI can help you fix them.

Data is the fuel for AI (and Analytics), but is messy in real enterprise applications. Here’s how to use AI to also refine it, allowing your company to build a Data Engine as powerful as those at the heart of today’s biggest tech companies.

Automated Data Quality at Scale

Automated Data Quality at Scale

A fully-automated analysis of errors in the ImageNet training set.

How To Train and Deploy Reliable Models on Messy Real-World Data With a Few Clicks

How To Train and Deploy Reliable Models on Messy Real-World Data With a Few Clicks

Introducing an entirely automated solution to: train cutting-edge ML models on raw data, use these models to detect various issues in the data, correct these issues, train better models on the improved data, and deploy them to serve reliable predictions in applications.

Letter from the CEO: Announcing Our Seed Funding and the Launch of Cleanlab Studio for Enterprise

Letter from the CEO: Announcing Our Seed Funding and the Launch of Cleanlab Studio for Enterprise

Cleanlab Studio for Enterprise launches to automate data curation for LLMs and the modern AI stack with $5 million in seed funding from Bain Capital Ventures.

Assessing the Quality of Synthetic Data with Cleanlab Studio

Assessing the Quality of Synthetic Data with Cleanlab Studio

Use AI to measure the quality of LLM-generated data, automatically detecting unrealistic synthetic examples and underrepresented tails of the real data distribution.

Enhancing Product Analytics and E-commerce with Data-Centric AI

Enhancing Product Analytics and E-commerce with Data-Centric AI

Using AI to analyze product listings for errors, and how this boosts the accuracy of product categorization and analytics efforts.

Beware of Unreliable Data in Model Evaluation: A LLM Prompt Selection case study with Flan-T5

Beware of Unreliable Data in Model Evaluation: A LLM Prompt Selection case study with Flan-T5

You may choose suboptimal prompts for your LLM (or make other suboptimal choices via model evaluation) unless you clean your test data.

Improving any OpenAI Language Model by Systematically Improving its Data

Improving any OpenAI Language Model by Systematically Improving its Data

Reduce LLM prediction error by 37% via data-centric AI.

ActiveLab: Active Learning with Data Re-Labeling

ActiveLab: Active Learning with Data Re-Labeling

ActiveLab helps you optimally choose which data to (re)label, lowering the cost to train an accurate ML model.

Cleanlab Studio: Issues Found in Popular Datasets

Cleanlab Studio: Issues Found in Popular Datasets

The Cleanlab Studio Audit uses AI to auto-detect problems in given data. Explore all sorts of issues found in popular datasets by Cleanlab Studio!

Automated Correction of Satellite Imagery Data

Automated Correction of Satellite Imagery Data

Use AI to measure the quality of satellite imagery data, automatically detecting mislabeled examples, outliers, ambiguous examples, and (near) duplicate examples.

Ensure high-quality data quickly via AI validation of which data is Well Labeled

Ensure high-quality data quickly via AI validation of which data is Well Labeled

How automated quality assurance can help data annotation teams ensure accurate data with less work.

Improving Legal Judgement Prediction with Data-Centric AI

Improving Legal Judgement Prediction with Data-Centric AI

A legal sector case study using Cleanlab Studio to produce better models for making predictions (eg. of final judgements) based on court case documents.

Detecting Dataset Drift and Non-IID Sampling: A k-Nearest Neighbors approach that works for Image/Text/Audio/Numeric Data

Detecting Dataset Drift and Non-IID Sampling: A k-Nearest Neighbors approach that works for Image/Text/Audio/Numeric Data

A simple method to determine if a dataset violates the IID assumption in common ways (e.g. temporal drift, or interaction between almost adjacent datapoints).

Effectively Annotate Text Data for Transformers via Active Learning + Re-labeling

Effectively Annotate Text Data for Transformers via Active Learning + Re-labeling

Use ActiveLab to efficiently choose which data to (re)label to train the best Transformer model.

Datalab: A Linter for ML Datasets

Datalab: A Linter for ML Datasets

Catch issues in your data/labels. This unified audit uses your ML model to automatically detect various problems in real-world datasets that can be fixed to produce a better model.

CleanVision: Audit your Image Data for better Computer Vision

CleanVision: Audit your Image Data for better Computer Vision

Introducing an open-source Python package to automatically identify common issues in image datasets.

Training Transformer Networks in Scikit-Learn?!

Training Transformer Networks in Scikit-Learn?!

Learn how to easily make any Tensorflow/Keras model compatible with scikit-learn.

cleanlab 2.3 adds support for Active Learning, Tensorflow/Keras models made sklearn-compatible, and highly scalable Label Error Detection

cleanlab 2.3 adds support for Active Learning, Tensorflow/Keras models made sklearn-compatible, and highly scalable Label Error Detection

Highlighting what's new in cleanlab 2.3

Handling Mislabeled Tabular Data to Improve Your XGBoost Model

Handling Mislabeled Tabular Data to Improve Your XGBoost Model

Learn how to reduce prediction errors by 70% using data-centric techniques with cleanlab.

Automatic Error Detection for Image/Text Tagging and Multi-label Datasets

Automatic Error Detection for Image/Text Tagging and Multi-label Datasets

Introducing new data quality algorithms for multi-label classification in cleanlab v2.2

Out-of-Distribution Detection via Embeddings or Predictions

Out-of-Distribution Detection via Embeddings or Predictions

Introducing cleanlab's dual new methods to detect outliers and how they perform on real image data.

A Simple Adjustment Improves Out-of-Distribution Detection for Any Classifier

A Simple Adjustment Improves Out-of-Distribution Detection for Any Classifier

Exploring new ways to identify outliers based on probabilistic predictions from a trained classifier.

Detecting Label Errors in Entity Recognition Data

Detecting Label Errors in Entity Recognition Data

Understanding cleanlab's new methods for text-based token classification tasks.

CROWDLAB: Simple and effective algorithms to handle data labeled by multiple annotators

CROWDLAB: Simple and effective algorithms to handle data labeled by multiple annotators

Understanding cleanlab's new methods for multi-annotator data and what makes them effective.

cleanlab 2.1 adds Multi-Annotator Analysis and Outlier Detection: toward a broad framework for Data-Centric AI

cleanlab 2.1 adds Multi-Annotator Analysis and Outlier Detection: toward a broad framework for Data-Centric AI

Highlighting new features available in cleanlab 2.1

How we built Cleanlab Vizzy

How we built Cleanlab Vizzy

How we built an in-browser visualization of Cleanlab's Confident Learning algorithm.

Handling Label Errors in Text Classification Datasets

Handling Label Errors in Text Classification Datasets

Learn how to find label issues in text datasets and improve NLP models.

Finding Label Issues in Audio Classification Datasets

Finding Label Issues in Audio Classification Datasets

Learn how to find label issues in any audio classification dataset.

Finding Label Issues in Image Classification Datasets

Finding Label Issues in Image Classification Datasets

Learn how to automatically find label issues in any image classification dataset.

cleanlab 2.0: Automatically Find Errors in ML Datasets

cleanlab 2.0: Automatically Find Errors in ML Datasets

Announcing cleanlab 2.0: an open-source framework for machine learning and analytics with messy, real-world data.

Cleanlab: The History, Present, and Future

Cleanlab: The History, Present, and Future

How an MIT grad student project became a company with tech used by Google, Amazon, Tesla, Uber, Facebook, and companies around the world.