Skip to content
AI Performance Benchmarking with Remote Labor Index Released

AI Performance Benchmarking with Remote Labor Index Released

First seen 10 Nov 2026, 16:49 UTC •
API

Article Content

Browse articles
ThreatCluster AI
ThreatCluster •November 10, 2026 at 16:50 UTC
  • •The Remote Labor Index (RLI) measures AI performance on real-world tasks.
  • •Current AI frameworks show a maximum automation rate of 2.5% on evaluated tasks.
  • •The RLI aims to inform stakeholders about AI's economic impact and automation risks.

On November 10, 2026, Scale AI and the Center for AI Safety introduced the Remote Labor Index (RLI), a benchmark assessing AI agents' ability to perform economically valuable remote work tasks. The RLI evaluates AI performance across 240 projects sourced from freelance platforms, providing a comparison against human-produced deliverables. The results indicate that current AI frameworks achieve a maximum automation rate of only 2.5% on RLI tasks, highlighting the limited capability of AI in real-world applications. This benchmark aims to ground discussions about AI automation in empirical evidence and assist stakeholders in understanding the risks associated with AI-driven labor automation. The research paper detailing the RLI is available for review, offering insights into the methodology and findings.

Start a free Starter trial for enhanced analysis

Ask AI about this cluster

Updated 1d ago How this analysis works

Timeline

2026-11-10
Remote Labor Index introduced
Scale AI and the Center for AI Safety launched the RLI to evaluate AI agents' performance on remote work tasks.
labs.scale.com
2026-11-10
RLI research paper published
The research paper detailing the RLI's methodology and findings was published, providing insights into AI performance.
scale.com

More articles in this cluster (2)

Following this threat?

Track Manus in your own feed — you're alerted when they show up in new reporting, leak sites or exploitation.

Free account · no card needed

Extracted Entities (7)

1 / 2

Common questions

What is the Remote Labor Index?
The Remote Labor Index (RLI) is a benchmark that measures AI agents' capability to perform economically valuable remote work tasks.
How does the RLI evaluate AI performance?
The RLI evaluates AI performance through a collection of 240 projects sourced from freelance platforms, comparing AI outputs to human-produced deliverables.
What is the maximum automation rate achieved by AI on RLI tasks?
The maximum automation rate achieved by current AI frameworks on RLI tasks is only 2.5%.