Scale AI

company

Verified

https://scale.com/

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

X1ingang updated a dataset 3 days ago

X1ingang published a dataset 4 days ago

soham-dan updated a dataset 19 days ago

ScaleAI/SWE-bench_Pro

View all activity

Papers

Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures

SteerDuplex: Steerable Duplex Speech Dialogue Models

View all Papers

ScaleAI 's papers 12

Submitted by

Harsh Raj

Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures

ScaleAI

Submitted by

Utkarsh Tyagi

SteerDuplex: Steerable Duplex Speech Dialogue Models

ScaleAI

Submitted by

varun-scale

Studying Without a Syllabus: Task-Agnostic Environment Preprocessing

ScaleAI

Submitted by

taesiri

HarnessOpt-Bench: Evaluating LLMs at Harness Optimization

ScaleAI

Submitted by

Harsh Raj

Model or Harness? An Interaction-Centric Taxonomy for Localizing Agent Failures

ScaleAI

Submitted by

Anisha Gunjal

SWE-INTERACT: Reimagining SWE Benchmarks as User-Driven Long-Horizon Coding Sessions

ScaleAI

Submitted by

Utkarsh Tyagi

Not Every Rubric Teaches Equally: Policy-Aware Rubric Rewards for RLVR

ScaleAI

2

Submitted by

Tu Trinh

HiL-Bench (Human-in-Loop Benchmark): Do Agents Know When to Ask for Help?

ScaleAI

Submitted by

taesiri

SciPredict: Can LLMs Predict the Outcomes of Scientific Experiments in Natural Sciences?

ScaleAI

Submitted by

taesiri

Agentic Rubrics as Contextual Verifiers for SWE Agents

ScaleAI

Submitted by

taesiri

ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agents

ScaleAI

Submitted by

Junkai Zhang

Chasing the Tail: Effective Rubric-based Reward Modeling for Large Language Model Post-Training

ScaleAI