// scorecard · 54/100
verified 1mo agoAgent-readiness23/35
Agent registration (api_key)6/9
Public API5/5
OpenAPI spec0/9
MCP server9/9
llms.txt3/3
Reliability & performance0/15
Actively maintained—
Production-ready0/4
Updated recently—
Pricing12/13
Itemized public pricing6/6
Free tier / trial4/4
Free-tier generosity2/3
Docs & DX5/12
Docs quality3/8
Public API2/2
Quickstart / examples0/2
Security & compliance10/12
SOC 26/6
ISO 270010/2
GDPR2/2
Security / trust page2/2
Openness4/10
Open source0/6
Open / un-gated API4/4
Company maturity0/3
Company size—
Years operating—
// rankings · cost per standard workload
#13 in Code Sandboxes$158.4/ 1k sandbox-hrs
$0.108/CPU-h + 2GB x $0.0252 = $0.1584/h x1000 = $158.40/mo (suspended = free)
runloop.ai/pricing// overview
Runloop provides secure code sandbox environments (Devboxes) for launching, refining, and scaling AI agents with evaluations, benchmarks, and managed infrastructure. It includes features like snapshots, repo connections, custom benchmarks, fine-tuning, and suspend/resume for agentic workflows. The platform supports public benchmarks such as SWE-Bench and enterprise security standards.
Best for: AI agent developers building and productionizing software engineering agents at scale
// pricing
Free tier · generosity 3/5
Includes: Public Benchmarks · Devboxes and Blueprints · Snapshots
Limits: 3 Running Devboxes / 5 blueprints / 10 snapshots / 3 objects during trial
BasicFree + usage-based compute
- 100 GB Free Storage
- Public Benchmarks
- Email Support
Pro$250/month + usage
- 1 TB Free Storage
- Suspend and Resume
- Custom Benchmarks
- Slack Support
EnterpriseContact Us
- Reinforcement Fine-Tuning
- Deploy to VPC
- Priority Support
// security & compliance
✓ SOC 2✗ ISO 27001✓ GDPR✓ HIPAA
// features
- Devboxes with fast starts and ARM/x86 support
- Public and custom benchmarks (SWE-Bench, R2E-Gym)
- Suspend & Resume for cost efficiency
- Credential Gateway and MCP Hub for security
- Repo connections and Git snapshot/branching
- Reinforcement/Supervised Fine Tuning at scale