Evaluation Benchmarks
Automated prompt suite evaluation results
Pass Rate83.3%
Total Benchmarks
6
Successful
5
Failed
1
Avg Latency
4.6s
| Benchmark Suite | Complexity | Status | Schemas Gen | Repairs Req | Comp. Latency |
|---|---|---|---|---|---|
| B2B SaaS Core | High | PASS | 12 | 2 | 4.2s |
| E-Commerce Storefront | High | PASS | 18 | 4 | 5.1s |
| Internal Admin Dashboard | Medium | PASS | 6 | 0 | 2.8s |
| Real-time Chat App | Very High | FAIL | 8 | 11 | 8.4s |
| Personal Blog | Low | PASS | 3 | 0 | 1.1s |
| Fintech Ledger | Critical | PASS | 24 | 3 | 6.5s |