# Vance Benchmark - openai-deepseek-v4-pro-MermaidVarietyBenchmark-20260805-181717

- **Started:** 2026-08-05T18:17:17.911387Z
- **Judge:** gemini-gemini-2.5-pro
- **Total tests:** 9
- **Passed:** 9 / 9 (100%)
- **Average score:** 1.000
- **Total LLM time:** 153.5s
- **Total tokens (in / out):** 1.12M / 8.3k (42 round-trips)


## mermaid-variety

| Test | Pass | Score | Time | In | Out | Calls | Reason |
|------|------|-------|------|----|-----|-------|--------|
| `emitsC4ContextDiagram` | OK | 1.00 | 10.4s | 104.6k | 801 | 4 | opener=C4Context produced at benchmark/mermaid/c4-notifications.md (1017 chars) |
| `emitsErDiagram` | OK | 1.00 | 8.2s | 103.9k | 635 | 4 | opener=erDiagram produced at benchmark/mermaid/er-shop.md (650 chars) |
| `emitsGanttDiagram` | OK | 1.00 | 11.6s | 104.2k | 1.0k | 4 | opener=gantt produced at benchmark/mermaid/gantt-onboarding.md (708 chars) |
| `emitsGitGraph` | OK | 1.00 | 11.0s | 104.1k | 932 | 4 | opener=gitGraph produced at benchmark/mermaid/gitflow.md (724 chars) |
| `emitsJourneyDiagram` | OK | 1.00 | 17.3s | 139.1k | 1.3k | 5 | opener=journey produced at benchmark/mermaid/journey-checkout.md (787 chars) |
| `emitsPieDiagram` | OK | 1.00 | 15.3s | 130.6k | 650 | 5 | opener=pie produced at benchmark/mermaid/pie-languages.md (182 chars) |
| `emitsSequenceDiagram` | OK | 1.00 | 27.2s | 138.9k | 1.5k | 5 | opener=sequenceDiagram produced at benchmark/mermaid/sequence-oauth.md (785 chars) |
| `emitsStateDiagram` | OK | 1.00 | 26.7s | 103.7k | 547 | 4 | opener=stateDiagram produced at benchmark/mermaid/state-order.md (248 chars) |
| `emitsTimelineDiagram` | OK | 1.00 | 25.9s | 189.9k | 895 | 7 | opener=timeline produced at benchmark/mermaid/timeline-web.md (364 chars) |