qwen2.5-coder-3b
2 run(s)21/28 graded7 failures
← all models
// score history
| Run | Mode | Score |
Graded | Failures |
|---|
| run 2 | agentic | 49.8 | 9/9 | 0 |
| run 2 | oneshot | 87.2 | 4/9 | 5 |
| run 1 | agentic | 80.0 | 5/5 | 0 |
| run 1 | oneshot | 100.0 | 3/5 | 2 |
// every attempt
| Run | Mode | Challenge |
Score | Tests | Wall | |
| 2 | agentic | calculator | 48.6 | 1/7 | 341s | report |
| 2 | agentic | fizzbuzz | 100.0 | 3/3 | 129s | report |
| 2 | agentic | json-pointer | 0.0 | 0/1 | 139s | report |
| 2 | agentic | lru-cache | 0.0 | 0/1 | 239s | report |
| 2 | agentic | palindrome | 100.0 | 5/5 | 63s | report |
| 2 | agentic | temperature | 100.0 | 4/4 | 77s | report |
| 2 | agentic | text-stats | 0.0 | 0/1 | 384s | report |
| 2 | agentic | vowel-count | 100.0 | 5/5 | 63s | report |
| 2 | agentic | word-ladder | 0.0 | 0/1 | 228s | report |
| 2 | oneshot | calculator | 48.6 | 1/7 | 16s | report |
| 2 | oneshot | fizzbuzz | 100.0 | 3/3 | 6s | report |
| 2 | oneshot | json-pointer | degenerate | | 6s | report |
| 2 | oneshot | lru-cache | degenerate | | 6s | report |
| 2 | oneshot | palindrome | degenerate | | 3s | report |
| 2 | oneshot | temperature | 100.0 | 4/4 | 5s | report |
| 2 | oneshot | text-stats | degenerate | | 14s | report |
| 2 | oneshot | vowel-count | 100.0 | 5/5 | 3s | report |
| 2 | oneshot | word-ladder | degenerate | | 12s | report |
| 1 | agentic | fizzbuzz | 100.0 | 3/3 | 90s | report |
| 1 | agentic | palindrome | 100.0 | 5/5 | 41s | report |
| 1 | agentic | temperature | 100.0 | 4/4 | 51s | report |
| 1 | agentic | text-stats | 0.0 | 0/1 | 251s | report |
| 1 | agentic | vowel-count | 100.0 | 5/5 | 41s | report |
| 1 | oneshot | fizzbuzz | 100.0 | 3/3 | 6s | report |
| 1 | oneshot | palindrome | error | | 3s | report |
| 1 | oneshot | temperature | 100.0 | 4/4 | 2s | report |
| 1 | oneshot | text-stats | error | | 8s | report |
| 1 | oneshot | vowel-count | 100.0 | 5/5 | 2s | report |