❯
llmcoderlab
Leaderboard
Models
Challenges
Findings
Methodology
Harness
Pipeline
Runs
qwen3-30b-a3b
1 run(s)
12/18 graded
6 failures
← all models
//
score history
Run
Mode
Score
Graded
Failures
run 2
agentic
100.0
5/9
4
run 2
oneshot
100.0
7/9
2
//
every attempt
Run
Mode
Challenge
Score
Tests
Wall
2
agentic
calculator
error
906s
report
2
agentic
fizzbuzz
100.0
3/3
215s
report
2
agentic
json-pointer
error
1400s
report
2
agentic
lru-cache
100.0
5/5
336s
report
2
agentic
palindrome
100.0
5/5
380s
report
2
agentic
temperature
100.0
4/4
132s
report
2
agentic
text-stats
error
906s
report
2
agentic
vowel-count
100.0
5/5
107s
report
2
agentic
word-ladder
error
906s
report
2
oneshot
calculator
error
906s
report
2
oneshot
fizzbuzz
100.0
3/3
89s
report
2
oneshot
json-pointer
100.0
10/10
284s
report
2
oneshot
lru-cache
100.0
5/5
238s
report
2
oneshot
palindrome
100.0
5/5
291s
report
2
oneshot
temperature
100.0
4/4
52s
report
2
oneshot
text-stats
error
906s
report
2
oneshot
vowel-count
100.0
5/5
60s
report
2
oneshot
word-ladder
100.0
5/5
196s
report