Benchmark Run Details

Run Summary

Model smollm2:1.7b:Q8_0
Benchmark 0050_translation_en_zh
Normed Score 68
Run Timestamp 2025-03-26 19:47:33

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0050_translation_en_zh:0 100 1866 {}
[+]
0050_translation_en_zh:1 0 493 { "response": "运动", "expected": "开车" }
[+]
0050_translation_en_zh:10 100 410 {}
[+]
0050_translation_en_zh:11 100 515 {}
[+]
0050_translation_en_zh:12 100 433 {}
[+]
0050_translation_en_zh:13 100 461 {}
[+]
0050_translation_en_zh:14 100 525 {}
[+]
0050_translation_en_zh:15 0 452 { "response": "新鲜", "expected": "安静" }
[+]
0050_translation_en_zh:16 100 388 {}
[+]
0050_translation_en_zh:17 100 387 {}
[+]
0050_translation_en_zh:18 100 496 {}
[+]
0050_translation_en_zh:19 100 433 {}
[+]
0050_translation_en_zh:2 100 462 {}
[+]
0050_translation_en_zh:20 100 460 {}
[+]
0050_translation_en_zh:21 100 424 {}
[+]
0050_translation_en_zh:22 0 503 { "response": "呼吸", "expected": "圆" }
[+]
0050_translation_en_zh:23 100 497 {}
[+]
0050_translation_en_zh:24 100 560 {}
[+]
0050_translation_en_zh:25 100 540 {}
[+]
0050_translation_en_zh:26 100 438 {}
[+]
0050_translation_en_zh:27 100 447 {}
[+]
0050_translation_en_zh:28 0 460 { "response": "光滑", "expected": "鸟" }
[+]
0050_translation_en_zh:29 100 379 {}
[+]
0050_translation_en_zh:3 100 419 {}
[+]
0050_translation_en_zh:30 0 462 { "response": "天空", "expected": "云" }
[+]
0050_translation_en_zh:31 100 417 {}
[+]
0050_translation_en_zh:32 0 377 { "response": "树", "expected": "软" }
[+]
0050_translation_en_zh:33 100 377 {}
[+]
0050_translation_en_zh:34 100 425 {}
[+]
0050_translation_en_zh:35 0 388 { "response": "飞", "expected": "快" }
[+]
0050_translation_en_zh:36 100 417 {}
[+]
0050_translation_en_zh:37 100 474 {}
[+]
0050_translation_en_zh:38 100 368 {}
[+]
0050_translation_en_zh:39 100 385 {}
[+]
0050_translation_en_zh:4 100 391 {}
[+]
0050_translation_en_zh:40 100 427 {}
[+]
0050_translation_en_zh:41 100 461 {}
[+]
0050_translation_en_zh:42 0 427 { "response": "新鲜", "expected": "盐" }
[+]
0050_translation_en_zh:43 0 491 { "response": "隐藏", "expected": "躲藏" }
[+]
0050_translation_en_zh:44 100 454 {}
[+]
0050_translation_en_zh:45 100 397 {}
[+]
0050_translation_en_zh:46 0 382 { "response": "快", "expected": "飞" }
[+]
0050_translation_en_zh:47 100 373 {}
[+]
0050_translation_en_zh:48 0 373 { "response": "树", "expected": "沙" }
[+]
0050_translation_en_zh:49 100 405 {}
[+]
0050_translation_en_zh:5 0 652 { "response": "英文表示的词可能是", "expected": "美丽" }
[+]
0050_translation_en_zh:50 0 375 { "response": "吃", "expected": "轻" }
[+]
0050_translation_en_zh:6 100 416 {}
[+]
0050_translation_en_zh:7 0 499 { "response": "被动", "expected": "睡觉" }
[+]
0050_translation_en_zh:8 0 495 { "response": "白兔", "expected": "月亮" }
[+]
0050_translation_en_zh:9 0 510 { "response": "锋利", "expected": "笑" }
[+]