Benchmark Run Details

System Prompt

You are helping with a language translation task.
When translating a word from EN to FR:
- Provide the most direct and common translation
- Give only the base form of the word
- Do not include articles unless they are part of the standard translation
- Do not provide explanations or alternative translations

Run Summary

Model lmstudio/granite-3.3-8b-instruct
Benchmark 0050_translation_en_fr
Normed Score 88
Run Timestamp 2025-04-29 17:17:38

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0050_translation_en_fr:0 100 1716 { "response": "fleur", "expected": "fleur", "is_correct": true }
[+]
0050_translation_en_fr:1 100 1434 { "response": "conduire", "expected": "conduire", "is_correct": true }
[+]
0050_translation_en_fr:10 100 1350 { "response": "montagne", "expected": "montagne", "is_correct": true }
[+]
0050_translation_en_fr:11 100 1343 { "response": "chanter", "expected": "chanter", "is_correct": true }
[+]
0050_translation_en_fr:12 100 1546 { "response": "cœur", "expected": "cœur", "is_correct": true }
[+]
0050_translation_en_fr:13 100 1399 { "response": "lumineux", "expected": "lumineux", "is_correct": true }
[+]
0050_translation_en_fr:14 100 1381 { "response": "danser", "expected": "danser", "is_correct": true }
[+]
0050_translation_en_fr:15 0 1408 { "response": "doux", "expected": "silencieux", "is_correct": false }
[+]
0050_translation_en_fr:16 100 1356 { "response": "arbre", "expected": "arbre", "is_correct": true }
[+]
0050_translation_en_fr:17 100 1528 { "response": "écrire", "expected": "écrire", "is_correct": true }
[+]
0050_translation_en_fr:18 100 1410 { "response": "ciel", "expected": "ciel", "is_correct": true }
[+]
0050_translation_en_fr:19 100 1424 { "response": "frais", "expected": "frais", "is_correct": true }
[+]
0050_translation_en_fr:2 100 1422 { "response": "le plus fort", "expected": "le plus fort", "is_correct": true }
[+]
0050_translation_en_fr:20 100 1435 { "response": "ami", "expected": "ami", "is_correct": true }
[+]
0050_translation_en_fr:21 100 1430 { "response": "courir", "expected": "courir", "is_correct": true }
[+]
0050_translation_en_fr:22 0 3371 { "response": "", "expected": "rond", "is_correct": false }
[+]
0050_translation_en_fr:23 100 1299 { "response": "vent", "expected": "vent", "is_correct": true }
[+]
0050_translation_en_fr:24 100 1375 { "response": "chaud", "expected": "chaud", "is_correct": true }
[+]
0050_translation_en_fr:25 100 1435 { "response": "pierre", "expected": "pierre", "is_correct": true }
[+]
0050_translation_en_fr:26 100 1409 { "response": "profond", "expected": "profond", "is_correct": true }
[+]
0050_translation_en_fr:27 100 1378 { "response": "nager", "expected": "nager", "is_correct": true }
[+]
0050_translation_en_fr:28 100 1488 { "response": "oiseau", "expected": "oiseau", "is_correct": true }
[+]
0050_translation_en_fr:29 100 1533 { "response": "sucré", "expected": "sucré", "is_correct": true }
[+]
0050_translation_en_fr:3 100 1432 { "response": "livre", "expected": "livre", "is_correct": true }
[+]
0050_translation_en_fr:30 0 3302 { "response": "", "expected": "nuage", "is_correct": false }
[+]
0050_translation_en_fr:31 100 1493 { "response": "sourire", "expected": "sourire", "is_correct": true }
[+]
0050_translation_en_fr:32 100 1427 { "response": "doux", "expected": "doux", "is_correct": true }
[+]
0050_translation_en_fr:33 100 1393 { "response": "pluie", "expected": "pluie", "is_correct": true }
[+]
0050_translation_en_fr:34 100 1319 { "response": "grandir", "expected": "grandir", "is_correct": true }
[+]
0050_translation_en_fr:35 100 1349 { "response": "rapide", "expected": "rapide", "is_correct": true }
[+]
0050_translation_en_fr:36 0 3422 { "response": "", "expected": "étoile", "is_correct": false }
[+]
0050_translation_en_fr:37 100 1402 { "response": "danser", "expected": "danser", "is_correct": true }
[+]
0050_translation_en_fr:38 0 3373 { "response": "", "expected": "lourd", "is_correct": false }
[+]
0050_translation_en_fr:39 100 1431 { "response": "feu", "expected": "feu", "is_correct": true }
[+]
0050_translation_en_fr:4 100 1355 { "response": "manger", "expected": "manger", "is_correct": true }
[+]
0050_translation_en_fr:40 100 1640 { "response": "respirer", "expected": "respirer", "is_correct": true }
[+]
0050_translation_en_fr:41 100 1426 { "response": "pointu", "expected": "pointu", "is_correct": true }
[+]
0050_translation_en_fr:42 100 1283 { "response": "sel", "expected": "sel", "is_correct": true }
[+]
0050_translation_en_fr:43 100 1312 { "response": "cacher", "expected": "cacher", "is_correct": true }
[+]
0050_translation_en_fr:44 100 1346 { "response": "lisse", "expected": "lisse", "is_correct": true }
[+]
0050_translation_en_fr:45 100 1380 { "response": "herbe", "expected": "herbe", "is_correct": true }
[+]
0050_translation_en_fr:46 100 1376 { "response": "voler", "expected": "voler", "is_correct": true }
[+]
0050_translation_en_fr:47 100 1393 { "response": "froid", "expected": "froid", "is_correct": true }
[+]
0050_translation_en_fr:48 100 1355 { "response": "sable", "expected": "sable", "is_correct": true }
[+]
0050_translation_en_fr:49 100 1369 { "response": "tomber", "expected": "tomber", "is_correct": true }
[+]
0050_translation_en_fr:5 0 1407 { "response": "belle", "expected": "beau/belle", "is_correct": false }
[+]
0050_translation_en_fr:50 100 1369 { "response": "léger", "expected": "léger", "is_correct": true }
[+]
0050_translation_en_fr:6 100 1422 { "response": "eau", "expected": "eau", "is_correct": true }
[+]
0050_translation_en_fr:7 100 1438 { "response": "dormir", "expected": "dormir", "is_correct": true }
[+]
0050_translation_en_fr:8 100 1389 { "response": "lune", "expected": "lune", "is_correct": true }
[+]
0050_translation_en_fr:9 100 1410 { "response": "rire", "expected": "rire", "is_correct": true }
[+]