Benchmark Run Details

System Prompt

You are helping with a language translation task.
When translating a word from EN to FR:
- Provide the most direct and common translation
- Give only the base form of the word
- Do not include articles unless they are part of the standard translation
- Do not provide explanations or alternative translations

Run Summary

Model granite3.3:8b:Q4_K_M
Benchmark 0050_translation_en_fr
Normed Score 98
Run Timestamp 2025-04-28 00:20:19

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0050_translation_en_fr:0 100 3545 { "response": "fleur", "expected": "fleur", "is_correct": true }
[+]
0050_translation_en_fr:1 100 1971 { "response": "conduire", "expected": "conduire", "is_correct": true }
[+]
0050_translation_en_fr:10 100 2051 { "response": "montagne", "expected": "montagne", "is_correct": true }
[+]
0050_translation_en_fr:11 100 1860 { "response": "chanter", "expected": "chanter", "is_correct": true }
[+]
0050_translation_en_fr:12 100 2323 { "response": "cœur", "expected": "cœur", "is_correct": true }
[+]
0050_translation_en_fr:13 100 2122 { "response": "lumineux", "expected": "lumineux", "is_correct": true }
[+]
0050_translation_en_fr:14 100 2142 { "response": "danser", "expected": "danser", "is_correct": true }
[+]
0050_translation_en_fr:15 100 2143 { "response": "silencieux", "expected": "silencieux", "is_correct": true }
[+]
0050_translation_en_fr:16 100 2159 { "response": "arbre", "expected": "arbre", "is_correct": true }
[+]
0050_translation_en_fr:17 100 2152 { "response": "écrire", "expected": "écrire", "is_correct": true }
[+]
0050_translation_en_fr:18 100 2309 { "response": "ciel", "expected": "ciel", "is_correct": true }
[+]
0050_translation_en_fr:19 100 2177 { "response": "frais", "expected": "frais", "is_correct": true }
[+]
0050_translation_en_fr:2 100 2241 { "response": "le plus fort", "expected": "le plus fort", "is_correct": true }
[+]
0050_translation_en_fr:20 100 1966 { "response": "ami", "expected": "ami", "is_correct": true }
[+]
0050_translation_en_fr:21 100 2098 { "response": "courir", "expected": "courir", "is_correct": true }
[+]
0050_translation_en_fr:22 100 1989 { "response": "rond", "expected": "rond", "is_correct": true }
[+]
0050_translation_en_fr:23 100 1988 { "response": "vent", "expected": "vent", "is_correct": true }
[+]
0050_translation_en_fr:24 100 2224 { "response": "chaud", "expected": "chaud", "is_correct": true }
[+]
0050_translation_en_fr:25 100 2077 { "response": "pierre", "expected": "pierre", "is_correct": true }
[+]
0050_translation_en_fr:26 100 2159 { "response": "profond", "expected": "profond", "is_correct": true }
[+]
0050_translation_en_fr:27 100 2284 { "response": "nager", "expected": "nager", "is_correct": true }
[+]
0050_translation_en_fr:28 100 2191 { "response": "oiseau", "expected": "oiseau", "is_correct": true }
[+]
0050_translation_en_fr:29 100 2060 { "response": "sucré", "expected": "sucré", "is_correct": true }
[+]
0050_translation_en_fr:3 100 1861 { "response": "livre", "expected": "livre", "is_correct": true }
[+]
0050_translation_en_fr:30 100 2132 { "response": "nuage", "expected": "nuage", "is_correct": true }
[+]
0050_translation_en_fr:31 100 2057 { "response": "sourire", "expected": "sourire", "is_correct": true }
[+]
0050_translation_en_fr:32 100 2282 { "response": "doux", "expected": "doux", "is_correct": true }
[+]
0050_translation_en_fr:33 100 2119 { "response": "pluie", "expected": "pluie", "is_correct": true }
[+]
0050_translation_en_fr:34 100 2153 { "response": "grandir", "expected": "grandir", "is_correct": true }
[+]
0050_translation_en_fr:35 100 2241 { "response": "rapide", "expected": "rapide", "is_correct": true }
[+]
0050_translation_en_fr:36 100 2170 { "response": "étoile", "expected": "étoile", "is_correct": true }
[+]
0050_translation_en_fr:37 100 2289 { "response": "danser", "expected": "danser", "is_correct": true }
[+]
0050_translation_en_fr:38 100 2197 { "response": "lourd", "expected": "lourd", "is_correct": true }
[+]
0050_translation_en_fr:39 100 2179 { "response": "feu", "expected": "feu", "is_correct": true }
[+]
0050_translation_en_fr:4 100 2143 { "response": "manger", "expected": "manger", "is_correct": true }
[+]
0050_translation_en_fr:40 100 2258 { "response": "respirer", "expected": "respirer", "is_correct": true }
[+]
0050_translation_en_fr:41 100 2092 { "response": "pointu", "expected": "pointu", "is_correct": true }
[+]
0050_translation_en_fr:42 100 1968 { "response": "sel", "expected": "sel", "is_correct": true }
[+]
0050_translation_en_fr:43 100 1818 { "response": "cacher", "expected": "cacher", "is_correct": true }
[+]
0050_translation_en_fr:44 100 2330 { "response": "lisse", "expected": "lisse", "is_correct": true }
[+]
0050_translation_en_fr:45 100 1997 { "response": "herbe", "expected": "herbe", "is_correct": true }
[+]
0050_translation_en_fr:46 100 2370 { "response": "voler", "expected": "voler", "is_correct": true }
[+]
0050_translation_en_fr:47 100 2150 { "response": "froid", "expected": "froid", "is_correct": true }
[+]
0050_translation_en_fr:48 100 1947 { "response": "sable", "expected": "sable", "is_correct": true }
[+]
0050_translation_en_fr:49 100 2822 { "response": "tomber", "expected": "tomber", "is_correct": true }
[+]
0050_translation_en_fr:5 0 1987 { "response": "belle", "expected": "beau/belle", "is_correct": false }
[+]
0050_translation_en_fr:50 100 2560 { "response": "léger", "expected": "léger", "is_correct": true }
[+]
0050_translation_en_fr:6 100 2032 { "response": "eau", "expected": "eau", "is_correct": true }
[+]
0050_translation_en_fr:7 100 2170 { "response": "dormir", "expected": "dormir", "is_correct": true }
[+]
0050_translation_en_fr:8 100 1948 { "response": "lune", "expected": "lune", "is_correct": true }
[+]
0050_translation_en_fr:9 100 2005 { "response": "rire", "expected": "rire", "is_correct": true }
[+]