Benchmark Run Details

System Prompt

You are helping with a language translation task.
When translating a word from EN to FR:
- Provide the most direct and common translation
- Give only the base form of the word
- Do not include articles unless they are part of the standard translation
- Do not provide explanations or alternative translations

Run Summary

Model qwen3:4b:Q4_K_M
Benchmark 0050_translation_en_fr
Normed Score 100
Run Timestamp 2025-04-29 17:16:17

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0050_translation_en_fr:0 100 1160 { "response": "fleur", "expected": "fleur", "is_correct": true }
[+]
0050_translation_en_fr:1 100 759 { "response": "conduire", "expected": "conduire", "is_correct": true }
[+]
0050_translation_en_fr:10 100 773 { "response": "montagne", "expected": "montagne", "is_correct": true }
[+]
0050_translation_en_fr:11 100 686 { "response": "chanter", "expected": "chanter", "is_correct": true }
[+]
0050_translation_en_fr:12 100 676 { "response": "cœur", "expected": "cœur", "is_correct": true }
[+]
0050_translation_en_fr:13 100 841 { "response": "lumineux", "expected": "lumineux", "is_correct": true }
[+]
0050_translation_en_fr:14 100 721 { "response": "danser", "expected": "danser", "is_correct": true }
[+]
0050_translation_en_fr:15 100 792 { "response": "silencieux", "expected": "silencieux", "is_correct": true }
[+]
0050_translation_en_fr:16 100 757 { "response": "arbre", "expected": "arbre", "is_correct": true }
[+]
0050_translation_en_fr:17 100 754 { "response": "écrire", "expected": "écrire", "is_correct": true }
[+]
0050_translation_en_fr:18 100 759 { "response": "ciel", "expected": "ciel", "is_correct": true }
[+]
0050_translation_en_fr:19 100 671 { "response": "frais", "expected": "frais", "is_correct": true }
[+]
0050_translation_en_fr:2 100 806 { "response": "le plus fort", "expected": "le plus fort", "is_correct": true }
[+]
0050_translation_en_fr:20 100 643 { "response": "ami", "expected": "ami", "is_correct": true }
[+]
0050_translation_en_fr:21 100 758 { "response": "courir", "expected": "courir", "is_correct": true }
[+]
0050_translation_en_fr:22 100 774 { "response": "rond", "expected": "rond", "is_correct": true }
[+]
0050_translation_en_fr:23 100 638 { "response": "vent", "expected": "vent", "is_correct": true }
[+]
0050_translation_en_fr:24 100 772 { "response": "chaud", "expected": "chaud", "is_correct": true }
[+]
0050_translation_en_fr:25 100 781 { "response": "pierre", "expected": "pierre", "is_correct": true }
[+]
0050_translation_en_fr:26 100 677 { "response": "profond", "expected": "profond", "is_correct": true }
[+]
0050_translation_en_fr:27 100 756 { "response": "nager", "expected": "nager", "is_correct": true }
[+]
0050_translation_en_fr:28 100 755 { "response": "oiseau", "expected": "oiseau", "is_correct": true }
[+]
0050_translation_en_fr:29 100 787 { "response": "sucré", "expected": "sucré", "is_correct": true }
[+]
0050_translation_en_fr:3 100 695 { "response": "livre", "expected": "livre", "is_correct": true }
[+]
0050_translation_en_fr:30 100 752 { "response": "nuage", "expected": "nuage", "is_correct": true }
[+]
0050_translation_en_fr:31 100 787 { "response": "sourire", "expected": "sourire", "is_correct": true }
[+]
0050_translation_en_fr:32 100 753 { "response": "doux", "expected": "doux", "is_correct": true }
[+]
0050_translation_en_fr:33 100 701 { "response": "pluie", "expected": "pluie", "is_correct": true }
[+]
0050_translation_en_fr:34 100 666 { "response": "grandir", "expected": "grandir", "is_correct": true }
[+]
0050_translation_en_fr:35 100 752 { "response": "rapide", "expected": "rapide", "is_correct": true }
[+]
0050_translation_en_fr:36 100 786 { "response": "étoile", "expected": "étoile", "is_correct": true }
[+]
0050_translation_en_fr:37 100 786 { "response": "danser", "expected": "danser", "is_correct": true }
[+]
0050_translation_en_fr:38 100 665 { "response": "lourd", "expected": "lourd", "is_correct": true }
[+]
0050_translation_en_fr:39 100 666 { "response": "feu", "expected": "feu", "is_correct": true }
[+]
0050_translation_en_fr:4 100 764 { "response": "manger", "expected": "manger", "is_correct": true }
[+]
0050_translation_en_fr:40 100 785 { "response": "respirer", "expected": "respirer", "is_correct": true }
[+]
0050_translation_en_fr:41 100 665 { "response": "pointu", "expected": "pointu", "is_correct": true }
[+]
0050_translation_en_fr:42 100 632 { "response": "sel", "expected": "sel", "is_correct": true }
[+]
0050_translation_en_fr:43 100 751 { "response": "cacher", "expected": "cacher", "is_correct": true }
[+]
0050_translation_en_fr:44 100 751 { "response": "lisse", "expected": "lisse", "is_correct": true }
[+]
0050_translation_en_fr:45 100 666 { "response": "herbe", "expected": "herbe", "is_correct": true }
[+]
0050_translation_en_fr:46 100 754 { "response": "voler", "expected": "voler", "is_correct": true }
[+]
0050_translation_en_fr:47 100 752 { "response": "froid", "expected": "froid", "is_correct": true }
[+]
0050_translation_en_fr:48 100 665 { "response": "sable", "expected": "sable", "is_correct": true }
[+]
0050_translation_en_fr:49 100 666 { "response": "tomber", "expected": "tomber", "is_correct": true }
[+]
0050_translation_en_fr:5 100 896 { "response": "beau/belle", "expected": "beau/belle", "is_correct": true }
[+]
0050_translation_en_fr:50 100 666 { "response": "léger", "expected": "léger", "is_correct": true }
[+]
0050_translation_en_fr:6 100 712 { "response": "eau", "expected": "eau", "is_correct": true }
[+]
0050_translation_en_fr:7 100 742 { "response": "dormir", "expected": "dormir", "is_correct": true }
[+]
0050_translation_en_fr:8 100 721 { "response": "lune", "expected": "lune", "is_correct": true }
[+]
0050_translation_en_fr:9 100 743 { "response": "rire", "expected": "rire", "is_correct": true }
[+]