Benchmark Run Details

System Prompt

You are a linguistic expert specializing in phonetics. 
Your task is to provide the IPA (International Phonetic Alphabet) pronunciation for English words.
Use American English pronunciation as your default standard.
Provide only the IPA transcription with no additional text or explanation.
Include stress markers and all appropriate IPA symbols.

Run Summary

Model qwen2.5:7b:Q4_K_M
Benchmark 0061_english_to_ipa
Normed Score 25
Run Timestamp 2025-04-04 16:34:50

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0061_english_to_ipa:0 0 4241 { "response": "/riːd/", "expected": "ɹid", "is_correct": false }
[+]
0061_english_to_ipa:1 0 784 { "response": "/riːd/", "expected": "ɹɛd", "is_correct": false }
[+]
0061_english_to_ipa:10 0 791 { "response": "/θruː/", "expected": "θɹu", "is_correct": false }
[+]
0061_english_to_ipa:11 100 784 { "response": "/naɪt/", "expected": "naɪt", "is_correct": true }
[+]
0061_english_to_ipa:12 0 1191 { "response": "/ˈsɪkələdʒi/", "expected": "saɪˈkɑlədʒi", "is_correct": false }
[+]
0061_english_to_ipa:13 0 1059 { "response": "/ˈkɑlənɛl/", "expected": "ˈkɜɹnəl", "is_correct": false }
[+]
0061_english_to_ipa:14 0 1013 { "response": "/ˈsʌb.təl/", "expected": "ˈsʌtl̩", "is_correct": false }
[+]
0061_english_to_ipa:15 0 1005 { "response": "/ˈɛpɪtəm/", "expected": "əˈpɪtəmi", "is_correct": false }
[+]
0061_english_to_ipa:16 0 946 { "response": "/ˈkeɪ.ɒs/", "expected": "ˈkeɪɑs", "is_correct": false }
[+]
0061_english_to_ipa:17 0 782 { "response": "/kwiː/", "expected": "kju", "is_correct": false }
[+]
0061_english_to_ipa:18 0 832 { "response": "/ˈkɛɪ/", "expected": "ki", "is_correct": false }
[+]
0061_english_to_ipa:19 100 935 { "response": "/ˈaɪlənd/", "expected": "ˈaɪlənd", "is_correct": true }
[+]
0061_english_to_ipa:2 100 955 { "response": "/ˈmɪnɪt/", "expected": "ˈmɪnɪt", "is_correct": true }
[+]
0061_english_to_ipa:20 100 1012 { "response": "/ˈskɛdʒʊl/", "expected": "ˈskɛdʒul", "is_correct": true }
[+]
0061_english_to_ipa:21 0 834 { "response": "/ˈlisər/", "expected": "ˈliʒɚ", "is_correct": false }
[+]
0061_english_to_ipa:22 0 782 { "response": "/dɛbt/", "expected": "dɛt", "is_correct": false }
[+]
0061_english_to_ipa:23 0 990 { "response": "/ˈsæl.fən/", "expected": "ˈsæmən", "is_correct": false }
[+]
0061_english_to_ipa:24 0 786 { "response": "/jɑkt/", "expected": "jɑt", "is_correct": false }
[+]
0061_english_to_ipa:25 0 828 { "response": "/ˈaɪsl/", "expected": "aɪl", "is_correct": false }
[+]
0061_english_to_ipa:26 0 833 { "response": "/hɛər/", "expected": "ɛɹ", "is_correct": false }
[+]
0061_english_to_ipa:27 0 1101 { "response": "/ˈhɑːn.stəʊn/", "expected": "ˈɑnɪst", "is_correct": false }
[+]
0061_english_to_ipa:28 100 795 { "response": "/noʊm/", "expected": "noʊm", "is_correct": true }
[+]
0061_english_to_ipa:29 0 1116 { "response": "/ˈnjuːmənɪə/", "expected": "nuˈmoʊniə", "is_correct": false }
[+]
0061_english_to_ipa:3 0 938 { "response": "/ˈmɪnɪt/", "expected": "maɪˈnut", "is_correct": false }
[+]
0061_english_to_ipa:30 0 1104 { "response": "/ˈzɪləfɑʊn/", "expected": "ˈzaɪləfoʊn", "is_correct": false }
[+]
0061_english_to_ipa:31 0 886 { "response": "/ˈfleɡm/", "expected": "flɛm", "is_correct": false }
[+]
0061_english_to_ipa:32 0 947 { "response": "/ˈɛð.ɹɪ/", "expected": "ˈiðɚ", "is_correct": false }
[+]
0061_english_to_ipa:33 100 1002 { "response": "/ˈkærəməl/", "expected": "ˈkɛɹəməl", "is_correct": true }
[+]
0061_english_to_ipa:34 0 893 { "response": "/ˈdætə/", "expected": "ˈdeɪtə", "is_correct": false }
[+]
0061_english_to_ipa:35 0 788 { "response": "/roʊt/", "expected": "ɹut", "is_correct": false }
[+]
0061_english_to_ipa:36 0 950 { "response": "/ˈɔf.tən/", "expected": "ˈɔfən", "is_correct": false }
[+]
0061_english_to_ipa:37 100 952 { "response": "/ˈsɪrəp/", "expected": "ˈsɪɹəp", "is_correct": true }
[+]
0061_english_to_ipa:38 0 957 { "response": "/ˈprɪvəsi/", "expected": "ˈpɹaɪvəsi", "is_correct": false }
[+]
0061_english_to_ipa:39 0 965 { "response": "/ˈdʒɛnrə/", "expected": "ˈʒɑnɹə", "is_correct": false }
[+]
0061_english_to_ipa:4 100 779 { "response": "/beɪs/", "expected": "beɪs", "is_correct": true }
[+]
0061_english_to_ipa:5 100 772 { "response": "/bæs/", "expected": "bæs", "is_correct": true }
[+]
0061_english_to_ipa:6 100 780 { "response": "/wɪnd/", "expected": "wɪnd", "is_correct": true }
[+]
0061_english_to_ipa:7 0 771 { "response": "/wɪnd/", "expected": "waɪnd", "is_correct": false }
[+]
0061_english_to_ipa:8 0 833 { "response": "/tɛər/", "expected": "tɪɹ", "is_correct": false }
[+]
0061_english_to_ipa:9 0 841 { "response": "/tɛər/", "expected": "tɛɹ", "is_correct": false }
[+]