Benchmark Run Details

System Prompt

You are a linguistic expert specializing in phonetics. 
Your task is to provide the IPA (International Phonetic Alphabet) pronunciation for English words.
Use American English pronunciation as your default standard.
Provide only the IPA transcription with no additional text or explanation.
Include stress markers and all appropriate IPA symbols.

Run Summary

Model phi4:14b:Q4_K_M
Benchmark 0061_english_to_ipa
Normed Score 45
Run Timestamp 2025-04-04 16:44:23

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0061_english_to_ipa:0 0 5743 { "response": "/rɛd/", "expected": "ɹid", "is_correct": false }
[+]
0061_english_to_ipa:1 100 1673 { "response": "/rɛd/", "expected": "ɹɛd", "is_correct": true }
[+]
0061_english_to_ipa:10 0 1627 { "response": "θruː", "expected": "θɹu", "is_correct": false }
[+]
0061_english_to_ipa:11 100 1652 { "response": "naɪt", "expected": "naɪt", "is_correct": true }
[+]
0061_english_to_ipa:12 100 2677 { "response": "/saɪˈkɑlədʒi/", "expected": "saɪˈkɑlədʒi", "is_correct": true }
[+]
0061_english_to_ipa:13 0 2306 { "response": "/ˈkɝːnəl/", "expected": "ˈkɜɹnəl", "is_correct": false }
[+]
0061_english_to_ipa:14 0 2165 { "response": "ˈsʌb.təl", "expected": "ˈsʌtl̩", "is_correct": false }
[+]
0061_english_to_ipa:15 0 2448 { "response": "/ˈɛpəˌtoʊmi/", "expected": "əˈpɪtəmi", "is_correct": false }
[+]
0061_english_to_ipa:16 0 2053 { "response": "/ˈkeɪ.əs/", "expected": "ˈkeɪɑs", "is_correct": false }
[+]
0061_english_to_ipa:17 0 1626 { "response": "/kjuː/", "expected": "kju", "is_correct": false }
[+]
0061_english_to_ipa:18 100 1369 { "response": "/ki/", "expected": "ki", "is_correct": true }
[+]
0061_english_to_ipa:19 100 2097 { "response": "/ˈaɪlənd/", "expected": "ˈaɪlənd", "is_correct": true }
[+]
0061_english_to_ipa:2 100 2178 { "response": "ˈmɪnɪt", "expected": "ˈmɪnɪt", "is_correct": true }
[+]
0061_english_to_ipa:20 0 2551 { "response": "/ˈskɛdʒuːl/", "expected": "ˈskɛdʒul", "is_correct": false }
[+]
0061_english_to_ipa:21 0 2219 { "response": "/ˈlɛʒər/", "expected": "ˈliʒɚ", "is_correct": false }
[+]
0061_english_to_ipa:22 0 1869 { "response": "ˈdɛt", "expected": "dɛt", "is_correct": false }
[+]
0061_english_to_ipa:23 100 2027 { "response": "/ˈsæmən/", "expected": "ˈsæmən", "is_correct": true }
[+]
0061_english_to_ipa:24 0 1921 { "response": "/jɑːt/", "expected": "jɑt", "is_correct": false }
[+]
0061_english_to_ipa:25 100 1681 { "response": "/aɪl/", "expected": "aɪl", "is_correct": true }
[+]
0061_english_to_ipa:26 0 1578 { "response": "/ɛr/", "expected": "ɛɹ", "is_correct": false }
[+]
0061_english_to_ipa:27 100 2068 { "response": "ˈɑnəst", "expected": "ˈɑnɪst", "is_correct": true }
[+]
0061_english_to_ipa:28 100 1697 { "response": "/noʊm/", "expected": "noʊm", "is_correct": true }
[+]
0061_english_to_ipa:29 0 2443 { "response": "/njuːˈmoʊniə/", "expected": "nuˈmoʊniə", "is_correct": false }
[+]
0061_english_to_ipa:3 0 2166 { "response": "ˈmɪnɪt", "expected": "maɪˈnut", "is_correct": false }
[+]
0061_english_to_ipa:30 100 2408 { "response": "/ˈzaɪləfoʊn/", "expected": "ˈzaɪləfoʊn", "is_correct": true }
[+]
0061_english_to_ipa:31 0 2430 { "response": "/fˈlɛɡ(ə)m/", "expected": "flɛm", "is_correct": false }
[+]
0061_english_to_ipa:32 0 2028 { "response": "ˈiðər", "expected": "ˈiðɚ", "is_correct": false }
[+]
0061_english_to_ipa:33 100 2569 { "response": "ˈkɑrəm(ə)l", "expected": "ˈkɛɹəməl", "is_correct": true }
[+]
0061_english_to_ipa:34 0 2061 { "response": "ˈdeɪ.tə", "expected": "ˈdeɪtə", "is_correct": false }
[+]
0061_english_to_ipa:35 0 1939 { "response": "ˈruːt", "expected": "ɹut", "is_correct": false }
[+]
0061_english_to_ipa:36 100 2119 { "response": "ˈɔfən", "expected": "ˈɔfən", "is_correct": true }
[+]
0061_english_to_ipa:37 0 2230 { "response": "/ˈsɝːp/", "expected": "ˈsɪɹəp", "is_correct": false }
[+]
0061_english_to_ipa:38 0 2178 { "response": "/ˈpraɪ.və.si/", "expected": "ˈpɹaɪvəsi", "is_correct": false }
[+]
0061_english_to_ipa:39 0 2258 { "response": "/ʒɑːn(r)/", "expected": "ˈʒɑnɹə", "is_correct": false }
[+]
0061_english_to_ipa:4 100 1674 { "response": "/beɪs/", "expected": "beɪs", "is_correct": true }
[+]
0061_english_to_ipa:5 0 1749 { "response": "ˈbæs", "expected": "bæs", "is_correct": false }
[+]
0061_english_to_ipa:6 100 1659 { "response": "/wɪnd/", "expected": "wɪnd", "is_correct": true }
[+]
0061_english_to_ipa:7 100 1635 { "response": "/waɪnd/", "expected": "waɪnd", "is_correct": true }
[+]
0061_english_to_ipa:8 100 1623 { "response": "/tɪr/", "expected": "tɪɹ", "is_correct": true }
[+]
0061_english_to_ipa:9 100 1613 { "response": "/tɛr/", "expected": "tɛɹ", "is_correct": true }
[+]