Benchmark Run Details

System Prompt

You are a linguistic expert specializing in phonetics. 
Your task is to provide the IPA (International Phonetic Alphabet) pronunciation for English words.
Use American English pronunciation as your default standard.
Provide only the IPA transcription with no additional text or explanation.
Include stress markers and all appropriate IPA symbols.

Run Summary

Model gpt-4.1-mini-2025-04-14
Benchmark 0061_english_to_ipa
Normed Score 37
Run Timestamp 2025-04-24 18:09:38

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0061_english_to_ipa:0 0 1290 { "response": "ɹiːd", "expected": "ɹid", "is_correct": false }
[+]
0061_english_to_ipa:1 100 1058 { "response": "ɹɛd", "expected": "ɹɛd", "is_correct": true }
[+]
0061_english_to_ipa:10 0 1075 { "response": "θruː", "expected": "θɹu", "is_correct": false }
[+]
0061_english_to_ipa:11 100 1183 { "response": "/naɪt/", "expected": "naɪt", "is_correct": true }
[+]
0061_english_to_ipa:12 0 1115 { "response": "saɪˈkɑːlədʒi", "expected": "saɪˈkɑlədʒi", "is_correct": false }
[+]
0061_english_to_ipa:13 0 1310 { "response": "ˈkɝnəl", "expected": "ˈkɜɹnəl", "is_correct": false }
[+]
0061_english_to_ipa:14 0 1135 { "response": "ˈsʌtəl", "expected": "ˈsʌtl̩", "is_correct": false }
[+]
0061_english_to_ipa:15 100 1240 { "response": "ɪˈpɪtəmi", "expected": "əˈpɪtəmi", "is_correct": true }
[+]
0061_english_to_ipa:16 0 1078 { "response": "ˈkeɪ.ɑs", "expected": "ˈkeɪɑs", "is_correct": false }
[+]
0061_english_to_ipa:17 0 1165 { "response": "/kjuː/", "expected": "kju", "is_correct": false }
[+]
0061_english_to_ipa:18 0 828 { "response": "kwiː", "expected": "ki", "is_correct": false }
[+]
0061_english_to_ipa:19 0 1195 { "response": "ˈaɪ.lənd", "expected": "ˈaɪlənd", "is_correct": false }
[+]
0061_english_to_ipa:2 100 1090 { "response": "ˈmɪnɪt", "expected": "ˈmɪnɪt", "is_correct": true }
[+]
0061_english_to_ipa:20 0 962 { "response": "ˈskɛdʒ.uːl", "expected": "ˈskɛdʒul", "is_correct": false }
[+]
0061_english_to_ipa:21 0 908 { "response": "ˈliʒər", "expected": "ˈliʒɚ", "is_correct": false }
[+]
0061_english_to_ipa:22 0 1953 { "response": "ˈdɛt", "expected": "dɛt", "is_correct": false }
[+]
0061_english_to_ipa:23 100 810 { "response": "ˈsæmən", "expected": "ˈsæmən", "is_correct": true }
[+]
0061_english_to_ipa:24 0 869 { "response": "ˈjɑt", "expected": "jɑt", "is_correct": false }
[+]
0061_english_to_ipa:25 100 656 { "response": "aɪl", "expected": "aɪl", "is_correct": true }
[+]
0061_english_to_ipa:26 0 956 { "response": "ɛr", "expected": "ɛɹ", "is_correct": false }
[+]
0061_english_to_ipa:27 100 808 { "response": "ˈɑnɪst", "expected": "ˈɑnɪst", "is_correct": true }
[+]
0061_english_to_ipa:28 0 898 { "response": "ˈnoʊm", "expected": "noʊm", "is_correct": false }
[+]
0061_english_to_ipa:29 0 1217 { "response": "n(j)uːˈmoʊniə", "expected": "nuˈmoʊniə", "is_correct": false }
[+]
0061_english_to_ipa:3 0 1146 { "response": "ˈmɪnɪt", "expected": "maɪˈnut", "is_correct": false }
[+]
0061_english_to_ipa:30 0 1134 { "response": "ˈzaɪləˌfoʊn", "expected": "ˈzaɪləfoʊn", "is_correct": false }
[+]
0061_english_to_ipa:31 100 1232 { "response": "flɛm", "expected": "flɛm", "is_correct": true }
[+]
0061_english_to_ipa:32 0 776 { "response": "ˈiːðər", "expected": "ˈiðɚ", "is_correct": false }
[+]
0061_english_to_ipa:33 100 1169 { "response": "ˈkærəməl", "expected": "ˈkɛɹəməl", "is_correct": true }
[+]
0061_english_to_ipa:34 0 920 { "response": "/ˈdeɪ.tə/", "expected": "ˈdeɪtə", "is_correct": false }
[+]
0061_english_to_ipa:35 0 1543 { "response": "/raʊt/", "expected": "ɹut", "is_correct": false }
[+]
0061_english_to_ipa:36 0 807 { "response": "ˈɔf.tən", "expected": "ˈɔfən", "is_correct": false }
[+]
0061_english_to_ipa:37 100 1231 { "response": "ˈsɪɹəp", "expected": "ˈsɪɹəp", "is_correct": true }
[+]
0061_english_to_ipa:38 100 1282 { "response": "ˈpraɪvəsi", "expected": "ˈpɹaɪvəsi", "is_correct": true }
[+]
0061_english_to_ipa:39 100 742 { "response": "ˈʒɑnrə", "expected": "ˈʒɑnɹə", "is_correct": true }
[+]
0061_english_to_ipa:4 0 1010 { "response": "bæs", "expected": "beɪs", "is_correct": false }
[+]
0061_english_to_ipa:5 100 4907 { "response": "bæs", "expected": "bæs", "is_correct": true }
[+]
0061_english_to_ipa:6 100 1328 { "response": "wɪnd", "expected": "wɪnd", "is_correct": true }
[+]
0061_english_to_ipa:7 0 2265 { "response": "ˈwɪnd", "expected": "waɪnd", "is_correct": false }
[+]
0061_english_to_ipa:8 100 1217 { "response": "tɪr", "expected": "tɪɹ", "is_correct": true }
[+]
0061_english_to_ipa:9 0 1123 { "response": "tɪr", "expected": "tɛɹ", "is_correct": false }
[+]