Benchmark Run Details

System Prompt

You are a linguistic expert specializing in phonetics. 
Your task is to provide the IPA (International Phonetic Alphabet) pronunciation for English words.
Use American English pronunciation as your default standard.
Provide only the IPA transcription with no additional text or explanation.
Include stress markers and all appropriate IPA symbols.

Run Summary

Model claude-3-5-haiku-20241022
Benchmark 0061_english_to_ipa
Normed Score 50
Run Timestamp 2025-04-04 16:46:47

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0061_english_to_ipa:0 100 1423 { "response": "/ɹid/", "expected": "ɹid", "is_correct": true }
[+]
0061_english_to_ipa:1 0 715 { "response": "ɹid", "expected": "ɹɛd", "is_correct": false }
[+]
0061_english_to_ipa:10 0 922 { "response": "/θruː/", "expected": "θɹu", "is_correct": false }
[+]
0061_english_to_ipa:11 100 778 { "response": "/naɪt/", "expected": "naɪt", "is_correct": true }
[+]
0061_english_to_ipa:12 0 1369 { "response": "saɪˈkɑːlədʒi", "expected": "saɪˈkɑlədʒi", "is_correct": false }
[+]
0061_english_to_ipa:13 0 1226 { "response": "ˈkɜːrnəl", "expected": "ˈkɜɹnəl", "is_correct": false }
[+]
0061_english_to_ipa:14 0 922 { "response": "ˈsʌt.əl", "expected": "ˈsʌtl̩", "is_correct": false }
[+]
0061_english_to_ipa:15 0 919 { "response": "ɪˈpɪt.əm", "expected": "əˈpɪtəmi", "is_correct": false }
[+]
0061_english_to_ipa:16 0 1212 { "response": "ˈkeɪ.ɒs", "expected": "ˈkeɪɑs", "is_correct": false }
[+]
0061_english_to_ipa:17 0 1245 { "response": "/kjuː/", "expected": "kju", "is_correct": false }
[+]
0061_english_to_ipa:18 0 1328 { "response": "/kiː/", "expected": "ki", "is_correct": false }
[+]
0061_english_to_ipa:19 0 1022 { "response": "/ˈaɪ.lənd/", "expected": "ˈaɪlənd", "is_correct": false }
[+]
0061_english_to_ipa:2 100 779 { "response": "ˈmɪnɪt", "expected": "ˈmɪnɪt", "is_correct": true }
[+]
0061_english_to_ipa:20 0 1116 { "response": "ˈskɛdʒuːl", "expected": "ˈskɛdʒul", "is_correct": false }
[+]
0061_english_to_ipa:21 0 934 { "response": "/ˈliʒər/", "expected": "ˈliʒɚ", "is_correct": false }
[+]
0061_english_to_ipa:22 100 1122 { "response": "dɛt", "expected": "dɛt", "is_correct": true }
[+]
0061_english_to_ipa:23 100 1227 { "response": "/ˈsæmən/", "expected": "ˈsæmən", "is_correct": true }
[+]
0061_english_to_ipa:24 100 1741 { "response": "jɑt", "expected": "jɑt", "is_correct": true }
[+]
0061_english_to_ipa:25 100 684 { "response": "aɪl", "expected": "aɪl", "is_correct": true }
[+]
0061_english_to_ipa:26 100 714 { "response": "ɛɹ", "expected": "ɛɹ", "is_correct": true }
[+]
0061_english_to_ipa:27 100 1364 { "response": "/ˈɑnɪst/", "expected": "ˈɑnɪst", "is_correct": true }
[+]
0061_english_to_ipa:28 100 919 { "response": "noʊm", "expected": "noʊm", "is_correct": true }
[+]
0061_english_to_ipa:29 100 921 { "response": "/nuˈmoʊniə/", "expected": "nuˈmoʊniə", "is_correct": true }
[+]
0061_english_to_ipa:3 0 959 { "response": "ˈmɪnɪt", "expected": "maɪˈnut", "is_correct": false }
[+]
0061_english_to_ipa:30 100 894 { "response": "/ˈzaɪləfoʊn/", "expected": "ˈzaɪləfoʊn", "is_correct": true }
[+]
0061_english_to_ipa:31 100 1152 { "response": "flɛm", "expected": "flɛm", "is_correct": true }
[+]
0061_english_to_ipa:32 0 938 { "response": "ˈaɪ.ðər", "expected": "ˈiðɚ", "is_correct": false }
[+]
0061_english_to_ipa:33 0 1110 { "response": "ˈkɛɹ.əm.əl", "expected": "ˈkɛɹəməl", "is_correct": false }
[+]
0061_english_to_ipa:34 0 1329 { "response": "/ˈdeɪ.tə/", "expected": "ˈdeɪtə", "is_correct": false }
[+]
0061_english_to_ipa:35 0 762 { "response": "/ɹuːt/", "expected": "ɹut", "is_correct": false }
[+]
0061_english_to_ipa:36 100 874 { "response": "/ˈɔfən/", "expected": "ˈɔfən", "is_correct": true }
[+]
0061_english_to_ipa:37 100 1227 { "response": "ˈsɪrəp", "expected": "ˈsɪɹəp", "is_correct": true }
[+]
0061_english_to_ipa:38 100 820 { "response": "ˈpraɪvəsi", "expected": "ˈpɹaɪvəsi", "is_correct": true }
[+]
0061_english_to_ipa:39 0 914 { "response": "ˈʒɑːnrə", "expected": "ˈʒɑnɹə", "is_correct": false }
[+]
0061_english_to_ipa:4 100 715 { "response": "/beɪs/", "expected": "beɪs", "is_correct": true }
[+]
0061_english_to_ipa:5 100 820 { "response": "/bæs/", "expected": "bæs", "is_correct": true }
[+]
0061_english_to_ipa:6 100 573 { "response": "wɪnd", "expected": "wɪnd", "is_correct": true }
[+]
0061_english_to_ipa:7 0 754 { "response": "/wɪnd/", "expected": "waɪnd", "is_correct": false }
[+]
0061_english_to_ipa:8 100 818 { "response": "tɪɹ", "expected": "tɪɹ", "is_correct": true }
[+]
0061_english_to_ipa:9 0 715 { "response": "tɪɹ", "expected": "tɛɹ", "is_correct": false }
[+]