Benchmark Run Details

System Prompt

You are a linguistic expert specializing in phonetics. 
Your task is to provide the IPA (International Phonetic Alphabet) pronunciation for English words.
Use American English pronunciation as your default standard.
Provide only the IPA transcription with no additional text or explanation.
Include stress markers and all appropriate IPA symbols.

Run Summary

Model gpt-4o-mini-2024-07-18
Benchmark 0061_english_to_ipa
Normed Score 52
Run Timestamp 2025-04-04 16:46:07

Question-Level Details

Question ID Score Evaluation Time (ms) Debug Info
0061_english_to_ipa:0 0 966 { "response": "riːd", "expected": "ɹid", "is_correct": false }
[+]
0061_english_to_ipa:1 100 472 { "response": "rɛd", "expected": "ɹɛd", "is_correct": true }
[+]
0061_english_to_ipa:10 100 511 { "response": "θru", "expected": "θɹu", "is_correct": true }
[+]
0061_english_to_ipa:11 100 613 { "response": "naɪt", "expected": "naɪt", "is_correct": true }
[+]
0061_english_to_ipa:12 0 613 { "response": "saɪˈkɑːlədʒi", "expected": "saɪˈkɑlədʒi", "is_correct": false }
[+]
0061_english_to_ipa:13 100 512 { "response": "ˈkɜrnəl", "expected": "ˈkɜɹnəl", "is_correct": true }
[+]
0061_english_to_ipa:14 0 512 { "response": "ˈsʌtəl", "expected": "ˈsʌtl̩", "is_correct": false }
[+]
0061_english_to_ipa:15 100 510 { "response": "/ɪˈpɪtəmi/", "expected": "əˈpɪtəmi", "is_correct": true }
[+]
0061_english_to_ipa:16 0 510 { "response": "ˈkeɪ.ɑs", "expected": "ˈkeɪɑs", "is_correct": false }
[+]
0061_english_to_ipa:17 100 407 { "response": "kju", "expected": "kju", "is_correct": true }
[+]
0061_english_to_ipa:18 100 412 { "response": "ki", "expected": "ki", "is_correct": true }
[+]
0061_english_to_ipa:19 0 714 { "response": "ˈaɪ.lənd", "expected": "ˈaɪlənd", "is_correct": false }
[+]
0061_english_to_ipa:2 100 613 { "response": "ˈmɪnɪt", "expected": "ˈmɪnɪt", "is_correct": true }
[+]
0061_english_to_ipa:20 0 1229 { "response": "ˈskɛdʒ.uːl", "expected": "ˈskɛdʒul", "is_correct": false }
[+]
0061_english_to_ipa:21 0 511 { "response": "ˈlɛʒər", "expected": "ˈliʒɚ", "is_correct": false }
[+]
0061_english_to_ipa:22 100 510 { "response": "dɛt", "expected": "dɛt", "is_correct": true }
[+]
0061_english_to_ipa:23 100 1126 { "response": "ˈsæmən", "expected": "ˈsæmən", "is_correct": true }
[+]
0061_english_to_ipa:24 100 408 { "response": "jɑt", "expected": "jɑt", "is_correct": true }
[+]
0061_english_to_ipa:25 100 553 { "response": "aɪl", "expected": "aɪl", "is_correct": true }
[+]
0061_english_to_ipa:26 0 470 { "response": "ɛr", "expected": "ɛɹ", "is_correct": false }
[+]
0061_english_to_ipa:27 100 614 { "response": "ˈɑnɪst", "expected": "ˈɑnɪst", "is_correct": true }
[+]
0061_english_to_ipa:28 100 1228 { "response": "/noʊm/", "expected": "noʊm", "is_correct": true }
[+]
0061_english_to_ipa:29 0 509 { "response": "nəˈmoʊ.njə", "expected": "nuˈmoʊniə", "is_correct": false }
[+]
0061_english_to_ipa:3 0 511 { "response": "ˈmɪnɪt", "expected": "maɪˈnut", "is_correct": false }
[+]
0061_english_to_ipa:30 0 642 { "response": "ˈzaɪ.lə.foʊn", "expected": "ˈzaɪləfoʊn", "is_correct": false }
[+]
0061_english_to_ipa:31 100 485 { "response": "flɛm", "expected": "flɛm", "is_correct": true }
[+]
0061_english_to_ipa:32 0 613 { "response": "ˈiːðər", "expected": "ˈiðɚ", "is_correct": false }
[+]
0061_english_to_ipa:33 0 462 { "response": "ˈkɛr.ə.mɛl", "expected": "ˈkɛɹəməl", "is_correct": false }
[+]
0061_english_to_ipa:34 100 519 { "response": "ˈdeɪtə", "expected": "ˈdeɪtə", "is_correct": true }
[+]
0061_english_to_ipa:35 0 776 { "response": "/ruːt/", "expected": "ɹut", "is_correct": false }
[+]
0061_english_to_ipa:36 100 594 { "response": "ˈɔfən", "expected": "ˈɔfən", "is_correct": true }
[+]
0061_english_to_ipa:37 0 1227 { "response": "ˈsɪr.əp", "expected": "ˈsɪɹəp", "is_correct": false }
[+]
0061_english_to_ipa:38 0 716 { "response": "ˈprɪvəsi", "expected": "ˈpɹaɪvəsi", "is_correct": false }
[+]
0061_english_to_ipa:39 0 515 { "response": "ˈʒɑːn.rə", "expected": "ˈʒɑnɹə", "is_correct": false }
[+]
0061_english_to_ipa:4 100 510 { "response": "/beɪs/", "expected": "beɪs", "is_correct": true }
[+]
0061_english_to_ipa:5 100 410 { "response": "/bæs/", "expected": "bæs", "is_correct": true }
[+]
0061_english_to_ipa:6 100 717 { "response": "wɪnd", "expected": "wɪnd", "is_correct": true }
[+]
0061_english_to_ipa:7 0 433 { "response": "wɪnd", "expected": "waɪnd", "is_correct": false }
[+]
0061_english_to_ipa:8 0 590 { "response": "tɛr", "expected": "tɪɹ", "is_correct": false }
[+]
0061_english_to_ipa:9 100 509 { "response": "tɛr", "expected": "tɛɹ", "is_correct": true }
[+]