an icelandic pronunciation dictionary for tts - wordpress.com

1
An Icelandic Pronunciation Dictionary for TTS Anna Björk Nikulásdóttir, Jón Guðnason, Eiríkur Rögnvaldsson* Center for Analysis and Design of Intelligent Agents, Language and Voice Lab (https://lvl.ru.is/), Reykjavik University *University of Iceland Overview 1. Phoneset consistency Corrections with regard to a closed set of 58 transcription symbols IPA transcripts used 440 entries corrected, 159 entries removed (abbreviations, compounds) 2. Postaspiration A large inconsistency issue Partly a distinctive feature: /pahka/ vs. /pʰahka/ ( bakka vs pakka) Automatic correction possible word initially 5,330 entries corrected 4. Variation Sources of variation: Dialects Homography Person and/or situation dependent Common alternative transcriptions processed, one alt. chosen Other entries with multiple transcriptions removed 5. Compound analysis Decompounding and comparison of components across the dictionary Choose clear, standard pronunciation Over 200 errors identified, corresponding entries removed Over 13,400 compounds removed 6. Vowel length Partly a distinctive feature: /ama/ vs. /aːma/ (amma vs ama) Follows well defined rules for simple words More vague for derivations and compounds No changes made to the current (partly inconsistent) length labeling 7. G2P Alignment Automatically generated g2p-map Forced alignment performed using entries from the map as anchors Scarce mappings inspected for errors, 481 erroneous entries removed A d a m /aː t a m/ 3. Diphthong consistency Seven different diphthong symbols: /ai, au, ou, ei, œy, ʏi, ɔi/ Both regular grapheme(s)-to-diphthong correspondences and various context/dialect dependent combinations Entries not matching grapheme-diphthong rules deleted: ~4,500 entries aːma G2P Transcription Experiments – Set up Two g2p models trained using the Sequitur 1 toolkit, based on: Cleaned IPD, ~40,000 entries (minus entries occurring in test/dev sets) Raw IPD, ~65,000 entries (minus entries occurring in test/dev sets) Training parameters: L=1 (max number of phonemes and graphemes in a graphone) M=5 (number of adjacent graphones to consider) Held-out set: 5% Development set, manually corrected: 700 entries Test set, manually corrected: 300 entries G2P Transcription Experiments – Results WER/PER Training set Test set WER PER Raw IPD Dev 38% 5.65% Clean IPD Dev 25.33% 2.82% Raw IPD Test 37.29% 6.1% Clean IPD Test 24.43% 3.4% G2P Transcription Experiments – Results Categories Error category Raw IPD Clean IPD Vowel length 42 29.2% 53 61% Postaspiration 46 32% 19 21.8% Dialect 6 4% 0 0% Style/variation 7 4.9% 2 2.3% Consonant voiceness 5 3.5% 4 4.6% Other errors 38 26.4% 9 10.3% SUM 144 100.0% 87 100.0% Database example – Generate transcriptions by dialect A manually transcribed pronunciation dictionary for Icelandic (IPD) was examined through pattern analysis and alignment procedures The aim was to create a more consistent version of the dictionary to improve grapheme-to-phoneme models needed in a TTS system under development During cleaning the size of the dictionary was reduced from ~65,000 entries to ~40,000 entries Significant improvement in PER for automatic transcriptions based on a g2p model trained on the clean data, compared to a model trained on the original dictionary Consistent transcription of the core vocabulary and labeled pronunciation variants further allow for generation of consistent transcriptions of compounds and derivations Future work, Resources Extend the database: compounds, dialect variations Implement transcription generation from database Post-processing steps for vowel length Resources on github: https://github.com/cadia-lvl/SLT2018 1 https://www-i6.informatik.rwth-aachen.de/web/Software/g2p.html

Upload: others

Post on 20-Apr-2022

6 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: An Icelandic Pronunciation Dictionary for TTS - WordPress.com

An Icelandic Pronunciation Dictionary for TTSAnna Björk Nikulásdóttir, Jón Guðnason, Eiríkur Rögnvaldsson*Center for Analysis and Design of Intelligent Agents, Language and Voice Lab (https://lvl.ru.is/), Reykjavik University*University of Iceland

Overview

df1. Phoneset consistency• Corrections with regard to a closed set of 58 transcription

symbols• IPA transcripts used• 440 entries corrected, 159 entries removed (abbreviations,

compounds)

df2. Postaspiration• A large inconsistency issue• Partly a distinctive feature: /pahka/vs./pʰahka/(bakka vspakka)• Automatic correction possible word initially• 5,330 entries corrected

df4. Variation• Sources of variation:

• Dialects• Homography• Person and/or situation dependent

• Common alternative transcriptions processed, one alt. chosen• Other entries with multiple transcriptions removed

df5. Compound analysis• Decompounding and comparison of components across the

dictionary• Choose clear, standard pronunciation• Over 200 errors identified, corresponding entries removed• Over 13,400 compounds removed

df6. Vowel length• Partly a distinctive feature: /ama/ vs. /aːma/ (amma vs ama)• Follows well defined rules for simple words• More vague for derivations and compounds• No changes made to the current (partly inconsistent) length

labeling

df7. G2P Alignment• Automatically generated g2p-map• Forced alignment performed using entries from the map as

anchors• Scarce mappings inspected for errors, 481 erroneous entries

removed

A d a m

/aː t a m/

df3. Diphthong consistency• Seven different diphthong symbols: /ai, au, ou, ei, œy, ʏi, ɔi/• Both regular grapheme(s)-to-diphthong correspondences and

various context/dialect dependent combinations• Entries not matching grapheme-diphthong rules deleted: ~4,500

entries

aːmaG2P Transcription Experiments – Set up• Two g2p models trained using the Sequitur1 toolkit, based on:

• Cleaned IPD, ~40,000 entries (minus entries occurring in test/dev sets)• Raw IPD, ~65,000 entries (minus entries occurring in test/dev sets)

• Training parameters:• L=1 (max number of phonemes and graphemes in a graphone)• M=5 (number of adjacent graphones to consider)• Held-out set: 5%

• Development set, manually corrected: 700 entries• Test set, manually corrected: 300 entries

aːmaG2P Transcription Experiments – Results WER/PER

Training set Test set WER PER

Raw IPD Dev 38% 5.65%

Clean IPD Dev 25.33% 2.82%

Raw IPD Test 37.29% 6.1%

Clean IPD Test 24.43% 3.4%

aːmaG2P Transcription Experiments – Results Categories

Error category Raw IPD Clean IPDVowel length 42 29.2% 53 61%Postaspiration 46 32% 19 21.8%Dialect 6 4% 0 0%Style/variation 7 4.9% 2 2.3%Consonant voiceness 5 3.5% 4 4.6%Other errors 38 26.4% 9 10.3%SUM 144 100.0% 87 100.0%

aːmaDatabase example – Generate transcriptions by dialect

• A manually transcribed pronunciation dictionary for Icelandic (IPD) was examined through pattern analysis and alignment procedures

• The aim was to create a more consistent version of the dictionary to improve grapheme-to-phoneme models needed in a TTS system under development

• During cleaning the size of the dictionary was reduced from ~65,000 entries to ~40,000 entries

• Significant improvement in PER for automatic transcriptions based on a g2p model trained on the clean data, compared to a model trained on the original dictionary

• Consistent transcription of the core vocabulary and labeled pronunciation variants further allow for generation of consistent transcriptions of compounds and derivations

Future work, Resources• Extend the database: compounds, dialect variations• Implement transcription generation from database• Post-processing steps for vowel length

Resources on github:https://github.com/cadia-lvl/SLT2018

1 https://www-i6.informatik.rwth-aachen.de/web/Software/g2p.html