Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak

The inflection of the Slovak language causes a large number of unique word forms, which produces not only a large vocabulary, but also a number of out-of-vocabulary words. Morph-based language models solve this problem by decomposition of inflected word forms into small sub-word units and resolve th...

Full description

Bibliographic Details
Main Authors: Jan Stas, Daniel Hladek, Jozef Juhar, Daniel Zlacky
Format: Article
Language:English
Published: VSB-Technical University of Ostrava 2012-01-01
Series:Advances in Electrical and Electronic Engineering
Subjects:
Online Access:http://advances.utc.sk/index.php/AEEE/article/view/717
id doaj-c5b5500704fa48d6830c6040cc1a466b
record_format Article
spelling doaj-c5b5500704fa48d6830c6040cc1a466b2021-10-11T08:03:02ZengVSB-Technical University of OstravaAdvances in Electrical and Electronic Engineering1336-13761804-31192012-01-0110429129610.15598/aeee.v10i4.717557Analysis of Morph-Based Language Modeling and Speech Recognition in SlovakJan Stas0Daniel Hladek1Jozef Juhar2Daniel Zlacky3Department of Electronics and Multimedia Communications Faculty of Electrical Engineering and Informatics Technical University of Kosice KosiceDepartment of Electronics and Multimedia Communications Faculty of Electrical Engineering and Informatics Technical University of Kosice KosiceDepartment of Electronics and Multimedia Communications Faculty of Electrical Engineering and Informatics Technical University of Kosice KosiceDepartment of Electronics and Multimedia Communications Faculty of Electrical Engineering and Informatics Technical University of Kosice KosiceThe inflection of the Slovak language causes a large number of unique word forms, which produces not only a large vocabulary, but also a number of out-of-vocabulary words. Morph-based language models solve this problem by decomposition of inflected word forms into small sub-word units and resolve the general problem of sparsity the training data. In this paper, we present several rule-based and data-driven approaches to the automatic segmentation of words into morphs. These data are later used in the modeling of the Slovak language for large vocabulary continuous speech recognition. Preliminary results show a significant decrease in the number of out-of-vocabulary words and reduction of resultant language model perplexity.http://advances.utc.sk/index.php/AEEE/article/view/717automatic word segmentationlanguage modelingmorphological analysisspeech recognition.
collection DOAJ
language English
format Article
sources DOAJ
author Jan Stas
Daniel Hladek
Jozef Juhar
Daniel Zlacky
spellingShingle Jan Stas
Daniel Hladek
Jozef Juhar
Daniel Zlacky
Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak
Advances in Electrical and Electronic Engineering
automatic word segmentation
language modeling
morphological analysis
speech recognition.
author_facet Jan Stas
Daniel Hladek
Jozef Juhar
Daniel Zlacky
author_sort Jan Stas
title Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak
title_short Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak
title_full Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak
title_fullStr Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak
title_full_unstemmed Analysis of Morph-Based Language Modeling and Speech Recognition in Slovak
title_sort analysis of morph-based language modeling and speech recognition in slovak
publisher VSB-Technical University of Ostrava
series Advances in Electrical and Electronic Engineering
issn 1336-1376
1804-3119
publishDate 2012-01-01
description The inflection of the Slovak language causes a large number of unique word forms, which produces not only a large vocabulary, but also a number of out-of-vocabulary words. Morph-based language models solve this problem by decomposition of inflected word forms into small sub-word units and resolve the general problem of sparsity the training data. In this paper, we present several rule-based and data-driven approaches to the automatic segmentation of words into morphs. These data are later used in the modeling of the Slovak language for large vocabulary continuous speech recognition. Preliminary results show a significant decrease in the number of out-of-vocabulary words and reduction of resultant language model perplexity.
topic automatic word segmentation
language modeling
morphological analysis
speech recognition.
url http://advances.utc.sk/index.php/AEEE/article/view/717
work_keys_str_mv AT janstas analysisofmorphbasedlanguagemodelingandspeechrecognitioninslovak
AT danielhladek analysisofmorphbasedlanguagemodelingandspeechrecognitioninslovak
AT jozefjuhar analysisofmorphbasedlanguagemodelingandspeechrecognitioninslovak
AT danielzlacky analysisofmorphbasedlanguagemodelingandspeechrecognitioninslovak
_version_ 1716828131896066048