Vision-based Sign Language Recognition System
碩士 === 國立清華大學 === 電機工程學系 === 97 === We present a vision-based sign language recognition system which works efficiently to recognize the Taiwan Sign Language. Sign language can be divided into a sequence of sign-words, and sign-word consists of three different phonemes, hand posture, location of the...
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Others |
Language: | en_US |
Published: |
2009
|
Online Access: | http://ndltd.ncl.edu.tw/handle/83617515055971863239 |
id |
ndltd-TW-097NTHU5442080 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-TW-097NTHU54420802015-11-13T04:08:49Z http://ndltd.ncl.edu.tw/handle/83617515055971863239 Vision-based Sign Language Recognition System 基於視覺的手語辨識系統 Tsai, Bo-Lin 蔡博鄰 碩士 國立清華大學 電機工程學系 97 We present a vision-based sign language recognition system which works efficiently to recognize the Taiwan Sign Language. Sign language can be divided into a sequence of sign-words, and sign-word consists of three different phonemes, hand posture, location of the hand, and the hand movement. The number of phonemes is limited for the sign language, however, an unlimited number of words can be built from the phonemes. We use the phonemes as the basic units to represent a sign-wrod, and this strategy has the advantage for a further increase of the vocabulary size. We segment the sign-wrod to a sequence of hold and movement segments. The hold segment is analyzed and represented in terms of the phonemes of the hand posture and location. The movement segment is also analyzed and converted to the phoneme of the hand movement. A hand gesture is composed of a sequence of the phonemes. To recognize a dynamic hand gesture, we select the most probable HMM model which represents the specific gesture. In the experiments, we choose twenty Taiwan Sign Language (TSL) sentences for our system to recognize, and collect the sign-language videos made by different signers. The experimental results demonstrate that our system achieves a good performance of sign-word recognition accuracy of 94% and sentence recognition accuracy of 83.3%. Huang, Chung-Lin 黃仲陵 2009 學位論文 ; thesis 69 en_US |
collection |
NDLTD |
language |
en_US |
format |
Others
|
sources |
NDLTD |
description |
碩士 === 國立清華大學 === 電機工程學系 === 97 === We present a vision-based sign language recognition system which works efficiently to recognize the Taiwan Sign Language. Sign language can be divided into a sequence of sign-words, and sign-word consists of three different phonemes, hand posture, location of the hand, and the hand movement. The number of phonemes is limited for the sign language, however, an unlimited number of words can be built from the phonemes. We use the phonemes as the basic units to represent a sign-wrod, and this strategy has the advantage for a further increase of the vocabulary size. We segment the sign-wrod to a sequence of hold and movement segments. The hold segment is analyzed and represented in terms of the phonemes of the hand posture and location. The movement segment is also analyzed and converted to the phoneme of the hand movement. A hand gesture is composed of a sequence of the phonemes. To recognize a dynamic hand gesture, we select the most probable HMM model which represents the specific gesture. In the experiments, we choose twenty Taiwan Sign Language (TSL) sentences for our system to recognize, and collect the sign-language videos made by different signers. The experimental results demonstrate that our system achieves a good performance of sign-word recognition accuracy of 94% and sentence recognition accuracy of 83.3%.
|
author2 |
Huang, Chung-Lin |
author_facet |
Huang, Chung-Lin Tsai, Bo-Lin 蔡博鄰 |
author |
Tsai, Bo-Lin 蔡博鄰 |
spellingShingle |
Tsai, Bo-Lin 蔡博鄰 Vision-based Sign Language Recognition System |
author_sort |
Tsai, Bo-Lin |
title |
Vision-based Sign Language Recognition System |
title_short |
Vision-based Sign Language Recognition System |
title_full |
Vision-based Sign Language Recognition System |
title_fullStr |
Vision-based Sign Language Recognition System |
title_full_unstemmed |
Vision-based Sign Language Recognition System |
title_sort |
vision-based sign language recognition system |
publishDate |
2009 |
url |
http://ndltd.ncl.edu.tw/handle/83617515055971863239 |
work_keys_str_mv |
AT tsaibolin visionbasedsignlanguagerecognitionsystem AT càibólín visionbasedsignlanguagerecognitionsystem AT tsaibolin jīyúshìjuédeshǒuyǔbiànshíxìtǒng AT càibólín jīyúshìjuédeshǒuyǔbiànshíxìtǒng |
_version_ |
1718128425264218112 |