Real-Time Adaptive Content-Based Synchronization of Multimedia Streams
Traditional synchronization schemes of multimedia applications are based on temporal relationships between inter- and intrastreams. These schemes do not provide good synchronization in the presence of random delay. As a solution, this paper proposes an adaptive content-based synchronization scheme t...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2011-01-01
|
Series: | Advances in Multimedia |
Online Access: | http://dx.doi.org/10.1155/2011/914062 |
id |
doaj-90cb68ed0faa4ad381dc9c898f014e57 |
---|---|
record_format |
Article |
spelling |
doaj-90cb68ed0faa4ad381dc9c898f014e572020-11-25T03:28:19ZengHindawi LimitedAdvances in Multimedia1687-56801687-56992011-01-01201110.1155/2011/914062914062Real-Time Adaptive Content-Based Synchronization of Multimedia StreamsImad H. Elhajj0Nadine Bou Dargham1Ning Xi2Yunyi Jia3Department of Electrical and Computer Engineering, American University of Beirut, P.O. Box 11-0236, Riad El Solh, Beirut 1107 2020, LebanonDepartment of Electrical and Computer Engineering, American University of Beirut, P.O. Box 11-0236, Riad El Solh, Beirut 1107 2020, LebanonDepartment of Electrical and Computer Engineering, Michigan State University, East lansing, MI 48824-1226, USADepartment of Electrical and Computer Engineering, Michigan State University, East lansing, MI 48824-1226, USATraditional synchronization schemes of multimedia applications are based on temporal relationships between inter- and intrastreams. These schemes do not provide good synchronization in the presence of random delay. As a solution, this paper proposes an adaptive content-based synchronization scheme that synchronizes multimedia streams by accounting for content in addition to time. This approach to synchronization is based on the fact that having two streams sampled close in time does not always imply that these streams are close in content. The proposed scheme primary contribution is the synchronization of audio and video streams based on content. The secondary contribution is adapting the frame rate based on content decisions. Testing adaptive content-based and adaptive time-based synchronization algorithms remotely between the American University of Beirut and Michigan State University showed that the proposed method outperforms the traditional synchronization method. Objective and subjective assessment of the received video and audio quality demonstrated that the content-based scheme provides better synchronization and overall quality of multimedia streams. Although demonstrated using a video conference application, the method can be applied to any multimedia streams including nontraditional ones referred to as supermedia like control signals, haptic, and other sensory measurements. In addition, the method can be applied to synchronize more than two streams simultaneously.http://dx.doi.org/10.1155/2011/914062 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Imad H. Elhajj Nadine Bou Dargham Ning Xi Yunyi Jia |
spellingShingle |
Imad H. Elhajj Nadine Bou Dargham Ning Xi Yunyi Jia Real-Time Adaptive Content-Based Synchronization of Multimedia Streams Advances in Multimedia |
author_facet |
Imad H. Elhajj Nadine Bou Dargham Ning Xi Yunyi Jia |
author_sort |
Imad H. Elhajj |
title |
Real-Time Adaptive Content-Based Synchronization of Multimedia Streams |
title_short |
Real-Time Adaptive Content-Based Synchronization of Multimedia Streams |
title_full |
Real-Time Adaptive Content-Based Synchronization of Multimedia Streams |
title_fullStr |
Real-Time Adaptive Content-Based Synchronization of Multimedia Streams |
title_full_unstemmed |
Real-Time Adaptive Content-Based Synchronization of Multimedia Streams |
title_sort |
real-time adaptive content-based synchronization of multimedia streams |
publisher |
Hindawi Limited |
series |
Advances in Multimedia |
issn |
1687-5680 1687-5699 |
publishDate |
2011-01-01 |
description |
Traditional synchronization schemes of multimedia applications are based on temporal relationships between inter- and intrastreams. These schemes do not provide good synchronization in the presence of random delay. As a solution, this paper proposes an adaptive content-based synchronization scheme that synchronizes multimedia streams by accounting for content in addition to time. This approach to synchronization is based on the fact that having two streams sampled close in time does not always imply that these streams are close in content. The proposed scheme primary contribution is the synchronization of audio and video streams based on content. The secondary contribution is adapting the frame rate based on content decisions. Testing adaptive content-based and adaptive time-based synchronization algorithms remotely between the American University of Beirut and Michigan State University showed that the proposed method outperforms the traditional synchronization method. Objective and subjective assessment of the received video and audio quality demonstrated that the content-based scheme provides better synchronization and overall quality of multimedia streams. Although demonstrated using a video conference application, the method can be applied to any multimedia streams including nontraditional ones referred to as supermedia like control signals, haptic, and other sensory measurements. In addition, the method can be applied to synchronize more than two streams simultaneously. |
url |
http://dx.doi.org/10.1155/2011/914062 |
work_keys_str_mv |
AT imadhelhajj realtimeadaptivecontentbasedsynchronizationofmultimediastreams AT nadineboudargham realtimeadaptivecontentbasedsynchronizationofmultimediastreams AT ningxi realtimeadaptivecontentbasedsynchronizationofmultimediastreams AT yunyijia realtimeadaptivecontentbasedsynchronizationofmultimediastreams |
_version_ |
1724584987350532096 |