A Musical Score Recognition System for iOS Devices

• Main Authors: Bo-Ren Wang, 王柏仁
• Other Authors: Ching-Yung Chen
• Format: Others
• Language: zh-TW
• Published: 2014
• Online Access: http://ndltd.ncl.edu.tw/handle/90226123120753198954

碩士 === 國立高雄第一科技大學 === 電腦與通訊工程研究所 === 102 === Mobile devices, like smart phones, more have become popular in our life over the years. Many applications are running on mobile devices based on multi media processing (e.g., those applications used to process photos or simulate instruments such as piano, violin, guitar, etc.). Moreover, various sensors embedded in devices can be used to make an intuitive interface such as gesture recognition, human gesture recognition, voice control, voice input and so on. This paper proposes a musical score recognition system which can be realized on iOS Devices. The research involves 2D image processing and associated algorithm design. The proposed system recognizes the information in a musical score such as notes, pitch of note, transforms the information to the MIDI format and plays the music through a simulated piano. In order to implement the proposed system on mobile devices, a lower-complexity procedure for note, stem and beam recognition is adapted that involves simply the horizontal and vertical projection of original images. The proposed musical score recognition system can be applied musical learning or musical education in the future. For example, one can design a game in which people can learn the musical knowledge or one can play the recognized musical score with different electric instruments.