Multi-Functional Robotic Arm with Image and Speech Interaction

碩士 === 國立臺灣海洋大學 === 電機工程學系 === 106 === The main purpose of this thesis is to design an intelligent robotic projector, which is based on a multi-joint robot arm equipped with a TV stick and a micro-projector. The system can be used interact with users via projected images touch control or speech reco...

Full description

Bibliographic Details
Main Authors: Li, Jyun-Ming, 李峻銘
Other Authors: Cheng, Chih-Yung
Format: Others
Language:zh-TW
Published: 2018
Online Access:http://ndltd.ncl.edu.tw/handle/q33jsx
Description
Summary:碩士 === 國立臺灣海洋大學 === 電機工程學系 === 106 === The main purpose of this thesis is to design an intelligent robotic projector, which is based on a multi-joint robot arm equipped with a TV stick and a micro-projector. The system can be used interact with users via projected images touch control or speech recognition. Due to the robot arm structure, the system can track the target, or adjust projection direction autonomously. Using the embedded camera as vision feedback, user can treat the projected image as a touch screen. The system can also accept oral commands to perform the arm movement or multimedia playback to make this interaction more diversified. The key control kernel is a TV stick and the designed Python control code inside. After the multimedia signals processed, the resulting commands are sent via Bluetooth to an Arduino Pro Mini control board in order to control the motors of the robotic arm. Furthermore, the interactive letters and mini pianos examples in the thesis use a laser line to light up the fingertip to make the localization easier.