Autonomous Mobility and Manipulation of a 9-DoF WMRA

• Main Author: Pence, William Garrett
• Format: Others
• Published: Scholar Commons 2011
• Subjects: ADL; Mobile Manipulation; Rehabilitation; Robotics; Visual Servoing; American Studies; Arts and Humanities; Computer Engineering; Mechanical Engineering
• Online Access: http://scholarcommons.usf.edu/etd/3288; http://scholarcommons.usf.edu/cgi/viewcontent.cgi?article=4483&context=etd

The wheelchair-mounted robotic arm (WMRA) is a 9-degree of freedom (DoF) assistive system that consists of a 2-DoF modified commercial power wheelchair and a custom 7-DoF robotic arm. Kinematics and control methodology for the 9-DoF system that combine mobility and manipulation have been previously developed and implemented. This combined control allows the wheelchair and robotic arm to follow a single trajectory based on weighted optimizations. However, for the execution of activities of daily living (ADL) in the real-world environment, modified control techniques have been implemented. In order to execute macro ADL tasks, such as a "go to and pick up" task, this work has implemented several control algorithms on the WMRA system. Visual servoing based on template matching and feature extraction allows the mobile platform to approach the desired goal object. Feature extraction based on scale-invariant feature transform (SIFT) gives the system object detection capabilities to recommend actions to the user and to orient the arm to grasp the goal object using visual servoing. Finally, a collision avoidance system is implemented to detect and avoid obstacles when the wheelchair platform is moving towards the goal object. These implementations allow the WMRA system to operate autonomously from the beginning of the task where the user selects the goal object, all the way to the end of the task where the task has been fully completed.