ARTIFICIAL INTELLIGENCE (AI) ENABLES SENSORIMOTOR INTEGRATION FOR PROSTHETIC HAND DEXTERITY

Hand amputation is a devastating feeling for amputees, and it is lifestyle changing since it is challenging to perform the basic life activities with amputation. Hand amputation means interrupting the closed loop between sensory feedback and motor control. The absence of sensory feedback requires a significant cognitive effort from the amputee to perform basic daily activities with prosthetic hand. Loss of tactile sensations is a major roadblock preventing amputees from multitasking or using the full dexterity of their prosthetic hands. One of the most significant features lacking from commercial prosthetic hands is sensory feedback, according to amputees. Many amputees abandoned their prosthetic devices due to the lack of tactile feedback. In the field of prosthetics, restoring sensory feedback is the most challenging task due to the complexity of integration between the prosthetic and the peripheral nervous system. A prosthetic hand with sensory feedback that imitates the intact hand would improve the lives of millions of amputees worldwide by inducing the prosthetic hand to be a part of the body image and significant impact the control of the prosthetic. To restore the sensory feedback and improve the dexterity for upper limb amputee, multiple components needed to be integrated together to provide the sensory feedback. Tactile sensors are the first components that needed to be integrated into the sensorimotor loop. In this research two tactile sensors were integrated in the sensory feedback loop. The first tactile sensor is BioTac which is a commercially available sensor. The first novel contribution with BioTac is the development of an ANN classifier to detect the direction a grasped object slips in a dexterous robotic hand in real time, and the second novel aspect of this study is the use of slip direction detection for adaptive robotic grasp reflexes. The second tactile sensor is the liquid metal sensor (LMS), this sensor was developed entirely in our lab (BioRobotics lab). The novel contribution for LMS is to detect and prevent slip in real time application, and to recognize different surface features and different sliding speeds.