Arduino/Python Object Detection-Recognition w/EasyVR3 & Robot Arm
This video demonstrates the Python/Arduino/EasyVR3 and Braccio robotic arm project that conducts real-time video object detection and recognition and then speaks each recognized object by name that it finds using a video camera mounted on a Braccio robotic arm controlled by a GUI interface. There are a total of four sketches/programs/modules and a video camera that are required to run this project. Two Arduino sketches, one running on a Mega controlling the piggybacked EasyVR3 speech shield, the other running on an Uno controlling the Braccio robotic arm movement. Two Python sketches, one running the GUI interface and the other running the real-time video object detection-recognition software and associated video camera, which is mounted to the robot arm gripper. This is a very complex system setup but by using Python and several hardware shields that directly plug into the Arduino, no additional wiring was necessary and complex coding was kept to a minimum. As the robot arm moves the real-time video is captured and processed detecting each object then speaking its description. Selecting buttons in the Python GUI interface window enables the arm (and thus the video camera) to make a wide range of movement which in turn controls the video feed. All communication is done via one direction - from the laptop to the Arduino boards. Two-way communication was not possible due to the slow response factor of the laptop and peripheral devices. The video processing too was slow at approximately 4 second delay due in part to no GPU (graphics processing unit) or VPU (video processing unit) this limited the serial communication to only one-way. All 4 programs are open source and can be downloaded and used. Please see below.
Please subscribe, share and leave comments! Thanks, Scott
*************************************************************
Download files here:
1) Object Recognition.py
http://www.mediafire.com/file/29lv9j2...
2) FINAL_FINAL_FINAL_Arduino-Python_Object_Recognition.ino
http://www.mediafire.com/file/3tld7bk...
3) TKinter Object Detection Robotic Arm Control.py
http://www.mediafire.com/file/asuiexs...
4) TKinter_Object_Detection_Robotic_Arm_Control.ino
http://www.mediafire.com/file/qa3yyza...