This week I have mostly been working on my second capstone project. This is for my second major, as I need to have some aspect of ECE in my second project so I can have it count for both majors. In my second project, I am designing a convolutional neural network to locate the users hand and follow it. The camera taking the photos of the user will be mounted on a servo which are both hooked to a raspberry pi. This way the raspberry pi can communicate with the camera, asses the network and then move the servo with the camera attached to follow the users movement. So fat, as of this post, I have finished most of these tasks. However, a lot of the current setup has errors in it. The current CNN has a high misidentification rate if the background has changes, and will sometimes target the users head instead. The servo will also jump back and forth of the the object when it has reached center frame.
I have also managed to get the LSTM NN working properly. It will recognize a gesture only when it has followed the proper movement, and not when it is a still image. However, this also has identification. General movements taht follow the same arc as the gesture will also be identified as it.
Categories