Warning System For Visually Impaired People Towards Moving Objects Through Mobile Camera
Abstract:
According to a report by the World Health Organization, there are about one billion visually impaired people in the world. By using their phones, visually impaired people can utilize navigation applications such as Google Maps and Waze to arrive at their destination. However, those applications do not provide the means to detect moving objects. Therefore, the writer designed an Android application called Blindness Guidance to detect moving objects by using the camera of their smartphone. With the presence of such application, users can be warned in real-time about surrounding objects in front of them to avoid accidents, especially in highly populated areas.
Blindness Guidance starts by loading the assets that are needed, consisting of the model file and the labels of the detected object. These assets are required for TensorFlow Lite to detect and classify objects from images. Next, the camera provides the images required in real time. The captured images are then processed into an array of numbers that are treated as input for TensorFlow Lite. Lastly, the output from TensorFlow Lite which consists of the name and location of the object in the image is then used to calculate the distance from the object to the user.
System testing is divided into two parts, which are distance and accuracy. Distance testing is done by using a tripod and tape measure. The real distance is then compared to the calculated distance. Accuracy testing is done by analyzing a two-minute recording, followed by calculating the precision and recall. According to the testing, the calculated distance has an error margin of below 5% for distances above four meters. For the accuracy testing, the mean average precision is 0.9393, while the mean average recall is 0.4479. The results show that objects below eight meters are successfully detected.
Pembimbing: Dr. David Habsara Hareva, S.Si., MHS
Co-pembimbing: Aditya Rama Mitra, S.Si., M.T.
Connect with us
Instagram: @uphilmukomputer
Youtube: SISTECH UPH
Facebook: / fikuph