Teach your AI
In this NeurIPS 2022 demo by Qualcomm AI Research, we showcase teaching your AI digital assistant new gesture commands.
The need for intelligent, personalized experiences powered by AI is ever-growing, such as personalized gesture commands with a digital assistant. Although cloud training can provide this personalization, on-device learning enables it without the need to share personal data and sacrifice privacy. However, teaching these personalized gestures on a mobile device is challenging due to power and compute constraints. To address this, our full-stack AI optimizations included developing an accurate and small gesture recognition model, quantizing the model with AIMET, and utilizing the AI hardware acceleration on Snapdragon. By simultaneously combining a voice command with an arbitrary gesture a few times, the digital assistant learns the new gestures through few-shot on-device learning. We achieve real-time processing at low power while maintaining high accuracy of 95 percent gesture detection.
Read the NeurIPS blog post: https://www.qualcomm.com/news/onq/202...
Visit the Qualcomm AI Research website: https://www.qualcomm.com/research/art...