Article,

IMPLEMENTATION OF TINY MACHINE LEARNING MODELS ON ARDUINO 33 – BLE FOR GESTURE AND SPEECH RECOGNITION

, , , , , and .
Journal of Xi'an University of Architecture & Technology, 14 (7): 160-169 (July 2022)
DOI: https://doi.org/10.37896/JXAT14.07/315417

Abstract

In this articlegesture recognition and speech recognitionapplications are implemented on embedded systems with Tiny Machine Learning (TinyML).The main benefit of using TinyML is its portability. It can be run on cheap microcontrollers with tiny batteries and low power consumption, and itcan easily integratemachine learning withvirtually anything. It also has the benefit of increased security due to local nature of computing.The benefit of using Arduino Nano 33 BLE sense is that it has a set of sensors embedded on the top, which gives us a lot of options to try ideas without having to generate the circuit to such sensors in prototyping board. It features 3-axis accelerometer, 3-axis gyroscope and 3-axis magnetometer. The gesture recognition,provides an innovative approach nonverbal communication. It has wide applications in human-computer interaction and sign language. Here in the implementationof handgesture recognition,TinyMLmodel istrained and deployedfromEdgeImpulseframeworkfor hand gesture recognitionand based on the hand movements,ArduinoNano 33 BLE device having 6-axis IMUcan find out the direction of movement of hand. The Speech is a mode of communication. Speech recognition is a way by which the statements or commands of human speech is understood by the computer which reacts accordingly. The main aim of speech recognition is to achieve communication between man and machine. Here in the implementationofspeech recognition,TinyMLmodel istrained and deployedfromEdgeImpulseframeworkfor speechrecognitionand based on thekeyword pronounced by human,ArduinoNano 33 BLE device having built-in microphonecan make an RGB LED glowlike red, green or blue based on keyword pronounced. The results of each applicationare obtained and listed in the results section and given the analysis upon the results.

Tags

Users

  • @viswas123

Comments and Reviewsshow / hide

  • @viswas123
    2 years ago (last updated 2 years ago)
    Very informative
Please log in to take part in the discussion (add own reviews or comments).