Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

How to Build an ML-Powered Doorbell Notifier Using TensorFlow Lite and Arm Cortex-M33

EDGE AI FOUNDATION via YouTube

Overview

Coursera Plus Monthly Sale: All Certificates & Courses 40% Off!
Learn how to create an ML-powered doorbell notification system in this technical talk from the tinyML EMEA conference. Explore the development of an audio classification tinyML system built on an Arm Cortex-M33 based Realtek RTL8721DM SoC. Discover techniques for working with audio datasets and implementing transfer learning to train TensorFlow Lite models using TensorFlow's signal processing and Keras APIs. Master the process of porting feature extraction pipelines to SoC using CMSIS-DSP and running ML interfaces with TensorFlow Lite for Microcontrollers, enhanced by CMSIS-NN accelerated computation kernels. Understand how to optimize Wi-Fi connectivity by triggering it only when the model detects relevant audio sounds. Gain insights into the Realtek RTL8721DM SoC's capabilities, including its compute resources that enable exploration of complex model architectures for various tinyML audio classification applications. Access the complete project code on GitHub to implement and expand upon the demonstrated concepts, from preprocessing and spectrogram generation to MEMS microphone input handling and Arduino integration.

Syllabus

Intro
David Henry's Garden Office
Machine Learning + Microcontroller based solution
Audio Classification - FSD50K subset
Preprocessing
tf.signal - spectrogram
tf.signal - Mel Weight Matrix Human perception of audio frequencies
Model Training Flow
SparkFun AzureWave ThingPlus Realtek RTL8721DM SOC-compute, connectivity, and audio
MEMS Microphone Input
Arduino Libraries
Arduino Sketch pseudo code
Recap

Taught by

EDGE AI FOUNDATION

Reviews

Start your review of How to Build an ML-Powered Doorbell Notifier Using TensorFlow Lite and Arm Cortex-M33

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.