Edge Impulse is the leading development platform for machine learning on edge devices, free for developers and trusted by enterprises.
The online Edge Impulse studio makes it very easy to design and train impulses.
An impulse typically takes raw data, uses signal processing to extract features (e.g. extracting a spectogram from audio) and then uses a learning block to classify new data. Currently edge impulse studio supports 3 types of learning blocks:
- Neural Network (Keras) - Learns patterns from data, and can apply these to new data. Great for categorizing movement or recognizing audio.
- Transfer Learning (Images) - Fine tune a pre-trained image model on your data. Good performance even with relatively small image datasets.
- K-means anomaly detection - Find outliers in new data. Good for recognizing unknown states, and to complement neural networks.
These impulses can be deployed to various types of edge devices.
This makes the model run without an internet connection, minimizes latency, and runs with minimal power consumption.
It is even possible to deploy it as a WebAssembly library which is the basis of the edge-impulse-classify.
This node runs an impulse on the input payload and outputs the classification and/or anomaly detection.
The input can be a fixed length audio fragment, an image,... converted to 1 dimensional array (e.g. [140,63,-665,457,-173,-687,...])
Here below an example of the output payload it might produce:
{
"anomaly":0,
"results":[{"label":"other","value":0.999983549118042},
{"label":"ring", "value":0.000016410584066761658}]
}In order to use this node, an impulse created by online Edge Impulse studio must be deployed as a Webassembly library to a folder that is readable by your Node-RED application. So when the studio builds your WebAssembly package it will download it as a zip file containing 2 files:
edge-impulse-standalone.js-
edge-impulse-standalone.wasm.
It is important that you copy these 2 files to a folder that is accessible by your Node-RED application.
You can then "bind" this impulse to your edge-impulse-classify node by just specifying the folder location in the Path configuration property of your edge-impulse-classify node.
Note that there is no need to restart Node-RED after you have deployed a new impulse or modified the Path configuration property. The new impulse will automatically be "bound" when the flow becomes restarted.
Feel free to report any issue to this github repository.