“Listen to temperatures” with TinyML

• Tweet
• Pin It

Can we “listen” a difference between pouring hot and cold water?

As you see in the video you can do it, but why? It is mentioned that the change is due to complex fluid dynamics reasons. Beyond the scientific investigation, the question we asked ourselves was: is this ability to “listen to temperatures” something that can be replicated using Artificial Neural Networks? We then tried to create an experiment using TinyML (Machine Learning applied to embedded devices).

We used very different water temperatures, with a range of 50 ° C between them. (11 ° C and 61 ° C); for each sample the listening time was the time taken by the glass to be filled (from 3 to 5 seconds). We are interested in capturing the sound of water only during the pouring process. The sound was recorded from the same digital microphone (sampling frequency: 16KHz) and stored as a .wav file in 3 different folders: cold water sound (“Cool”); sound of hot water (“Hot”); no sound of water (“Noise”).

The acquired dataset (via Arduino Nano 33 BLE Sense) was uploaded to Edge Impulse Studio, where it was preprocessed, the neural network (NN) model was trained, tested and deployed on an MCU for a real physical test (an iPhone was also used for live classification).

More info

Related Posts

• 

  Segstick: Build Your Own Self-Balancing Vehicle in Just 2 Days with Arduino
  Segstick: Build Your Own Self-Balancing Vehicle in Just 2 Days with Arduino
• 

  What is IoT and which devices to use
  What is IoT and which devices to use
• 

  Creating a Unique Electronic Musical Instrument: The Sound Wall
  Creating a Unique Electronic Musical Instrument: The Sound Wall
• 

  Grand Piano Keys with Arduino
  Grand Piano Keys with Arduino