“Listen to temperatures” with TinyML

• Tweet
• Pin It

Can we “listen” a difference between pouring hot and cold water?

As you see in the video you can do it, but why? It is mentioned that the change is due to complex fluid dynamics reasons. Beyond the scientific investigation, the question we asked ourselves was: is this ability to “listen to temperatures” something that can be replicated using Artificial Neural Networks? We then tried to create an experiment using TinyML (Machine Learning applied to embedded devices).

We used very different water temperatures, with a range of 50 ° C between them. (11 ° C and 61 ° C); for each sample the listening time was the time taken by the glass to be filled (from 3 to 5 seconds). We are interested in capturing the sound of water only during the pouring process. The sound was recorded from the same digital microphone (sampling frequency: 16KHz) and stored as a .wav file in 3 different folders: cold water sound (“Cool”); sound of hot water (“Hot”); no sound of water (“Noise”).

The acquired dataset (via Arduino Nano 33 BLE Sense) was uploaded to Edge Impulse Studio, where it was preprocessed, the neural network (NN) model was trained, tested and deployed on an MCU for a real physical test (an iPhone was also used for live classification).

More info

Related Posts

• 

  Control a Nintendo Gamecube with a PS3 controller
  Control a Nintendo Gamecube with a PS3 controller
• 

  Never lose your phone again
  Never lose your phone again
• 

  How to emulate an Xbox controller with Arduino
  How to emulate an Xbox controller with Arduino
• 

  A “Wordclock” with magnets
  A “Wordclock” with magnets