Sensingexperiments
Reading the real world in the browser: sound, hands, faces, Wi-Fi and cars.
A series of experiments in turning raw, real-time data from a device into something readable. They share one idea: a live map of which rooms are quiet and empty right now, built from sound and motion.
Decibel is the finished one, a live sound level meter with peak, floor and average readings, bass, mid and treble bands, and PNG and CSV export. SensePlay was built to test the motion part: real-time hand and face tracking with MediaPipe, running smoothly in the browser. The answer to “how hard is this?” turned out to be: not that hard.
WiFiTrace and DriveTrace take the same spirit further, and AEGIS Radar is a prompt-and-go radar console that I never properly tested. Most of them are still in progress.
- Real-time sound analysis from the microphone
- Browser-based hand and face tracking
- Position from Wi-Fi signal strength with trilateration
- Live data turned into displays you can read at a glance
- Decibel
A live sound level meter: dB, peak, floor, average and frequency bands. Finished.
Open ↗ - SensePlay
Hand-tracking Rock Paper Scissors and a Mood Mirror, with MediaPipe. In progress.
Open ↗ - WiFiTrace
Indoor positioning from Wi-Fi signal strength with trilateration, on a live floor plan. Vanilla JS, PHP and Canvas. In progress.
- DriveTrace
Driving telemetry: connect a phone to the car and get live speed, RPM and location, then the full stats. In progress.
- AEGIS Radar
A browser radar console with a 360° sweep, motion detection and sound monitoring. Live, but untuned.
Open ↗