A smartwatch that sees your whole body, without cameras: EchoMotion
An ordinary smartwatch that reconstructs the movements of your whole body. Without cameras.
A smartwatch that works like a sonar
At Cornell University, in the SciFi Lab, they presented EchoMotion. The idea is simple and brilliant: the watch speaker emits ultrasound, the microphone picks up the echoes bouncing off arms and legs, and a very small AI model reconstructs the position of 12 joints, from head to ankles.
The numbers
- It works on an unmodified Galaxy Watch 6, and the same model also runs on Galaxy Watch 7 and Pixel Watch 3 without retraining.
- Average error of about 6 cm per joint, after a 12-minute calibration.
- 5-6% of battery in half an hour, about 40 times less than a wearable camera.
Small is beautiful
While everyone talks only about giant models, here a tiny model running on a watch opens up a concrete application: a personal trainer on your wrist that counts reps and corrects your posture. With no cameras pointed at you, which is no small thing for privacy.
Would you use it? Tell me under the video.
Original video: Cornell University (SciFi Lab). Article and paper: news.cornell.edu