Zero-Shot Activity Recognition from a Wrist-Worn IMU

This model recognizes activities of daily living (ADLs) — like brushing teeth, putting on a jacket, or washing dishes — from wrist motion alone (accelerometer, gyroscope, magnetometer). It was trained on 17 activities, but never saw a single training example of the other 7 — it only ever received a text description of what they are. Pick an activity below and run a real recorded wrist-motion segment through it.

Choose an activity to test

On held-out recordings: 78.5% accuracy on activities seen during training, 37.3% on activities never seen at all (zero-shot) — versus 14.3% chance level for 7 unseen activities.

Paper forthcoming.