Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi
- 12 June 2019
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
Wi-Fi based sensing systems, although sound as being deployed almost everywhere there is Wi-Fi, are still practically difficult to be used without explicit adaptation efforts to new data domains. Various pioneering approaches have been proposed to resolve this contradiction by either translating features between domains or generating domain-independent features at a higher learning level. Still, extra training efforts are necessary in either data collection or model re-training when new data domains appear, limiting their practical usability. To advance cross-domain sensing and achieve fully zero-effort sensing, a domain-independent feature at the lower signal level acts as a key enabler. In this paper, we propose Widar3.0, a Wi-Fi based zero-effort cross-domain gesture recognition system. The key insight of Widar3.0 is to derive and estimate velocity profiles of gestures at the lower signal level, which represent unique kinetic characteristics of gestures and are irrespective of domains. On this basis, we develop a one-fits-all model that requires only one-time training but can adapt to different data domains. We implement this design and conduct comprehensive experiments. The evaluation results show that without re-training and across various domain factors (i.e. environments, locations and orientations of persons), Widar3.0 achieves 92.7% in-domain recognition accuracy and 82.6%-92.4% cross-domain recognition accuracy, outperforming the state-of-the-art solutions. To the best of our knowledge, Widar3.0 is the first zero-effort cross-domain gesture recognition work via Wi-Fi, a fundamental step towards ubiquitous sensing.Keywords
Funding Information
- National key research plan (No. 2016YFC0700100)
- National Science Foundation (CNS-1837146)
- National Natural Science Foundation of China (61832010, 61632008, 61672319, 61872081)
This publication has 42 references indexed in Scilit:
- WiGest: A ubiquitous WiFi-based gesture recognition systemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Feasibility and limits of wi-fi imagingPublished by Association for Computing Machinery (ACM) ,2014
- E-eyesPublished by Association for Computing Machinery (ACM) ,2014
- A tutorial on human activity recognition using body-worn inertial sensorsACM Computing Surveys, 2014
- From RSSI to CSIACM Computing Surveys, 2013
- See through walls with WiFi!Published by Association for Computing Machinery (ACM) ,2013
- Multiple Target Tracking with RF Sensor NetworksIEEE Transactions on Mobile Computing, 2013
- Whole-home gesture recognition using wireless signalsPublished by Association for Computing Machinery (ACM) ,2013
- BodyScopePublished by Association for Computing Machinery (ACM) ,2012
- Tool releaseACM SIGCOMM Computer Communication Review, 2011