Human Sensing Using Visible Light Communication
- 7 September 2015
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
We present LiSense, the first-of-its-kind system that enables both data communication and fine-grained, real-time human skeleton reconstruction using Visible Light Communication (VLC). LiSense uses shadows created by the human body from blocked light and reconstructs 3D human skeleton postures in real time. We overcome two key challenges to realize shadow-based human sensing. First, multiple lights on the ceiling lead to diminished and complex shadow patterns on the floor. We design light beacons enabled by VLC to separate light rays from different light sources and recover the shadow pattern cast by each individual light. Second, we design an efficient inference algorithm to reconstruct user postures using 2D shadow information with a limited resolution collected by photodiodes embedded in the floor. We build a 3 m x 3 m LiSense testbed using off-the-shelf LEDs and photodiodes. Experiments show that LiSense reconstructs the 3D user skeleton at 60 Hz in real time with 10 degrees mean angular error for five body joints.Keywords
Funding Information
- National Science Foundation (CNS-1421528)
This publication has 60 references indexed in Scilit:
- A survey of advances in vision-based human motion capture and analysisComputer Vision and Image Understanding, 2006
- A model-based image-matching technique for three-dimensional reconstruction of human motion from uncalibrated video sequencesJournal of Biomechanics, 2005
- Fundamental analysis for visible-light communication system using LED lightsIEEE Transactions on Consumer Electronics, 2004
- Channel model for wireless communication around human bodyElectronics Letters, 2004
- Human body modelling for prediction of effect of people on indoor propagation channelElectronics Letters, 2004
- Integrated system of white LED visible-light communication and power-line communicationIEEE Transactions on Consumer Electronics, 2003
- Analysis of micro-Doppler signaturesIEE Proceedings - Radar, Sonar and Navigation, 2003
- The effects of the human body on UWB signal propagation in an indoor environmentIEEE Journal on Selected Areas in Communications, 2002
- Relative 3D Reconstruction Using Multiple Uncalibrated ImagesThe International Journal of Robotics Research, 1995
- ‘Split radix’ FFT algorithmElectronics Letters, 1984