Deeper Exercise Monitoring for Smart Gym using Fused RFID and CV Data

Individual activity recognition is crucial for Human-Computer Interaction (HCI) applications, especially in multi-person scenarios. Current approaches, based on wearable sensors or wireless signals (e.g., WiFi and RFID), however, are often focused on single person scenario only, due to the limitation of existing wireless sensing technologies. In order to address the issue, we design a DEeper Exercise Monitoring system, called DEEM, in which we introduce computer vision techniques to facilitate RFID devices to provide exercise estimation support, as well as identifying the users and the objects users hold. We implement this design with COTS Kinect camera and RFID devices in a smart gym application. To the best of our knowledge, it is the first system for estimating multiple people behavior in a complicated gym environment. We conduct extensive experiments to evaluate the performance of the DEEM system. The experimental results show that the matching accuracy can reach 95%, and the exercise estimation accuracy can reach 94% on average.