The Artificial Intelligence of Things framework enhances the accuracy of human activity recognition.
The Artificial Intelligence of Things (AIoT) integrates Artificial Intelligence (AI) with the Internet of Things (IoT), combining the strengths of both technologies. Unlike traditional IoT systems, where devices collect and transmit data to a remote server for processing, AIoT devices process data locally in real-time, allowing them to make intelligent decisions on the spot. This capability has led to widespread adoption in areas such as intelligent manufacturing, smart home security, and healthcare monitoring.
In smart home applications, accurate human activity recognition is essential, enabling AIoT systems to detect activities like cooking or exercising. By analyzing this data, the system can automatically adjust lighting, play music, or optimize energy usage, enhancing both convenience and efficiency. Among the various approaches to motion recognition, WiFi-based detection stands out due to its widespread availability, cost-effectiveness, and ability to preserve user privacy.
Breakthrough in AIoT: The MSF-Net Framework
Recently, in a novel research article, a team of researchers, led by Professor Gwanggil Jeon from the College of Information Technology at Incheon National University, South Korea, has come up with a new AIoT framework called multiple spectrogram fusion network (MSF-Net) for WiFi-based human activity recognition. Their findings were recently published in the IEEE Internet of Things Journal.
Prof. Jeon explains the motivation behind their research. “As a typical AIoT application, WiFi-based human activity recognition is becoming increasingly popular in smart homes. However, WiFi-based recognition often has unstable performance due to environmental interference. Our goal was to overcome this problem.”
MSF-Net: A Deep Learning Framework for Enhanced Activity Recognition
In this view, the researchers developed the robust deep learning framework MSF-Net, which achieves coarse as well as fine activity recognition via channel state information (CSI). MSF-Net has three main components: a dual-stream structure comprising short-time Fourier transform along with discrete wavelet transform, a transformer, and an attention-based fusion branch. While the dual-stream structure pinpoints abnormal information in CSI, the transformer extracts high-level features from the data efficiently. Lastly, the fusion branch boosts cross-model fusion.
The researchers performed experiments to validate the performance of their framework, finding that it achieves remarkable Cohen’s Kappa scores of 91.82%, 69.76%, 85.91%, and 75.66% on SignFi, Widar3.0, UT-HAR, and NTU-HAR datasets, respectively. These values highlight the superior performance of MSF-Net compared to state-of-the-art techniques for WiFi data-based coarse and fine activity recognition.
“The multimodal frequency fusion technique has significantly improved accuracy and efficiency compared to existing technologies, increasing the possibility of practical applications. This research can be used in various fields such as smart homes, rehabilitation medicine, and care for the elderly. For instance, it can prevent falls by analyzing the user’s movements and contribute to improving the quality of life by establishing a non-face-to-face health monitoring system,” concludes Prof. Jeon.
Overall, activity recognition using WiFi, the convergence technology of IoT and AI proposed in this work, is expected to greatly improve people’s lives through everyday convenience and safety!
Reference: “An AIoT Framework With Multimodal Frequency Fusion for WiFi-Based Coarse and Fine Activity Recognition” by Junxin Chen, Xu Xu, Tingting Wang, Gwanggil Jeon and David Camacho, 13 May 2024, IEEE Internet of Things Journal.
DOI: 10.1109/JIOT.2024.3400773
Never miss a breakthrough: Join the SciTechDaily newsletter.
Follow us on Google and Google News.
1 Comment
The shameless hyping of future surveillance housing as something desirable for the common cotizen.
And even if this system would not be abused by the government and nefarious actors: what when it breaks down? How smart will you feel then for having it?