Collaborative Research: CNS Core: Medium: Data Augmentation and Adaptive Learning for Next Generation Wireless Spectrum Systems

List of Personnel

Principle Investigator

  • Xuyu Wang, Assistant Professor

Graduate Students

  • Tianya Zhao

  • Ningning Wang

Undergraduate Students

  • Jason Jiang in Summer 2024

  • Yanelli Gloria in Spring 2024

  • Ben Abraham from Kean University in Summer 2023.

Alumni

  • Steven Mackey at CSUS

  • Amirush Ramdas Javare at CSUS

  • Mansi Patel at CSUS

  • Chao Yang at Auburn University (co-advised by Dr. Shiwen Mao)

Project Description

Deep learning has shown great promise in solving many open challenges in wireless networking research and applications. Deep learning is data hungry, and one of the critical obstacles towards fulfilling its promise is facilitating the acquisition of sufficient amounts of data to train and validate deep learning models. The primary goal of this project is to devise innovative approaches that enable wireless researchers and practitioners to acquire data more efficiently at reduced cost and to utilize existing data more effectively. Findings from this project are expected to fuel future breakthroughs in wireless research by making deep learning models more widely applicable. By integrating research and education, the proposed work will provide excellent hands-on exercises, research, and educational opportunities for undergraduate and graduate students at the three collaborating universities. The project will leverage the existing diversity-related outreach programs at the three institutions to broaden participation from under-represented groups.

A team of four investigators with complementary expertise from Auburn University, Temple University, and Florida International University will carry out a coherent research agenda consisting of the following four thrusts: (1) Spectrum data synthesis and augmentation aided by generative adversarial networks; (2) Exploiting historical and synthetic wireless networking data through novel transfer learning algorithms; (3) Characterizing the relationship between dataset size and performance; (4) Integrate, validate and apply approaches developed in the first three thrusts on spectrum database construction, RF spectrum anomaly detection, and transmitter classification. Thrusts 1-3 are application-agnostic and focused on studying fundamental concepts and techniques that facilitate the acquisition of sufficient amounts of wireless data, enable more effective utilization of existing data, and enable the prediction of how much data is needed to meet desired performance. Thrust 4 is application-specific and focused on specific wireless applications where deep learning has been applied and demonstrated great potential. The data, software and education materials developed from this project will be widely disseminated. The project will engage industry stakeholders on project-related issues, with the aim to disseminate ideas and learn relevant challenges faced by the industry when applying deep learning to wireless applications.

Related Journal and Book Chapter Publications

  1. Tianya Zhao, Xuyu Wang, Shiwen Mao, Slobodan Vucetic, and Jie Wu, “Adversarial deep learning for indoor localization,” Chapter X in Network Security Empowered by Artificial Intelligence.

  2. Jing Hou, Xuyu Wang, and Amy Z Zeng, “Inter-Temporal Reward Strategies in the Presence of Strategic Ethical Hackers,” in IEEE/ACM Transactions on Networking, 2024.

  3. Azhar Chara, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Respiratory biofeedback using acoustic sensing with smartphones,” Elsevier Smart Health Journal, vol. 28, pp.100387, June 2023.

  4. Chao Yang, Xuyu Wang, and Shiwen Mao, “TARF: Technology-agnostic RF sensing for human activity recognition,” IEEE Journal of Biomedical and Health Informatics, Special Issue on Cognitive Cyber-Physical Systems with AI based Solutions in Medical Informatics, vol.27, no.2, pp.636--647, Feb. 2023.

  5. Chao Yang, Xuyu Wang, and Shiwen Mao, “RFID based 3D human pose tracking: A subject generalization approach,” Elsevier/KeAi Digital Communications and Networks, Special Issue on Edge computation and intelligence, vol.8, no.3, pp.278-288, Aug. 2022.

  6. Chao Yang, Lingxiao Wang, Xuyu Wang, and Shiwen Mao, “Environment adaptive RFID based 3D human pose tracking with a meta-learning approach,” IEEE Journal of Radio Frequency Identification, Special Issue on Wireless Motion Capture and Fine-Scale Localization, vol.6, no.1, pp.413-425, Jan. 2022.

  7. Chao Yang, Xuyu Wang, Shiwen Mao, “Respiration monitoring with RFID in driving environments,” IEEE Journal on Selected Areas in Communications, Special Issue on Internet of Things for In-Home Health Monitoring, vol.39, no.2, pp.500-512, Feb. 2021. (2022 Best Journal Paper Award of IEEE ComSoc eHealth Technical Committee)

  8. Chao Yang, Xuyu Wang, and Shiwen Mao, “Unsupervised drowsy driving detection with RFID,” IEEE Transactions on Vehicular Technology, vol.69, no.8, pp. 8151-8163, Aug. 2020.

  9. Chao Yang, Xuyu Wang, and Shiwen Mao, “Unsupervised detection of apnea using commodity RFID tags with a recurrent variational autoencoder,” IEEE Access Journal, Special Section on Advanced Information Sensing and Learning Technologies for Data-centric Smart Health Applications, vol.7, no.1, pp.67526-67538, June 2019.

  10. Xiangyu Wang, Xuyu Wang, Shiwen Mao, Jian Zhang, Senthilkumar CG Periaswamy, and Justin Patton, “Indoor radio map construction and localization with deep Gaussian Processes,” IEEE Internet of Things Journal, vol.7, no.11, pp. 11238-11249, Nov. 2020.

Related Conference Publications

  1. Ningning Wang, Tianya Zhao, Shiwen Mao, and Xuyu Wang, "AI Generated Wireless Data for Enhanced Satellite Device Fingerprinting” in Proc. IEEE ICC 2024 workshop, Denver, CO, June 2024.

  2. Tianya Zhao, Xuyu Wang, Junqing Zhang, and Shiwen Mao, “Explanation-Guided Backdoor Attacks on Model-Agnostic RF Fingerprinting,” in Proc. IEEE INFOCOM 2024, Vancouver, Canada, May 2024.

  3. Tianya Zhao, Xuyu Wang, and Shiwen Mao, "Cross-domain, Scalable, and Interpretable RF Device Fingerprinting,” in Proc. IEEE INFOCOM 2024, Vancouver, Canada, May 2024.

  4. Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Backdoor attacks against deep learning-based massive MIMO localization,” in Proc. IEEE GLOBECOM 2023, Kuala Lumpur, Malaysia, Dec. 2023.

  5. Nawrin Tabassum, Ka-Ho Chow, Xuyu Wang, Wenbin Zhang, and Yanzhao Wu, "On the Efficiency of Privacy Attacks in Federated Learning," in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2024) Workshops - FedVision.

  6. Hongpeng Jin, Wenqi Wei, Xuyu Wang, Wenbin Zhang, Yanzhao Wu, “Rethinking Learning Rate Tuning in the Era of Large Language Models,” will appear in IEEE CogMI 2023 Vision Track.

  7. Jing Hou, Xuyu Wang, and Amy Z. Zeng, “Inter-Temporal Reward Decisions with Strategic Ethical Hackers,” in Proc. IEEE CNS 2023, Orlando, FL, Oct. 2023.

  8. Zichong Wang, Nripsuta Saxena, Tongjia Yu, Sneha Karki, Tyler Zetty, Israat Haque, Shan Zhou, Dukka Kc, Ian Stockwell, Xuyu Wang, Albert Bifet and Wenbin Zhang, “Preventing Discriminatory Decision-making in Evolving Data Stream,” in Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT), Chicago, USA, 2023. (ACM FAcct 2023 Best Paper Award).

  9. Harshit Ambalkar, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Adversarial attack and defense for WiFi-based apnea detection system,” in Proc. IEEE INFOCOM Posters, Hoboken, NJ, May 2023.

  10. Steven Mackey, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Poster Abstract: Cross-Domain Adaptation for RF Fingerprinting Using Prototypical Networks,” in Proc. ACM SenSys 2022, Boston, MA, Nov. 2022.

  11. Shivenkumar Parmar, Xuyu Wang, Chao Yang, and Shiwen Mao, “Voice fingerprinting for indoor localization with a single microphone array and deep learning,” in Proc. the Fourth ACM Wireless Security and Machine Learning Workshop (WiseML'22), in conjunction with ACM WiSec 2022, San Antonio, TX, May 2022.

  12. Ushasree Boora, Xuyu Wang, and Shiwen Mao, “Robust massive MIMO localization using neural ODE in adversarial environments,” in Proc. IEEE ICC 2022, Seoul, South Korea, May 2022.

  13. Erbo Shen, Weidong Yang, Xuyu Wang, Shiwen Mao, and Wei Bin, “TagSense: Robust wheat moisture and temperature sensing using a passive RFID tag,” in Proc. IEEE ICC 2022, Seoul, South Korea, May 2022. (The IEEE ICC 2022 Best Paper Award).

  14. Chao Yang, Lingxiao Wang, Xuyu Wang, and Shiwen Mao, “Demo Abstract: Environment-adaptive 3D human pose tracking with RFID,” in Proc. IEEE INFOCOM 2022, Virtual Conference, May 2022. (The IEEE INFOCOM 2022 Demo Award).

  15. Chao Yang, Xuyu Wang, and Shiwen Mao, “Demo Abstract: Technology-agnostic approach to RF based human activity recognition,” in Proc. IEEE INFOCOM 2022, Virtual Conference, May 2022.

  16. Mansi Patel, Xuyu Wang, and Shiwen Mao, “Data augmentation with Conditional GAN for automatic modulation classification,” in Proc. 2020 ACM Workshop on Wireless Security and Machine Learning (WiseML 2020), in conjunction with the 13th ACM Conference on Security and Privacy in Wireless and Mobile Networks (ACM WiSec 2020), Linz, Austria, July 2020, pp.31-36.

  17. Xuyu Wang, and Shiwen Mao, “Meta-Pose: Environment-adaptive human skeleton tracking with RFID,” in Proc. IEEE GLOBECOM 2021, Madrid, Spain, Dec. 2021.

  18. Chao Yang, Xuyu Wang, and Shiwen Mao, “Subject-adaptive skeleton tracking with RFID,” in Proc. The 16th IEEE International Conference on Mobility, Sensing and Networking (MSN 2020), Tokyo, Japan, Dec. 2020, pp.599-606.

  19. Chao Yang, Xuyu Wang, and Shiwen Mao, “RFID-based driving fatigue detection,” in Proc. IEEE GLOBECOM 2019, Waikoloa, HI, Dec. 2019. (The IEEE GLOBECOM 2019 Best Paper Award)

  20. Chao Yang, Xuyu Wang, and Shiwen Mao, “AutoTag: Recurrent variational autoencoder for unsupervised apnea detection with RFID tags,” in Proc. IEEE GLOBECOM 2018, Abu Dhabi, United Arab Emirates, Dec. 2018, pp.1-7.

  21. Xiangyu Wang*, Xuyu Wang*, Shiwen Mao, Jian Zhang, Senthilkumar C.G. Periaswamy, and Justin Patton, “DeepMap: Deep Gaussian Process for indoor radio map construction and location estimation,” in Proc. IEEE GLOBECOM 2018, Abu Dhabi, United Arab Emirates, Dec. 2018. (*means Co-first authors)

Open Wireless Spectrum Dataset

Outreach Activities

  • 2024.07   I am hosting an NSF Broadening Participation in Computing (BPC) workshop at FIU from July 1 to July 8. The workshop will involve 13 K-12 teachers and 8 REU students, featuring 7 talks and one wireless spectrum project.

  • 2024.06   I am invited to serve as a TPC co-chair of IEEE GLOBECOM 2024 Workshop on Machine Learning and Deep Learning for Wireless Security, Cape Town, South Africa in Dec. 2024. Please consider submitting your papers.

  • 2024.06   I am invited to serve as a TPC co-chair of IEEE GLOBECOM 2024 Workshop on Machine Learning and Deep Learning for Wireless Security, Cape Town, South Africa in Dec. 2024. Please consider submitting your papers.

  • 2024.06  I co-orgnized a tutorial at CVPR 2024 on June 18 about "Contactless AI Healthcare using Cameras and Wireless Sensors" and gave a talk about "Wireless-based Vital Sign Monitoring and Activity Monitoring".

  • 2024.06  I served as a co-chair for the IEEE ICC 2024 Workshop on Machine Learning and Deep Learning for Wireless Security in Denver, Colorado, USA on June 9, 2024.

  • 2024.06  Jason Jiang (an undergraduate student from FIU) has an in-person REU internship at FIU AIoT Lab in Summer 2024. He is conducting research on WiFi CSI and BFI sensing, supported by NSF REU Site program.

  • 2024.04   I am invited to serve as a symposium co-chair of AI and Machine Learning for Communications and Networking (AMCN) in ICNC 2025. Please consider submitting your papers.

  • 2024.02   I am invited to serve as a Tutorials Co-Chair of IEEE CCNC 2024. Please consider submitting your papers and tutorial proposals.

  • 2024.02   Yanelli Gloria (an undergraduate student from UCSC) has a remote internship at FIU AIoT Lab in Spring 2024. She is conducting research on the application of Large Language Models (LLM) in IoT sensing, supported by the CASHI Spring 2024 program.

  • 2023.12   I am invited to serve as a Workshop Chair of IEEE Healthcom 2024. Please consider submitting your papers.

  • 2023.12   I am invited to serve as a judge for Fall 2023 KFSCIS Capstone Showcase on Dec.1, 2023.

  • 2023.10   I am selected in the 2023 Stanford's list of World Top 2% scientists.

  • 2023.10   I am invited to serve as a co-chair of IEEE INFOCOM 2024 Workshop on Deep Learning for Wireless Communications, Sensing, and Security (DeepWireless), Vancouver, Canada in May 2024. Please consider submitting your papers.

  • 2023.09   I am invited to serve as a session chair for "Cyber-Physical Systems" in IEEE CNS 2023 at Orlando. I will present our ethical hackers paper.

  • 2023.09   I am invited to serve as a TPC co-chair of IEEE ICC 2024 Workshop on Machine Learning and Deep Learning for Wireless Security, Denver, Colorado USA in June 2024.

  • 2023.06   Tianya and I attended IEEE/ACM CHASE 2023 at Orlando. I served as a session chair for "Sensing for Smart Health", and Tianya presented our acoustic-based health monitoring paper.

  • 2023.05   I am invited to serve as a judge and a mentor at TechTogether's Miami Chapter that will host a city's first in-person hackathon from May 5th-6th, 2023.

  • 2023.05   I am invited to attend NSF Broadening Participation in Computing (BPC) workshop at Temple University from June 8 to June 12 and give a talk titled “Introduction to Learning-based RF Fingerprinting” and provide a hands-on wireless spectrum project for REU students.

  • 2023.04   Daniel McDuff at Google Research, Wenjin Wang at Southern University of Science and Technology, Jun Luo at Nanyang Technological University, and I will co-organize a tutorial at CVPR 2023 from June 18-19 about “Contactless Healthcare using Cameras and Wireless Sensors”.

  • 2022.11   I am invited to serve as a co-chair of IEEE INFOCOM 2023 Workshop on Deep Learning for Wireless Communications, Sensing, and Security (DeepWireless), New York Area, May 2023. Please consider submitting your papers.

  • 2022.10   I am invited to serve as a judge of Poster/Demo Session for Undergraduates (REU) program in Networking and Systems 2022 in Denver.

  • 2022.10   I am invited to serve as a Session Chair of IEEE MASS 2022 in Denver. Also, I will present our IEEE MASS paper about WiFi CSI-based water-injected pork detection.

  • 2022.08   I am invited to serve as a Guest Editor of ACM Transactions on Sensor Networks, Special Issue on Contact-free Smart Sensing in AIoT. Please consider submitting your papers.

Award Information

This project is supported by the National Science Foundation (NSF) under Grant CNS-2107164 from 10/01/2021 to 09/30/2024. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the foundation. [NSF link with CNS-2317190] [NSF link with CNS-2107164 ]