CRII: CNS: RUI: Exploiting Robust Deep Learning Framework for Wireless Localization Systems in Adversarial IoT Environments

List of Personnel

Principle Investigator

  • Xuyu Wang, Assistant Professor

Graduate Students

  • Tianya Zhao

  • Ningning Wang

Undergraduate Students

  • Jason Jiang in Summer 2024

  • Yanelli Gloria in Spring 2024

Alumni

  • Chao Yang (co-advised by Dr. Shiwen Mao)

  • Xiangyu Wang (co-advised by Dr. Shiwen Mao)

  • Ushasree Boora

  • Harshit Ambalkar

  • Azhar Chara

  • Shivenkumar Parmar

Project Description

With the proliferation of wireless networks and mobile devices, wireless Internet of Things (IoT) applications (e.g., location-based services) have gained considerable attention. Indoor localization faces a number of challenges in the radio propagation environment, including the multipath effect, shadowing, fading, and delay distortion. To tackle the non-line-of-sight (NLOS) indoor environment, fingerprinting based wireless localization methods using deep neural networks (DNN) have been proposed. However, a data-driven only approach using DNN may perform poorly in adversarial IoT environments (e.g., wireless jamming). Specifically, DNN models are shown to be vulnerable to adversarial examples generated by introducing a subtle perturbation. Thus, the primary aim of the proposed research is to develop robust solutions for wireless localization in adversarial IoT environments, which fills in the gap between wireless localization accuracy and robustness. Particularly, we consider adversarial machine learning for wireless localization in IoT environments. The successful completion of this project will significantly improve the state-of-the-art of wireless localization and enable robust IoT applications. The project's educational plan includes developing a new graduate-level course on deep learning for wireless IoT systems and enhancing various core undergraduate and graduate-level courses. Also, the project strives to broaden participation from under-represented groups in research and will continue to greatly strengthen such efforts throughout the project years.

The project research agenda is composed of two closely integrated research thrusts. In Thrust I, this project will use adversarial deep learning for indoor localization in a way that leverages adversarial training in the offline stage to improve the robustness of the deep network, thus alleviating the threat of the adversarial example attacks on wireless data. This project will consider two wireless localization tasks: adversarial examples for wireless localization in black-box attacks and unsupervised learning for adversarial examples detection. In Thrust II, this project will combine deep learning and Gaussian processes for uncertain location estimation, to improve robustness for wireless localization algorithms. Specifically, this project will exploit uncertainty location estimation with deep Gaussian process against both white-box and black-box attacks. Also, this project will model and analyze the fundamental limits and robustness of wireless localization. For all the proposed tasks in the two thrusts, this project will develop mathematical models and solution algorithms. The proposed algorithms will be implemented with wireless IoT devices/platforms (e.g., Wi-Fi, RFID, and LoRa), and validated with extensive experiments in representative indoor environments.

Related Journal and Book Chapter Publications

  1. Tianya Zhao, Xuyu Wang, Shiwen Mao, Slobodan Vucetic, and Jie Wu, “Adversarial deep learning for indoor localization,” Chapter X in Network Security Empowered by Artificial Intelligence.

  2. Azhar Chara, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Respiratory biofeedback using acoustic sensing with smartphones,” Elsevier Smart Health Journal, vol. 28, pp.100387, June 2023.

  3. Xiangyu Wang*, Xuyu Wang*, Shiwen Mao, Jian Zhang, Senthilkumar CG Periaswamy, and Justin Patton, “Adversarial deep learning for indoor localization,” IEEE Internet of Things Journal, vol.9, no.19, pp.18182--18194, Oct. 2022. DOI: 10.1109/JIOT.2022.3155562.. (*means co-first authors)

  4. Chao Yang, Xuyu Wang, and Shiwen Mao, “RFID tag localization with a sparse tag array,” IEEE Internet of Things Journal, Special Issue on Knowledge and Service Oriented Industrial Internet of Things: Architectures, Challenges and Methodologies, vol.9, no.18, pp.16976-16989, Sept. 2022. DOI: 10.1109/JIOT.2021.3137723.

  5. Chao Yang, Shiwen Mao, Xuyu Wang, “An overview of 3GPP positioning standards,” ACM GetMobile, vol.26, no.1, pp.9-13, Mar. 2022.

  6. Chao Yang, Xuyu Wang, Shiwen Mao, “Respiration monitoring with RFID in driving environments,” IEEE Journal on Selected Areas in Communications, Special Issue on Internet of Things for In-Home Health Monitoring, vol.39, no.2, pp.500-512, Feb. 2021. (2022 Best Journal Paper Award of IEEE ComSoc eHealth Technical Committee)

  7. Xiangyu Wang, Xuyu Wang, Shiwen Mao, Jian Zhang, Senthilkumar CG Periaswamy, and Justin Patton, “Indoor radio map construction and localization with deep Gaussian Processes,” IEEE Internet of Things Journal, vol.7, no.11, pp. 11238-11249, Nov. 2020.

  8. Xiangyu Wang, Xuyu Wang, and Shiwen Mao, “Indoor fingerprinting with bimodal CSI tensors: A deep residual sharing learning approach,” IEEE Internet of Things Journal, vol.8, no.6, pp.4498-4513, Mar. 2021.

Related Conference Publications

  1. Tianya Zhao, Ningning Wang, Guanqun Cao, Shiwen Mao, and Xuyu Wang, “Functional Data Analysis Assisted Cross-Domain Wi-Fi Sensing Using Few-Shot Learning,,” in Proc. IEEE ICC 2024, Denver, CO, June 2024.

  2. Tianya Zhao, Ningning Wang, Yanzhao Wu, Wenbin Zhang, and Xuyu Wang, “Backdoor Attacks Against Low-Earth Orbit Satellite Fingerprinting,” in Proc. IEEE INFOCOM 2024 workshop, Vancouver, Canada, May 2024.

  3. Tianya Zhao, Xuyu Wang, Junqing Zhang, and Shiwen Mao, “Explanation-Guided Backdoor Attacks on Model-Agnostic RF Fingerprinting,” in Proc. IEEE INFOCOM 2024, Vancouver, Canada, May 2024.

  4. Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Backdoor attacks against deep learning-based massive MIMO localization,” in Proc. IEEE GLOBECOM 2023, Kuala Lumpur, Malaysia, Dec. 2023.

  5. Jing Hou, Xuyu Wang, and Amy Z Zeng, “Inter-Temporal Reward Decisions with Strategic Ethical Hackers,” in Proc. IEEE CNS 2023, Orlando, FL, Oct. 2023.

  6. Hongpeng Jin, Wenqi Wei, Xuyu Wang, Wenbin Zhang, Yanzhao Wu, “Rethinking Learning Rate Tuning in the Era of Large Language Models,” will appear in IEEE CogMI 2023 Vision Track.

  7. Zichong Wang, Nripsuta Saxena, Tongjia Yu, Sneha Karki, Tyler Zetty, Israat Haque, Shan Zhou, Dukka Kc, Ian Stockwell, Xuyu Wang, Albert Bifet and Wenbin Zhang, “Preventing Discriminatory Decision-making in Evolving Data Stream,” in Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT), Chicago, USA, 2023. (ACM FAcct 2023 Best Paper Award).

  8. Harshit Ambalkar, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Adversarial attack and defense for WiFi-based apnea detection system,” in Proc. IEEE INFOCOM Posters, Hoboken, NJ, May 2023.

  9. Shivenkumar Parmar, Xuyu Wang, Chao Yang, and Shiwen Mao, “Voice fingerprinting for indoor localization with a single microphone array and deep learning,” in Proc. the Fourth ACM Wireless Security and Machine Learning Workshop (WiseML'22), in conjunction with ACM WiSec 2022, San Antonio, TX, May 2022.

  10. Ushasree Boora, Xuyu Wang, and Shiwen Mao, “Robust massive MIMO localization using neural ODE in adversarial environments,” in Proc. IEEE ICC 2022, Seoul, South Korea, May 2022.

  11. Chao Yang, Lingxiao Wang, Xuyu Wang, and Shiwen Mao, “Demo Abstract: Environment-adaptive 3D human pose tracking with RFID,” in Proc. IEEE INFOCOM 2022, Virtual Conference, May 2022. (The IEEE INFOCOM 2022 Demo Award).

  12. Chao Yang, Xuyu Wang, and Shiwen Mao, “Demo Abstract: Technology-agnostic approach to RF based human activity recognition,” in Proc. IEEE INFOCOM 2022, Virtual Conference, May 2022.

  13. Harshit Ambalkar, Xuyu Wang, and Shiwen Mao, “Adversarial human activity recognition using Wi-Fi CSI,” invited paper, in Proc. 2021 Annual IEEE Canadian Conference of Electrical and Computer Engineering (CCECE'21), Virtual Conference, Sept. 2021.

  14. Xuyu Wang, Mohini Patil, Chao Yang, Shiwen Mao, and Palak Anilkumar Patel, “Deep Convolutional Gaussian Processes for mmWave outdoor localization,” in Proc. IEEE ICASSP 2021, Special Session on Contactless and Wireless Sensing for Smart Environments, Toronto, Canada, June 2021.

  15. Jait Purohit, Xuyu Wang, Shiwen Mao, Xiaoyan Sun, and Chao Yang, “Fingerprinting-based indoor and outdoor localization with LoRa and deep learning,” in Proc. IEEE GLOBECOM 2020, Taipei, Taiwan, Dec. 2020.

  16. Chao Yang, Xuyu Wang, and Shiwen Mao, “SparseTag: High-precision backscatter indoor localization with sparse RFID tag arrays,” in Proc. IEEE SECON 2019, Boston, MA, June 2019.

  17. Xiangyu Wang*, Xuyu Wang*, Shiwen Mao, Jian Zhang, Senthilkumar C.G. Periaswamy, and Justin Patton, “DeepMap: Deep Gaussian Process for indoor radio map construction and location estimation,” in Proc. IEEE GLOBECOM 2018, Abu Dhabi, United Arab Emirates, Dec. 2018. (*means Co-first authors)

Open Wireless Localization, Sensing and Spectrum Dataset

Outreach Activities

  • 2024.06   I am invited to serve as a TPC co-chair of IEEE GLOBECOM 2024 Workshop on Machine Learning and Deep Learning for Wireless Security, Cape Town, South Africa in Dec. 2024. Please consider submitting your papers.

  • 2024.06  I co-orgnized a tutorial at CVPR 2024 on June 18 about "Contactless AI Healthcare using Cameras and Wireless Sensors" and gave a talk about "Wireless-based Vital Sign Monitoring and Activity Monitoring".

  • 2024.06  I served as a co-chair for the IEEE ICC 2024 Workshop on Machine Learning and Deep Learning for Wireless Security in Denver, Colorado, USA on June 9, 2024.

  • 2024.06  Jason Jiang (an undergraduate student from FIU) has an in-person REU internship at FIU AIoT Lab in Summer 2024. He is conducting research on WiFi CSI and BFI sensing, supported by NSF REU Site program.

  • 2024.04   I am invited to serve as a symposium co-chair of AI and Machine Learning for Communications and Networking (AMCN) in ICNC 2025. Please consider submitting your papers.

  • 2024.02   I am invited to serve as a Tutorials Co-Chair of IEEE CCNC 2024. Please consider submitting your papers and tutorial proposals.

  • 2024.02   Yanelli Gloria (an undergraduate student from UCSC) has a remote internship at FIU AIoT Lab in Spring 2024. She is conducting research on the application of Large Language Models (LLM) in IoT sensing, supported by the CASHI Spring 2024 program.

  • 2023.12   I am invited to serve as a Workshop Chair of IEEE Healthcom 2024. Please consider submitting your papers.

  • 2023.12   I am invited to serve as a judge for Fall 2023 KFSCIS Capstone Showcase on Dec.1, 2023.

  • 2023.10   I am selected in the 2023 Stanford's list of World Top 2% scientists.

  • 2023.10   I am invited to serve as a co-chair of IEEE INFOCOM 2024 Workshop on Deep Learning for Wireless Communications, Sensing, and Security (DeepWireless), Vancouver, Canada in May 2024. Please consider submitting your papers.

  • 2023.09   I am invited to serve as a session chair for "Cyber-Physical Systems" in IEEE CNS 2023 at Orlando. I will present our ethical hackers paper.

  • 2023.09   I am invited to serve as a TPC co-chair of IEEE ICC 2024 Workshop on Machine Learning and Deep Learning for Wireless Security, Denver, Colorado USA in June 2024. Please consider submitting your papers.

  • 2023.06   Tianya and I attended IEEE/ACM CHASE 2023 at Orlando. I served as a session chair for "Sensing for Smart Health", and Tianya presented our acoustic-based health monitoring paper.

  • 2023.05   I am invited to serve as a judge and a mentor at “TechTogether's Miami Chapter" that will host a city's first in-person hackathon from May 5th-6th, 2023.

  • 2023.05   I am invited to attend NSF Broadening Participation in Computing (BPC) workshop at Temple University from June 8 to June 12 and give a talk titled “Introduction to Learning-based RF Fingerprinting” and provide a hands-on wireless spectrum project for REU students.

  • 2023.04   Daniel McDuff at Google Research, Wenjin Wang at Southern University of Science and Technology, Jun Luo at Nanyang Technological University, and I will co-organize a tutorial at CVPR 2023 from June 18-19 about “Contactless Healthcare using Cameras and Wireless Sensors”.

  • 2022.11   I am invited to serve as a co-chair of IEEE INFOCOM 2023 Workshop on Deep Learning for Wireless Communications, Sensing, and Security (DeepWireless), New York Area, May 2023. Please consider submitting your papers.

  • 2022.10   I am invited to serve as a judge of Poster/Demo Session for Undergraduates (REU) program in Networking and Systems 2022 in Denver.

  • 2022.10   I am invited to serve as a Session Chair of IEEE MASS 2022 in Denver. Also, I will present our IEEE MASS paper about WiFi CSI-based water-injected pork detection.

  • 2022.08   I am invited to serve as a Guest Editor of ACM Transactions on Sensor Networks, Special Issue on Contact-free Smart Sensing in AIoT. Please consider submitting your papers.

Award Information

This project is supported by the National Science Foundation (NSF) under Grant CNS-2321763/2105416 from 07/01/2021 to 06/30/2024. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the foundation. [NSF link with CNS-2321763] [NSF link with CNS-2105416]