CRII: CNS: RUI: Exploiting Robust Deep Learning Framework for Wireless Localization Systems in Adversarial IoT Environments

List of Personnel

Principle Investigator

• Xuyu Wang, Assistant Professor

Graduate Students

• Tianya Zhao

Alumni

• Chao Yang (co-advised by Dr. Shiwen Mao)

• Xiangyu Wang (co-advised by Dr. Shiwen Mao)

• Ushasree Boora

• Harshit Ambalkar

• Azhar Chara

• Shivenkumar Parmar

Project Description

With the proliferation of wireless networks and mobile devices, wireless Internet of Things (IoT) applications (e.g., location-based services) have gained considerable attention. Indoor localization faces a number of challenges in the radio propagation environment, including the multipath effect, shadowing, fading, and delay distortion. To tackle the non-line-of-sight (NLOS) indoor environment, fingerprinting based wireless localization methods using deep neural networks (DNN) have been proposed. However, a data-driven only approach using DNN may perform poorly in adversarial IoT environments (e.g., wireless jamming). Specifically, DNN models are shown to be vulnerable to adversarial examples generated by introducing a subtle perturbation. Thus, the primary aim of the proposed research is to develop robust solutions for wireless localization in adversarial IoT environments, which fills in the gap between wireless localization accuracy and robustness. Particularly, we consider adversarial machine learning for wireless localization in IoT environments. The successful completion of this project will significantly improve the state-of-the-art of wireless localization and enable robust IoT applications. The project's educational plan includes developing a new graduate-level course on deep learning for wireless IoT systems and enhancing various core undergraduate and graduate-level courses. Also, the project strives to broaden participation from under-represented groups in research and will continue to greatly strengthen such efforts throughout the project years.

The project research agenda is composed of two closely integrated research thrusts. In Thrust I, this project will use adversarial deep learning for indoor localization in a way that leverages adversarial training in the offline stage to improve the robustness of the deep network, thus alleviating the threat of the adversarial example attacks on wireless data. This project will consider two wireless localization tasks: adversarial examples for wireless localization in black-box attacks and unsupervised learning for adversarial examples detection. In Thrust II, this project will combine deep learning and Gaussian processes for uncertain location estimation, to improve robustness for wireless localization algorithms. Specifically, this project will exploit uncertainty location estimation with deep Gaussian process against both white-box and black-box attacks. Also, this project will model and analyze the fundamental limits and robustness of wireless localization. For all the proposed tasks in the two thrusts, this project will develop mathematical models and solution algorithms. The proposed algorithms will be implemented with wireless IoT devices/platforms (e.g., Wi-Fi, RFID, and LoRa), and validated with extensive experiments in representative indoor environments.

Related Journal Publications

1. Azhar Chara, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Respiratory biofeedback using acoustic sensing with smartphones,” Elsevier Smart Health Journal, vol. 28, pp.100387, June 2023.

2. Xiangyu Wang*, Xuyu Wang*, Shiwen Mao, Jian Zhang, Senthilkumar CG Periaswamy, and Justin Patton, “Adversarial deep learning for indoor localization,” IEEE Internet of Things Journal, vol.9, no.19, pp.18182--18194, Oct. 2022. DOI: 10.1109/JIOT.2022.3155562.. (*means co-first authors)

3. Chao Yang, Xuyu Wang, and Shiwen Mao, “RFID tag localization with a sparse tag array,” IEEE Internet of Things Journal, Special Issue on Knowledge and Service Oriented Industrial Internet of Things: Architectures, Challenges and Methodologies, vol.9, no.18, pp.16976-16989, Sept. 2022. DOI: 10.1109/JIOT.2021.3137723.

4. Chao Yang, Shiwen Mao, Xuyu Wang, “An overview of 3GPP positioning standards,” ACM GetMobile, vol.26, no.1, pp.9-13, Mar. 2022.

5. Chao Yang, Xuyu Wang, Shiwen Mao, “Respiration monitoring with RFID in driving environments,” IEEE Journal on Selected Areas in Communications, Special Issue on Internet of Things for In-Home Health Monitoring, vol.39, no.2, pp.500-512, Feb. 2021. (2022 Best Journal Paper Award of IEEE ComSoc eHealth Technical Committee)

6. Xiangyu Wang, Xuyu Wang, Shiwen Mao, Jian Zhang, Senthilkumar CG Periaswamy, and Justin Patton, “Indoor radio map construction and localization with deep Gaussian Processes,” IEEE Internet of Things Journal, vol.7, no.11, pp. 11238-11249, Nov. 2020.

7. Xiangyu Wang, Xuyu Wang, and Shiwen Mao, “Indoor fingerprinting with bimodal CSI tensors: A deep residual sharing learning approach,” IEEE Internet of Things Journal, vol.8, no.6, pp.4498-4513, Mar. 2021.

Related Conference Publications

1. Harshit Ambalkar, Tianya Zhao, Xuyu Wang, and Shiwen Mao, “Adversarial attack and defense for WiFi-based apnea detection system,” in Proc. IEEE INFOCOM Posters, Hoboken, NJ, May 2023.

2. Shivenkumar Parmar, Xuyu Wang, Chao Yang, and Shiwen Mao, “Voice fingerprinting for indoor localization with a single microphone array and deep learning,” in Proc. the Fourth ACM Wireless Security and Machine Learning Workshop (WiseML'22), in conjunction with ACM WiSec 2022, San Antonio, TX, May 2022.

3. Ushasree Boora, Xuyu Wang, and Shiwen Mao, “Robust massive MIMO localization using neural ODE in adversarial environments,” in Proc. IEEE ICC 2022, Seoul, South Korea, May 2022.

4. Chao Yang, Lingxiao Wang, Xuyu Wang, and Shiwen Mao, “Demo Abstract: Environment-adaptive 3D human pose tracking with RFID,” in Proc. IEEE INFOCOM 2022, Virtual Conference, May 2022. (The IEEE INFOCOM 2022 Demo Award).

5. Chao Yang, Xuyu Wang, and Shiwen Mao, “Demo Abstract: Technology-agnostic approach to RF based human activity recognition,” in Proc. IEEE INFOCOM 2022, Virtual Conference, May 2022.

6. Harshit Ambalkar, Xuyu Wang, and Shiwen Mao, “Adversarial human activity recognition using Wi-Fi CSI,” invited paper, in Proc. 2021 Annual IEEE Canadian Conference of Electrical and Computer Engineering (CCECE'21), Virtual Conference, Sept. 2021.

7. Xuyu Wang, Mohini Patil, Chao Yang, Shiwen Mao, and Palak Anilkumar Patel, “Deep Convolutional Gaussian Processes for mmWave outdoor localization,” in Proc. IEEE ICASSP 2021, Special Session on Contactless and Wireless Sensing for Smart Environments, Toronto, Canada, June 2021.

8. Jait Purohit, Xuyu Wang, Shiwen Mao, Xiaoyan Sun, and Chao Yang, “Fingerprinting-based indoor and outdoor localization with LoRa and deep learning,” in Proc. IEEE GLOBECOM 2020, Taipei, Taiwan, Dec. 2020.

9. Chao Yang, Xuyu Wang, and Shiwen Mao, “SparseTag: High-precision backscatter indoor localization with sparse RFID tag arrays,” in Proc. IEEE SECON 2019, Boston, MA, June 2019.

10. Xiangyu Wang*, Xuyu Wang*, Shiwen Mao, Jian Zhang, Senthilkumar C.G. Periaswamy, and Justin Patton, “DeepMap: Deep Gaussian Process for indoor radio map construction and location estimation,” in Proc. IEEE GLOBECOM 2018, Abu Dhabi, United Arab Emirates, Dec. 2018. (*means Co-first authors)

Open Wireless Localization, Sensing and Spectrum Dataset

• 2023.06   The public wireless dataset about “Wireless Localization, Sensing, and Spectrum Dataset ” was collected.

Outreach Activities

• 2023.06   Tianya and I attended IEEE/ACM CHASE 2023 at Orlando. I served as a session chair for "Sensing for Smart Health", and Tianya presented our acoustic-based health monitoring paper.

• 2023.05   I am invited to serve as a judge and a mentor at “TechTogether's Miami Chapter" that will host a city's first in-person hackathon from May 5th-6th, 2023.

• 2023.05   I am invited to attend NSF Broadening Participation in Computing (BPC) workshop at Temple University from June 8 to June 12 and give a talk titled “Introduction to Learning-based RF Fingerprinting” and provide a hands-on wireless spectrum project for REU students.

• 2023.04   Daniel McDuff at Google Research, Wenjin Wang at Southern University of Science and Technology, Jun Luo at Nanyang Technological University, and I will co-organize a tutorial at CVPR 2023 from June 18-19 about “Contactless Healthcare using Cameras and Wireless Sensors”.

• 2022.11   I am invited to serve as a co-chair of IEEE INFOCOM 2023 Workshop on Deep Learning for Wireless Communications, Sensing, and Security (DeepWireless), New York Area, May 2023. Please consider submitting your papers.

• 2022.10   I am invited to serve as a judge of Poster/Demo Session for Undergraduates (REU) program in Networking and Systems 2022 in Denver.

• 2022.10   I am invited to serve as a Session Chair of IEEE MASS 2022 in Denver. Also, I will present our IEEE MASS paper about WiFi CSI-based water-injected pork detection.

• 2022.08   I am invited to serve as a Guest Editor of ACM Transactions on Sensor Networks, Special Issue on Contact-free Smart Sensing in AIoT. Please consider submitting your papers.

Award Information

This project is supported by the National Science Foundation (NSF) under Grant CNS-2321763/2105416 from 07/01/2021 to 06/30/2024. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the foundation. [NSF link with CNS-2321763] [NSF link with CNS-2105416]