SynthSoM: A synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM).

Journal: Scientific data
Published Date: May 20, 2025

Abstract

Given the importance of datasets for sensing-communication integration research, a novel simulation platform for constructing communication and multi-modal sensory dataset is developed. The developed platform integrates three high-precision software, i.e., AirSim, WaveFarer, and Wireless InSite, and further achieves in-depth integration and precise alignment of them. Based on the developed platform, a new synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM), named SynthSoM, is proposed. The SynthSoM dataset contains various air-ground multi-link cooperative scenarios with comprehensive conditions, including multiple weather conditions, times of the day, intelligent agent densities, frequency bands, and antenna types. The SynthSoM dataset encompasses multiple data modalities, including radio-frequency (RF) channel large-scale and small-scale fading data, RF millimeter wave (mmWave) radar sensory data, and non-RF sensory data, e.g., RGB images, depth maps, and light detection and ranging (LiDAR) point clouds. The quality of SynthSoM dataset is validated via statistics-based qualitative inspection and evaluation metrics through machine learning (ML) via real-world measurements. The SynthSoM dataset is open-sourced and provides consistent data for cross-comparing SoM-related algorithms.

Authors

  • Xiang Cheng
    Computer Department, Jingdezhen Ceramic Institute, Jingdezhen, China.
  • Ziwei Huang
    Hertie Institute for AI in Brain Health, University of Tübingen, Tübingen, Germany.
  • Yong Yu
    Department of Automation, Xi'an Institute of High-Technology, Xi'an 710025, China, and Institute No. 25, Second Academy of China, Aerospace Science and Industry Corporation, Beijing 100854, China yuyongep@163.com.
  • Lu Bai
    College of Chemical Engineering, Department of Pharmaceutical Engineering, Northwest University, Taibai North Road 229, Xi'an 710069, Shaanxi, China.
  • Mingran Sun
    State Key Laboratory of Photonics and Communications, School of Electronics, Peking University, Beijing, 100871, China.
  • Zengrui Han
    State Key Laboratory of Photonics and Communications, School of Electronics, Peking University, Beijing, 100871, China.
  • Ruide Zhang
    State Key Laboratory of Photonics and Communications, School of Electronics, Peking University, Beijing, 100871, China.
  • Sijiang Li
    State Key Laboratory of Photonics and Communications, School of Electronics, Peking University, Beijing, 100871, China.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals