Tutorial Materials
1. Introduction to 4D Radar: HW, MIMO, and Signal Processing
(Presented by Junfeng Guan)
2. Introduction to 4D Radar: Dataset and AI
(Presented by Dong-Hee Paek)
If you found the materials helpful, please cite:
Paek, D.-H. and Guan, J., "Introduction to 4D Radar: Hardware, MIMO, Signal Processing, Dataset, and AI," Tutorial at the 35th IEEE Intelligent Vehicles Symposium (IV 2024), Jeju Island, South Korea, June 2, 2024. URL: https://www.ieee-iv-4dradar.org/
Autonomous driving is a ten-billion-dollar market worldwide but automotive Radars only contribute to a tiny share because they are only used for unidirectional ranging in auxiliary tasks. The emerging mmWave 4D imaging Radars (i.e.., 4D Radars) provide unprecedented capabilities of high-resolution imaging, which can capture rich perceptual and contextual information about the environment to enable full-fledged perception.
Moreover, with the reliability in inclement weather introduced by Radar sensors, autonomous driving has finally begun overcoming this bottleneck and take another firm step toward the vision of full autonomy. We believe the integration of 4D Radars would speed up the practical use and commercialization of self-driving cars and significantly expand the market size. Nonetheless, most commercial self-driving cars today only operate in certain regions and cities with consistently good weather, e.g., Arizona, USA, because of the unreliability of the vision-based perception system in adverse weather. By introducing 4D Radars as a new sensor modality and providing robustness in all weather conditions, self-driving technologies can be more accessible to broader areas and communities.
This tutorial aims to provide a comprehensive overview and in-depth insights into the advanced technology of 4D Radar. This sensor, notable for offering 3D spatial information along with velocity measurement, has garnered significant attention in both academic and industrial circles due to its robustness in adverse weather conditions. The tutorial is structured in two parts to facilitate understanding of the entire 4D Radar system for researchers both familiar and unfamiliar with this field.
In the first part, the importance of 4D Radar, its hardware system, and the signal processing pipeline are introduced by Junfeng Guan. The second part, presented by Dong-Hee Paek, delves into the recent datasets, AI technologies, and future directions in 4D Radar.
The overall contents of this tutorial are as follows (please note that some sections could be abbreviated or changed due to time considerations):
-
Part 1. 4D Radar System (Presenter: Junfeng Guan)
-
Introduction to 4D Radar
-
Importance of 4D Radar in Intelligent Vehicles
-
-
4D Radar System
-
FMCW Radar Waveform
-
FMCW Radar Hardware System
-
-
Signal Processing Pipeline of 4D Radar
-
Range Processing through FFT (Fast Fourier Transform)
-
Velocity Estimation & Doppler FFT
-
AoA (Angle of Arrival) Estimation and Beamforming
-
Angle FFT
-
2D Azimuth and Elevation Beamforming
-
CFAR (Constant False Alarm Rate) Detection
-
-
Radar Equations for 4D Radar
-
Range Resolution
-
Velocity/Doppler Resolution and Ambiguity
-
Angle Resolution and Ambiguity
-
-
MIMO (Multiple-Input Multiple-Output) Radar
-
Virtual Antenna Array
-
4D MIMO Radar Example: TI Cascaded MIMO Radar
-
Doppler Phase Entanglement due to Time-Division Multiplexing (TDM)
-
Doppler Phase Entanglement Compensation
-
-
-
Part 2. Recent AI in 4D Radar (Presenter: Dong-Hee Paek)
-
Introduction to 4D Radar AI
-
Overview of 4D Radar AI
-
Challenges in 4D Radar AI: Datasets and Neural Networks
-
-
4D Radar Datasets
-
Characteristics of 4D Radar compared to Camera and LiDAR
-
Dealing with Un-intuitiveness
-
Various Tasks
-
-
4D Radar AI
-
4D Radar AI with Various Input
-
Reflecting characteristics of 4D Radar
-
Sensor Fusion Networks in 4D Radar
-
-
Future Directions in 4D Radar AI
-
Dataset: Radar Signal Synthesis
-
AI Realization: Shared Memory in AI Embedding
-
-
Duration: half day (3 hours: 1 and a half hours for each presenter)