Perception

Introduction to the Perception Module

The ISS perception module provides support to multiple perception tasks, such as 3D obstacle perception, 2D object recognition, 2D semantic segmentation, and sensor-based Bird’s Eye View (BEV) map generation. Our team is focused on developing and refining these critical perception tasks. These tasks serve as the foundation for enabling our vehicles to navigate complex environments with safety and precision.

Tasks

The different tasks supported by the ISS perception module allow our vehicles to learn specific properties of the surrounding environment and its elements.

  • 3D Obstacle Detection: Our system employs advanced sensor technologies to detect and analyze three-dimensional obstacles in real-time. This capability allows our autonomous vehicles to make informed decisions and ensure safe navigation, even in dynamic and challenging scenarios.

  • 2D Object Detection: Recognizing and identifying objects in the vehicle’s surroundings is crucial for safe navigation. Our framework utilizes cutting-edge algorithms to identify and classify various objects, such as pedestrians, vehicles, and signage, contributing to enhanced situational awareness.

3D Obstacle Perception and 2D Object Detection

  • 2D Semantic Segmentation: Semantic segmentation is an essential task for understanding the environment in detail. We leverage state-of-the-art techniques to partition the scene into meaningful segments, enabling our vehicles to comprehend the road layout and better respond to complex urban landscapes. ISS Architecture

  • Sensor-Based BEV Map Generation: Our system generates a Bird’s Eye View (BEV) map using sensor data, providing a holistic view of the vehicle’s surroundings. This map serves as a valuable tool for path planning and decision-making, enhancing the vehicle’s ability to navigate efficiently and safely.

At present, we are diligently working on these modules, and we are pleased to share that we have developed initial models for the first three tasks. However, it’s important to note that these models are still undergoing refinement to enhance their performance and reliability.

We also provide a dataset about the object detection generated by ISS. Still updating.