Projects synthetic data

Boundless

A photorealistic synthetic data pipeline built on Unreal Engine 5 that replaces manual data collection and annotation for object detection in dense urban streetscapes.

Role
Lead author and system creator
Paper
arXiv preprint, 2024
Engine
Unreal Engine 5, built on the City Sample
Boundless street scenes in fog, snow, rain, and at night, with 3D bounding boxes on vehicles and pedestrians
Boundless scenes under fog, snow, rain, and night conditions, with automatically exported 3D bounding boxes.

Boundless is a photorealistic synthetic data pipeline for training object detectors in dense urban streetscapes. It extends the Unreal Engine 5 City Sample into a configurable research system that exports accurately projected 3D annotations across lighting, weather, camera, and scene variations, replacing large-scale real-world data collection and manual labeling with an automated process.

The system connects interactive world building in Unreal Engine with reproducible data pipeline design for applied computer vision. Detectors trained on Boundless data were evaluated on real-world footage from medium-altitude intersection cameras. In this cross-domain setting, a detector trained on Boundless improved mean average precision by 7.8 points over one trained on CARLA data, supporting synthetic data generation as a credible way to train and fine-tune scalable detectors for urban scenes.

The public release includes datasets for two viewpoints, infrastructure cameras mounted above intersections and aerial drones, along with the benchmark code used for evaluation.

Project details

Artifacts
Synthetic datasets for infrastructure and aerial viewpoints, benchmark code, and a reproducible generation methodology
Keywords
  • Unreal Engine 5
  • Synthetic data
  • Object detection
  • Domain transfer
  • Procedural environments
  • 3D annotation
  • Urban perception

References

2024

  1. Boundless: Generating Photorealistic Synthetic Data for Object Detection in Urban Streetscapes
    Boundless: Generating Photorealistic Synthetic Data for Object Detection in Urban Streetscapes
    Mehmet Kerem Turkcan, Yuyang Li, Chengbo Zang, Javad Ghaderi, Gil Zussman, and Zoran Kostic
    2024

This work began while I was a postdoc in the Department of Electrical Engineering (AIDL Lab) at Columbia University.