Supplementary data for the paper "Deep Learning Approach for Realistic Traffic Video Changes Across Lighting and Weather Conditions"
DOI: 10.4121/ef03b8d5-a25d-4a83-a371-1c0a11c368d3
Dataset
Recent advances in GAN-based architectures have led to innovative methods for image transformation. The lack of diversity of environmental factors, such as lighting conditions and seasons in public data, prevents researchers from effectively studying the differences in the behaviour of road users under varying conditions. This study introduces a deep learning pipeline that combines CycleGAN-turbo and Real-ESRGAN to improve video transformations of traffic scenes. Evaluated using dashcam videos from Los Angeles, London, and Hong Kong, our pipeline demonstrates a notable improvement in T-SIMM for temporal consistency during night-to-day transformations, achieving a 7.97% increase for Hong Kong, 7.35% for Los Angeles, and 3.41% for London compared to CycleGAN-turbo. PSNR and VPQ scores are comparable, but the pipeline performs better in DINO structure similarity and KL divergence, with up to 153.49% better structural fidelity in Hong Kong compared to Pix2Pix and 107.32% better compared to ToDayGAN. This approach demonstrates better realism and temporal coherence in day-to-night, night-to-day, and clear-to-rainy transitions.
History
- 2025-02-05 first online, published, posted
Publisher
4TU.ResearchDataFormat
.mp4, .txt, .pyOrganizations
TU Eindhoven, Department of Industrial DesignDATA
Files (1)
- 73,811,140 bytesMD5:
daa85bb0f5a9423d1e52acfd24ee0258Supplementary data for the paper 'Deep Learning Approach for Realistic Traffic Video Changes Across Lighting and Weather Conditions'.zip
