Overview

InfraParis: A multi-modal and multi-task autonomous driving dataset

InfraParis

We present InfraParis, an extensive dataset designed for autonomous driving applications. This dataset is characterized by its multimodal and multitasking nature, encompassing a total of 7,301 data samples. Specifically, it consists of 6,567 images in the training set, 189 in the validation set, and 571 in the test set. InfraParis is structured to support various tasks across three distinct modalities: RGB, depth, and infrared. These tasks encompass object detection, semantic segmentation, and depth prediction.

InfraParis encompasses four distinct tasks, each catering to different aspects of autonomous driving:

  • Semantic Segmentation Task: This task involves images with associated semantic segmentation labels.
  • Object Detection Task: In this task, the dataset provides images with bounding boxes delineating pedestrians.
  • Supervised Depth Prediction Task: For this task, the dataset includes images with ground truth depth information.
  • Unsupervised Depth Prediction Task: Here, the dataset comprises sequences of images along with ground truth depth data.

InfraParis has 4 modalities:

  • RGB Images
  • Infrared Images
  • RGB Video
  • Depth Images

Overview of annotated classes:

There are a total of 155 fine-grained classes, which are also aggregated to facilitate the use along with other datasets, e.g. Citiscapes:

Cityscapes classesInfraParisnb. of images with the annotations
RoadBots, Tram Tracks, Crosswalk, Parking Area, Garbage - Road, Road Lines, Sewer Longitudinal Crack, Transversal Crack, Road, Asphalt Hole, Polished Aggregate, Vegetation - Road, Sewer - Road, Construction Concrete9055
SidewalkLane Bike, Kerb Stone, Sidewalk, Kerb Rising Edge8948
BuildingHouse, Construction Scaffold, Building, Air Conditioning, Construction Container, TV Antenna, Terrace, Water Tank, Pergola Garden, Stairs, Dog House, Sunshades, Railings, Construction Stock, Marquees, Hangar Airport9089
WallWall1101
FenceConstruction Fence, Fences8622
PoleTraffic Signs Poles or Structure, Traffic Lights Poles, Street lights, Lamp8984
Traffic lightTraffic Lights Head, Traffic Cameras, Traffic Lights Bulb (red, yellow, green)8222
Traffic signTraffic Signs2672
VegetationVegetation9072
TerrainTerrain, Tree Pit8377
SkySky8591
PersonWalker, All colors of Construction Helmet, All colors of Safety Vest, Umbrella, People8843
RiderCyclist, Biker3470
CarCar, Beacon Light, Van, Ego Car9026
TruckTruck5533
BusBus0
TrainTrain, Subway2240
MotorcycleMotorcycle, Segway, Scooter Child2615
BicycleBicycle, Kickbike, Tricycle2816
AnimalsCow, Bear, Deer, Moose603
Objects anomaliesStand Food, Trash Can, Garbage bag352
BackgroundOthers-


Examples


Move the mouse over the semantic segmentation label map, and the corresponding RGB image will appear.


Resources



Paper

Github repository




Download

Terms of use


Copyright for InfraParis Dataset is owned by ENSTA Paris (U2IS Laboratory, Palaiseau, FR).

By downloading the dataset, you acknowledge and agree to abide by the terms outlined in the InfraParis release agreement. If you need InfraParis Dataset, please Click and Fill in this Google form.

[Note] We will release all the test sets (with the RGB images and the ground truth maps) after the InfraParis challenge on the Codalab. Currently, only a small part of the test sets is released with only the RGB images.



Acknowledgments


We gratefully acknowledge the support of AID Project ACoCaTherm which supported the creation of the dataset. We are also grateful to Remi KAZMIERCZAK and Adrien LAFAGE for their help with the early processing of the dataset, as well as the many staff who worked hard to annotate the dataset.

Citation

If you use InfraParis in your work, please cite this publication:

Contributors

Gianni Franchi

U2IS, ENSTA Paris, Institut Polytechnique de Paris

Marwane Hariat

U2IS, ENSTA Paris, Institut Polytechnique de Paris

Xuanlong Yu

SATIE, Paris Saclay University
U2IS, ENSTA Paris, Institut Polytechnique de Paris

Nacim Belkhir

SafranTech

Antoine Manzanera

U2IS, ENSTA Paris, Institut Polytechnique de Paris

David Filliat

U2IS, ENSTA Paris, Institut Polytechnique de Paris

contact

If you have any questions (about the dataset or this website), please feel free to contact (replace at by @):

Gianni Franchi

gianni.franchi at ensta-paris.fr

Marwane Hariat

marwane.hariat at ensta-paris.fr

Xuanlong Yu

xuanlong.yu at ensta-paris.fr