overview

4D, or space-time, models are sequences of 3D shape models that represent live and dynamic events, human activities for instance.

They are captured from the real world using a multi-camera set up. The models are composed of texture information (sequences of images obtained from the cameras) and geometry (sequence of mesh-models reconstructed from the images), allowing both the shape and the appearance of the scene to be reconstructed at any instant. As the user navigates in 4D, i.e, space and time, these models can be seen from any viewing angle and inspected frozen at any instant of time.

This website contains such 4D models of human and non-human interactions, which can be downloaded from the data section.

Softwares related to space time modeling, e.g. a viewer, are also available for download.

objective

This repository aims to disseminate the data acquired with the GRImage multi-camera platform, hosted at INRIA Grenoble, France.

It also seeks to be a common repository for dynamic mesh-sequences acquired from similar platforms elsewhere in the world.

description

Each sequence consists of

  1. calibration information for the multi-camera set up
  2. images acquired from multiple cameras
  3. silhouettes extracted from these images by eliminating the background
  4. reconstructed mesh geometry at different time frames in the sequence.

These files are compressed and available for download either individually or as a whole.

The web page of each sequence contains textual information about the nature of the interactions, as well as a video-snippet for visualization. Additional files, if available, are cited along with the methods used to derive them.

The mesh-sequences acquired from the GRImage platform are visual hull reconstructions from extracted silhouettes, through the use of software developed by 4DView Solutions.

Other Capture Scenarios

If you are an academic researcher, it is possible to acquire custom multiple-view image sequences in the Grimage platform. Do not hesitate to contact us for specific setups or scenarios at:

bruno.raffin@inria.fr
matthijs.douze@inria.fr

If you are from a European research lab, the travel costs incurred by your visit to the platform can even be reimbursed by the Visionair project (Visionair).