You Can Get There From Here – Creating 3D models with Photorealistic textures from the e57 file format

Fred Leighton, University of Wisconsin-Whitewater, USA

Abstract

Demonstration of workflow for developing 3D models with photorealistic textures for use in interactive projects. A development pipeline will be demonstrated showing how to create models with textures, starting from E57 files that include LiDAR scan and associated image data, and ending with an optimized 3D model asset for use in software authoring tools.

Keywords: E57, LiDAR, RealityCapture, 3D Models, Remote Sites, Education

Abstract

 This is an introduction to developing 3D models with photorealistic textures for use in digital projects, for example, animation, cinematics, augmented reality and virtual reality. A development process is demonstrated, starting with an e57 file, a format that includes laser scan data and images, including metadata, and results in an optimized, textured mapped 3D model asset.

 

Keywords

e57, LiDAR, RealityCapture, Blender, Unity, 3D models with photorealistic textures, cultural heritage, laser scans, point cloud, photogrammetry, development pipeline, Chumash rock art

 

Introduction

Definitions / Terminology

 

e57 data

e57 data files include point clouds, images, and metadata generated by 3D imaging systems, including laser scanners and imaging systems.The file format is specified by the ASTM, an international standards organization, and it is documented in the ASTM E2807 standard. The current version is 1.1.312 (http://www.libe57.org/)

 

Point Cloud data

A point cloud is a set of data points in space. The points represent a 3D shape or object. Each point has its set of X, Y and Z coordinates.

(https://en.wikipedia.org/wiki/Point_cloud)

 

LiDAR

Light Detection and Ranging, is a remote sensing method that uses light in the form of a pulsed laser to measure ranges (variable distances) to the Earth. These light pulses—combined with other data recorded by the airborne system — generate precise, three-dimensional information about the shape of the Earth and its surface characteristics.

A lidar instrument principally consists of a laser, a scanner, and a specialized GPS receiver. Airplanes and helicopters are the most commonly used platforms for acquiring lidar data over broad areas. Two types of lidar are topographic and bathymetric. Topographic lidar typically uses a near-infrared laser to map the land, while bathymetric lidar uses water-penetrating green light to also measure seafloor and riverbed elevations. (https://oceanservice.noaa.gov/facts/lidar.html#:~:text=Lidar%2C%20which%20stands%20for%20Light,variable%20distances)%20to%20the%20Earth.)

 

Photogrammetry

Photogrammetry is the science and technology of obtaining reliable information about physical objects and the environment through the process of recording, measuring and interpreting photographic images and patterns of electromagnetic radiant imagery and other phenomena. Digital image capturing and photogrammetric processing includes several well defined stages, which allow the generation of 2D or 3D digital models of the object as an end product. (https://en.wikipedia.org/wiki/Photogrammetry#:~:text=Photogrammetry%20is%20the%20science%20and,radiant%20imagery%20and%20other%20phenomena.)

 

 

About the sample data set for demonstration

Chumash Painted Cave State Historic Park

Native American rock art

The walls of this small cave carved from towering sandstone boulders contain some of the finest remaining rock art created by Chumash Native Americans.  A steep path leads to the cave entrance, which is protected by heavy iron grillwork. Anthropologists estimate that the paintings date to the 1600’s and earlier.  The meaning of these enigmatic images has been lost. (https://www.parks.ca.gov/?page_id=602)

 

Intended Audience

 Designers and developers of digital content who want to work with accurate point cloud data and images for creating 3D models with photorealistic textures. Experience with software tools for design and development of 3D models and textures, and authoring tools that include 3D models and textures is recommended.

 

Session Goals

To demonstrate a development process for creating lower resolution 3D models with photorealistic textures from an e57 data file source.

 

Development

Step by Step Example

In this example, a low polygon texture mapped 3D model is developed starting with e57source data from the Chumash Painted Cave at Painted Cave State Historic Park, a California State Park located near Santa Barbara, California.

 

Step One

Locate an e57 source file.

e57 files can be obtained from websites at no cost. For this example, the source file is from the Open Heritage website.

 

Step Two

Import the file into RealityCapture 1.1 for viewing, editing, and exporting.

Import the e57 file to RealityCapture. The software interface can be configured to access a number of different views and data sets including 2D images, point cloud data from LiDAR laser scans, and metadata. Tools, settings and workflow selections are in the ribbon on the top of the interface. Workflow choices are presented in a basic set of commands, and, in more detailed tool settings. Here are views of the 2D images combined point cloud data to create an initial rendering of the data.

RealityCapture Interface
Image 1 – RealityCapture 1.1 interface with settings, 2D images, and 3D point cloud render from single e57 file.

 

Step Three

Align data to create 3D model

After applying tools to align the images and scan data, a flat shaded texture is created.

RealityCapture interface
Image 2 – RealityCapture, 3D model mesh with shading , cave entrance exterior.

 

Step Four

Apply images to create view of model with photorealistic textures.

RealityCapture Interface
Image 3 – RealityCapture, 3D model with photorealistic textures from aligned images, cave entrance exterior.

 

RealityCapture Interface
Image 4 – RealityCapture, simplified 3D model with photorealistic textures, rock art, cave interior.

 

Step Five

Edit the model

Use selection tools to delete polygons, resulting in edited model for export.

RealityCapture Interface
Image 5 – RealityCapture, editing 3D model, using selection tools.

 

RealityCapture Interface
Image 6 – RealityCapture, edited 3D model, cave with entrance.

 

Step Six

Prepare model for UV texture mapping.

RealityCapture Interface
Image 7 – RealityCapture, UV unwrap tool, settings and checkerboard map indicating texture map.

 

RealityCapture Interface
Image 8 – RealityCapture, photorealistic texture map applied to edited 3D model.

 

Step Seven

Export model with texture from images.

Exporting with the FBX model format will include the UV coordinates and mapped texture image in PNG format, which can then be easily imported to other applications, keeping the texture map placement intact with the model.

RealityCapture Interface
Image 9 – RealityCapture, Export Model settings

 

Exported Files from RealityCapture
Image 10 –Exported files, FBX model, with mapped PNG texture

 

Step Eight

Import the FBX model to 3D modelling tools, for example, Blender, an open source software tool, and Unity, an interactive 3D authoring tool for games, augmented reality, virtual reality and cinematics.

Blender Interface
Image 11 – Blender, FBX model and applied PNG texture view, cave interior, rock art.

 

Unity Interface
Image 12 – Unity, 2D view of PNG texture map image.

 

Unity Interface
Image 13 – Unity, 3D model with mapped image texture

 

Unity Interface
Image 14 – Unity, camera view of texture mapped 3D model asset, cave interior, rock art.

 

 

Resources

 

Software

RealityCapture 1.1 (PC only)

https://www.capturingreality.com/

Blender

https://www.blender.org/

Unity

https://unity.com/

 

e57 file sources

Open Heritage

https://www.openheritage3d.org/

 Lib E57

http://www.libe57.org/data.html

 

Chumash Painted Cave State Historic Park

https://www.parks.ca.gov/?page_id=602

 

 

 

 

 


Cite as:
Leighton, Fred. "You Can Get There From Here – Creating 3D models with Photorealistic textures from the e57 file format." MW21: MW 2021. Published January 29, 2021. Consulted .
https://mw21.museweb.net/paper/you-can-get-there-from-here-creating-3d-models-with-photorealistic-textures-from-the-e57-file-format/