Continuing our series of comparing Pix4D and WebODM, in this post we explore 2D outputs from a dataset covering an area containing multiple buildings and other structures.

Dataset

As before, we take a dataset to be what Pix4D has decided to showcase itself: a demo project from Pix4D. We will be using the UAV Demo Dataset as present on https://cloud.pix4d.com/demo.

UAV Demo Project – Courtesy of Pix4D

Target Area

The dataset is a populated area with multiple features. It consists of an assortment of buildings which includes small houses, residential apartments, office complexes, train yards and a convention center. It also features a railway track which encircles the buildings. A moderately busy road goes across the area. There is a green field towards south-west and a forest area towards north-east.

Flight Characteristics

Flight Path – Courtesy of Pix4D

Flight Pattern: Double Lawnmower Grid
Front Overlap: 50%
Side Overlap: 80%
Flight Altitude: 155m / 508 feet AGL
Average GSD: 4.26 cm/pixel / 1.67 in/pixel
Area Covered: 0.223km2 / 55.1235 acres

Inputs

Number of images: 169
Input image resolution: 4608×3456
Camera model name: Canon IXUS 127 HS

Methodology

We will comparing the outputs processed from WebODM against the outputs already present in the demo project.

Processing Options

Pix4D

Pix4D Version: Enterprise 2.1.61

WebODM

ODM version: 2.3.3
dtm: true
dsm: true
gps-accuracy: 0.1
pc-quality: ultra

Result

Quality

On a high-level, the output produced by WebODM looks to be at par with Pix4D. The major differences between the two are most visible in the case of building edges and overground structures. Pix4D produces slightly smoother building edges as compared to WebODM. On the other hand, WebODM is better at handling overground structures such as electric poles and cars which have a ghost-like appearance in Pix4D. Trees are also much more defined in WebODM.

Accuracy

We do comparison for two outputs. One, when GCPs were provided and second, when GCPs were not provided.

With GCP

We have used 5 out of 6 GCPs as GCPs. We use the remaining GCP, GCP 4, as checkpoint to compare accuracy.

CheckpointWebODM – X ErrorWebODM – Y ErrorWebODM – Z ErrorPix4D – X ErrorPix4D – Y ErrorPix4D – Z Error
GCP 40.0900.0660.4930.0510.0460.412

Though it is not quite able to reach the accuracy provided by Pix4D, WebODM does manage to reach pretty close to be able to useful in many applications.

Without GCP

We can use the GCPs as checkpoints to check accuracy in this case.

CheckpointWebODM – X ErrorWebODM – Y ErrorWebODM – Z ErrorPix4D – X ErrorPix4D – Y ErrorPix4D – Z Error
GCP 0-1.9220.006-53.904-1.625-0.015-54.082
GCP 1-2.398-0.536-53.530-2.410-0.507-53.849
GCP 2-1.728-0.649-54.492-1.691-0.836-54.630
GCP 3-1.723-0.832-55.550-1.456-0.920-55.698
GCP 4-1.582-0.241-55.083-1.280-0.290-55.430
GCP 5-2.452-0.303-53.919-2.098-0.373-54.497
RMS1.9960.50854.4181.8010.58154.702

Both Pix4D and WebODM are well off-the-mark but their divergences are almost equal in magnitude.

Conclusion

In both quality and accuracy, Pix4D demonstrates why it is the preferred solution for thousands of drone pilots. Still, for a free and open-source software that is relatively new, WebODM does hold its ground against the 10-year old proprietary Pix4D. One thing is clear, with another good option available now for photogrammetry, the drone pilots are the real winner.

Managed WebODM Deployment

Due to its open nature of licensing, WebODM allows for powerful cloud deployments which can provide much cheaper and faster processing in an automated fashion than the usual workstation-based deployments. If you have a business requirement for managed WebODM deployments, check out WebODM on Cloud.

Newsletter