Forum

Author Topic: Advice seeked: 3D Modelling of a Bridge  (Read 6071 times)

BobvdMeij

  • Full Member
  • ***
  • Posts: 157
    • View Profile
Advice seeked: 3D Modelling of a Bridge
« on: June 26, 2017, 02:14:17 PM »
(Ps. Due to attachment size limitations additional attachments referred to in the below text were added in seperate replies below the following post).

Hello all,

I would like to get some advice regarding the following. Earlier this week we performed a test in order to produce a 3D model of a small (100m) former traintrack bridge (see attached image: Image12_Bridg_Plan (left)). Having no prior experience we expected somewhat of a challenge, and a challenge it proved to be indeed! We initially executed an automated nadir grid flight, followed by a cross-grid flight over the structure with the camera pointed down at 45 degrees. We found that lightning conditions varied a lot (due to vast amounts of sunlight and changing terrain underneath the bridge (water -vs- vegetation -vs- soil). Hence we decided to let go of the automated flights and perform a series of manual flights and also to trigger the camera manually. This resulted in the following image sets:

1.   Nadir imagery: Approx 8m ABL (Above Bridge Level)
2.   Horizontal imagery: Approx 5m from either side of the bridge (camera at 90 degrees)
3.   Oblique imagery: Approx 5m from the bridge, 4m ABL (camera at approx 45 degrees)
4.   Oblique imagery: Approx 4m from the bridge, 8m ABL (camera at approx 30 degrees)
5.   Oblique pillar imagery: Approx 4m orbit around pillars (camera at approx 20 degrees)

All of the above values are estimates as the flights and camera orientation was done manually, but see the second attached image (image12_Bridge_Plan(Right)) for a more comprehensive overview.

As an initial test we tried to align all of the images at once, using High Alignment settings, and both Generic and Reference preselection turned on. We did not apply any masking at all. The output was useless, resulting in a highly dispersed sparse point cloud. It seemed that each flight line produced a sparse point cloud of the bridge structure of its own, but none were aligned with one another (see attached: image3_misalignment_total). We ran similar Alignments using only Reference preselection, only Generic preselection and no preselection; but differences were slim and the model remained useless.

Regardless of performing a manual flight and adjusting lightning conditions (EV value) for each image, illumination differences sustained. Consequently we then performed some editing in an attempt to produce more homogeneous images. Unfortunately with no succes; the model failed to be build properly. Even when taking out the orbital flights around the pillars out of the equation, the results were the same.

In an attempt to diagnose where things went wrong we decided to process each of the flight lines/ camera angles seperately, for each side of the bridge. Unfortunately still then, apart from the nadir flight and the orbital flights around the pillars, none of the image sets aligned properly. Even a set of 6 horizontal images of one side of the bridge, which was very properly illuminated in this particular instance, failed miserably. Even though it is stated all images were aligned, the order is off by A LOT. The order of images after alignment is in no way correct with respect to the order in which they were taken. The last image at the fartest away location, was actually projected on the location of the second image, and vice versa (see attached: image4_misalignment_horizontal). It seems then that Photoscan was not only unable to align images in between different flight, but even alignment of images within a single flight line proved troublesome and useless.

This was also indicated by relatively few projections per image after initial alignment, varying between 84 and 540 (even though Alignment was set to High and Key- and Tiepoint limits to 160k/40k). In a final attempt to aid in the alignment and solve the issue I added at least 4 manual markers/ tie points on each image, as well as on subsequent images that they were visible on (see attached: image5_manualmarkers). However, after either resetting and re-aligning a subset of images OR after re-aligning all images, the misalignment remained completely. I am wellwilling to share the (only 6) horizontally taken images of this small subsection of the bridge to allow others to give it a shot!

So, what’s next? As this is a highly important test for us we are forced to redo it during next week. We will visit the location once more, during overcast this time, and collect massive numbers of images of a small (20m) portion of the bridge from even more positions and camera angles. Hopefully resulting in a sufficient number of flight lines and images that will produce a succesful model. Afterwards we can iteratively take out flight lines/ camera angles to arrive at an optimum and minimum number of images and camera angles required.

Any help and advice on taking on this challenge is much appreciated! What should we have to look (out) for? What are the do’s and don’ts? How many flight lines should be incorporated, from what distance and position with respect to the bridge? What about camera angles and minimum overlap? Regarding oblique zipline flights along either side of the bridge, should be change the lateral distance to the bridge as we make the camera point downward more and more, or should be keep only vary altitude but keep the ziplines aligned in X and Y? Could it be that we flew too close tot he bridge and should we perhaps acquire imagery from a larger distance? And what about mission planning? Provided that we can indeed fly during overcast, should automated flight work or is manual flying and illumination adjusting still necessary?

BobvdMeij

  • Full Member
  • ***
  • Posts: 157
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #1 on: June 26, 2017, 02:15:41 PM »
Image3_misalignment_total

BobvdMeij

  • Full Member
  • ***
  • Posts: 157
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #2 on: June 26, 2017, 02:16:16 PM »
Image4_misalignment_horizontal

BobvdMeij

  • Full Member
  • ***
  • Posts: 157
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #3 on: June 26, 2017, 02:17:08 PM »
image5_manualmarkers

SAV

  • Hero Member
  • *****
  • Posts: 710
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #4 on: June 26, 2017, 04:21:00 PM »
Hi BobvdMeij,

I think you get poor results due to insufficient image overlap. For such a complex structure you should have 80%-90% overlap to guarantee geometrically accurate modelling results. I suggest to 1) take more images and/or 2) fly further away from the bridge. Additionally, mask out the sky in all pictures where it is visible and check the box to incorporate masks in the Photo Alignment step.

Additionally, before alignment check the image quality (right click on a photo in the photos pane, then choose ESTIMATE IMAGE QUALITY > ALL IMAGES). If the quality is below 0.5, then disable the image. If there are several images with low quality, this might explain your poor matching results. You generally want image quality to be at least 0.70. Blurry images are a big problem for digital photogrammetry workflows.
If you have a low image quality, you might want to check/change your camera settings and/or horizontal flight speed. Also, always manually select your White Balance.

Regarding manual flight. I highly recommend to use a flight planning software. For more complex surveys (such as yours) try FlyLitchi. I have used it many times with great success (I was mapping coastal cliffs and open pit mines).

I hope you get better results next time.

Regards
Stefan








 

3DFranz

  • Newbie
  • *
  • Posts: 44
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #5 on: June 27, 2017, 09:47:44 AM »
You also need to mask out the water areas.
Additional : Don't use Generic and Reference Precelection.
In Case of Oblique Images (=not Nadir) Reference Preselction can cause problems (or if you insit on Reference Preselction, you have to input the Ground Elevation).

Massive Overlap, and some Circle-Flights around the Bridge should help you to allign.
Dont forget to Mask the Sky and the Water areas.

BobvdMeij

  • Full Member
  • ***
  • Posts: 157
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #6 on: June 27, 2017, 10:04:39 AM »
Hi BobvdMeij,

I think you get poor results due to insufficient image overlap. For such a complex structure you should have 80%-90% overlap to guarantee geometrically accurate modelling results. I suggest to 1) take more images and/or 2) fly further away from the bridge. Additionally, mask out the sky in all pictures where it is visible and check the box to incorporate masks in the Photo Alignment step.

Additionally, before alignment check the image quality (right click on a photo in the photos pane, then choose ESTIMATE IMAGE QUALITY > ALL IMAGES). If the quality is below 0.5, then disable the image. If there are several images with low quality, this might explain your poor matching results. You generally want image quality to be at least 0.70. Blurry images are a big problem for digital photogrammetry workflows.
If you have a low image quality, you might want to check/change your camera settings and/or horizontal flight speed. Also, always manually select your White Balance.

Regarding manual flight. I highly recommend to use a flight planning software. For more complex surveys (such as yours) try FlyLitchi. I have used it many times with great success (I was mapping coastal cliffs and open pit mines).

I hope you get better results next time.

Regards
Stefan

Thanks SAV for your comprehensive explanation! We indeed plan to reach at least 80% overlap during our second attempt and increase our distance from 7 to about 10 meters, hopefully resulting in more matches. The image quality, by the way, was fine for all images!

As a matter of fact we will indeed use Litchi for a few of our flights. I created two ziplines (i.e. waypoints) on either side of the bridge (10m from the bridge), starting at 1 meter below bridge level and then increasing the altitude by 1m until we reach 13m (pointing the camera a few degrees down for each level). In the end we should have 14 zipline flights on either size of the bridge, with camera angles varying between 0 and 45 degrees.

Then we will use Altizure to perform 5 more flights. 1 vertical/ nadir grid flight at 13m altitude, and another four flights with the camera pointed down at 60 degrees in all four directions. This should help a lot, I reckon. If we have any batteries to spare we might also do some orbital flights and/ or some closeup flights of the pillars underneath.

SAV

  • Hero Member
  • *****
  • Posts: 710
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #7 on: June 28, 2017, 04:48:57 AM »
Hi BobvdMeij,

If you follow the survey layout/design that you explained in your last post, then I would be really surprised if there were any issues processing the images. Keep us updated on the outcome.

All the best for your project.

Regards
SAV

cadm8

  • Jr. Member
  • **
  • Posts: 74
    • View Profile
Re: Advice seeked: 3D Modelling of a Bridge
« Reply #8 on: June 29, 2017, 03:22:21 PM »
Hi

Personally I think you're pushing the photogrammetry -as a method- boundary of what is possible and not. Provided you need to produce a full and correct model (including the railings, poles etc), I would include automated flights with a 85-90% overlap (forward and sideways) and a minimum 4 different views for each subject you're trying to reproduce