Forum

Author Topic: Help with a heavy project  (Read 5195 times)

OZDF

  • Newbie
  • *
  • Posts: 6
    • View Profile
Help with a heavy project
« on: June 15, 2021, 12:54:31 PM »
Hi everyone,
I am writing on Metashape forum because I need some advice for a huge work.
My machine is an Intel i9 18 core, 128 GB RAM, GeForce 3060 RTX 12GB, 4TB SSD, Motherboard Asus Prime X299-A2.

I am working with Metashape to reconstruct a big wooden church choir, it has a lot of details and I took 1620 pictures of this object.
Since it is the first time I use Metashape for a big project, I tried to work with all the 1620 uncompressed pictures (25mb each photo). The alignment worked but once I tried to do the dense cloud the computer wasn't able to process the action. My SSD and RAM jumped to 99-100% of activity and the completion rate did not advance once 4% was reached (even if I left my computer working for days).
So I decided to create the dense cloud dividing the church choir into smaller parts, but the results of the alignment weren't as good as the alignment of the whole object with 1620 pictures. Indeed I would say that the results obtained were full of errors. So I just tried to reduce the size of the pictures to 4-6 mb each. This time I reached about 70% of completion with a normal use of memory, CPU, etc, after 70% everything goes to 100% and the completion rate doesn't advance.

Is there a "right way" to go for this kind of big projects? What would be the steps you would take to get a good result?
Furthermore, from my experiments, I noticed that it is more difficult to obtain a good result by dividing the project into smaller parts rather than processing big objects as a whole, but in this case obviously we have to contend with the limits of computer performance. Is there a way to subdivide a big the project without losing quality in the result? Maybe doing the alignment of all the 1600 photos, and after that dividing it in 4 chunks and creating smaller dense clouds (I am now trying to proceed in this way, but it is just an experiment).

Thank you so much for your patience and information.

c-r-o-n-o-s

  • Jr. Member
  • **
  • Posts: 91
    • View Profile
Re: Help with a heavy project
« Reply #1 on: June 15, 2021, 01:16:33 PM »
Let me first say, 1600 images is not a big project. (Especially not for this computer).
We use a 20Mpix drone camera and process projects with up to 6000 images.
True, they are JPEGs as our drone only outputs them. As far as I know, the profit of RAW photos is moderate, though.

So I think you should change something in the workflow.
It's definitely doable.

How high is the resolution of the images and what settings do you use for the point cloud?
(Unfortunately, I cannot see that from the screenshot because of the quality.)
« Last Edit: June 15, 2021, 01:23:20 PM by c-r-o-n-o-s »

OZDF

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Help with a heavy project
« Reply #2 on: June 15, 2021, 01:22:16 PM »
Let me first say, 1600 images is not a big project. (Especially not for this computer).
We use a 20Mpix drone camera and process projects with up to 6000 images.
True, they are JPEGs as our drone only outputs them. As far as I know, the profit of RAW photos is moderate, though.

So I think you should change something in the workflow.
It's definitely doable.

I thought my project was big because trying to create the dense cloud of the whole project with 1600 photos Metashape estimate about 10+ days of work...
Maybe I am missing something. Can you suggest me a workflow for this kind of projects? Even in a very synthetic way so I can try to emulate it, because I absolutely cannot do anything with the methods I tried.
About the resolution, I tried the first time with 7000x5000 300dpi, and the second time with 5000x3000 100dpi, none of them worked.
Thank you so much.
« Last Edit: June 15, 2021, 01:24:30 PM by OZDF »

c-r-o-n-o-s

  • Jr. Member
  • **
  • Posts: 91
    • View Profile
Re: Help with a heavy project
« Reply #3 on: June 15, 2021, 01:31:35 PM »
One "test" solution would be to leave the images in the original, but to go to Lowest for the point cloud.
In any case, I would not split the project.

OZDF

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Help with a heavy project
« Reply #4 on: June 15, 2021, 01:38:23 PM »
One "test" solution would be to leave the images in the original, but to go to Lowest for the point cloud.
In any case, I would not split the project.

I am going to try this right now.
By the way, for 6000 photos 20mb, how long does your computer take to process a dense cloud? And which machine are you using? So I can compare with mine and understand if there's something wrong with it.

sfmdd

  • Newbie
  • *
  • Posts: 21
    • View Profile
Re: Help with a heavy project
« Reply #5 on: September 07, 2021, 09:22:08 AM »
What quality settings are you using?
1600 images on ultra high settings are a quite large project, try medium or high quality in dense point cloud and mesh stage, it should run through easily with a much lower processing time.

Just to show the difference on a project with 303 20 Mpx images:

High Quality
Depth Maps      2h38min    6 GB Memory usage
Dense Cloud    1h27min    20,5 GB Memory usage

Ultra High Quality
Depth Maps      10h26min    21,8 GB Memory usage
Dense Cloud    8h34min      44,4 GB Memory usage

Both on Metashape Pro 1.6.5

Greetings
« Last Edit: September 07, 2021, 09:38:11 AM by sfmdd »