Segmentation

[jrh87]

Is there any way to apply auto-segmentation on a 3D model? For example, I am taking drone pictures of a building, but other buildings in the background appear in the scene and I would like to have a method to automatically segment only the building of interest and remove the rest. Alternatively, can Metashape only generate the 3D model of the area at the front and do not generate it for the background (e.g. some sort of masking).

[Duringar]

Hi jrh87,

As far as i know, an auto-segmentation is not (yet) available.
One possible solution to your problem would be to generate your 3D-Model as you normally would and then set a boundary around the object you want your 3D-Model of.
In the export-dialog of the 3D-Model you can set the model to "clip to boundary shapes". That way you only export the wanted 3D-Model and nothing in the background.

A boundary can (to my knowledge) only be created on a DEM or Orthomosaic, so you would have to calculate those as well.

Set a boundary:
1) draw a polygon around the area you want to have a 3D-Model of in your DEM or Orthomosaic by using the polygon/polyline tool (image 1).
2) select navigation (the arrow-symbol in the toolbar) and select the just drawn polygon.
3) right click and "Set Boundary Type" --> "Outer Boundary", your Polygon should now turn into a hashed line (image 2).
4) right click on your 3D-Model and follow the export-dialogue. There you will have the opportunity to select "Clip to boundary shapes (image 3).

The exported 3D-Model will be clipped to your boundary and nothing outside said boundary will be visible in the final model.

Does this answer your question?
Good luck and all the best!

[olihar]

Of course you can use the Bounding Box and or Clipping mask.

[jrh87]

I was looking for some automated, as in either changing the settings or having some AI segmentation models.

[olihar]

Why AI, AI is just an overused word noone understands.

What do you want the AI to do, make automatic bounding box for you?

[jrh87]

Yes, given a 3D model containing different buildings, I need some automated way to extract each building separately. Note that the buildings may overlap with each other, so they are mostly different by height, textures, etc.

[Duringar]

Yes, given a 3D model containing different buildings, I need some automated way to extract each building separately. Note that the buildings may overlap with each other, so they are mostly different by height, textures, etc.

I do not think this is possible as of now. The available solutions to your problem have been named already.

[olihar]

You can train AI on the orthographic data to make cutting boxes around the buildings.