Hello Jernej,
I would say that there's a coordinate system issue.
If the external point cloud that you are importing to Metashape is georeferenced in some projected coordinate system, you should select it in Import Points dialog. Also select the same system in the Reference pane settings dialog prior to the mesh generation operation.
Another possible reason is partially inverted normals for the points of the imported cloud.