Messages

16

Bug Reports / COLMAP masks export incorrect image rotation

« on: January 08, 2025, 05:29:15 PM »

Exporting masks using the Colmap camera export with V2.2.0 is not adhering to the original image rotation.

The original photos were from an iphone, so I suspect that the camera orientation flag is being missed somehow?

The resultant exported images in my test case are portrait (correct orientation), Whilst the masks are rotated to landscape.

17

Feature Requests / Re: Export COLMAP in standard

« on: January 03, 2025, 12:17:52 AM »

Thanks for adding the option to not export images every time!

sorry for the dumb question, but can anyone explain the difference between the new "transform to pinhole" and unselected options? what does this do?

18

Feature Requests / Re: Export COLMAP in standard

« on: October 14, 2024, 07:44:19 PM »

I'd like to chime in here:

1. dense point clouds exported from Metashape as points3d work fine in both Nerfstudio and Postshot.
I have a customized version of the gaussian export script which does exactly this. A friend programmed this for me, but it's a kind of a workaround which we therefore couldn't offer Open Source (unlike the Masks implementation we added to the script).
But @ PolarNick, I can of course provide you this script version for internal examination.
One has to install open3d for Metashape manually, and the script internally creates a tmp ply version, reads it back in an then exports it as points3d. A hack which Metashape developers can probably solve in a cleaner fashion, with direct access to the dense cloud points via Python API.
The script chooses the currently active Dense Point cloud in Metashape for export (which I find is a neat solution if the project contains multiple dense point clouds).

I guess replacing the points3d.txt is still compatible with colmap, unlike changing the images.txt with its matching points (although that 2d-matching information isn't needed for Gaussian Splatting reonstructions).
And I personally favour such a points3d approach, rather than mixing this with a ply file or similar.

2. Yes, it would be _extremely_ useful to be able to disable the export of images (like in the script version), due to the long time undistorting takes.
There are many use cases for this (as also mentioned in post above).

3. Looking ahead, it's only a matter of time until fisheye camera models are fully supported for Gaussian Splatting.
The first steps were already made in Nerfstudio's latest GSplat version (1.4).
That's why I think an option to:
a) create idealized fisheye images on export, with the cameras.txt parameters following the OpenCV Fisheye convention, or
b) leave the images as-is, but adapt the cameras.txt  (p1/2, b1/2 intrinsics get lost in this case, but something which is acceptable for OpenCV compatibility?!)

Point 3) should probably be in an advanced section of the export dialog, as users will need to know what they are doing. Maybe also point 2)?

For any discussions of this closer to the 3dGS applications, I'm on the Nerfstudio and Postshot Discord servers as @pics23d

Thanks!

Really great points - I agree with all of these!

19

Feature Requests / Re: Export COLMAP in standard

« on: October 03, 2024, 01:17:21 PM »

Hi, Yep, I get what yore saying, but I think the ability to have the option to choose "true" colmap export or altered export using the dense cloud should still cover both options? But if its not possible to add that option, then I guess thats the end of that request.

Which does leave the other quite important option to add is the ability to not export the images every time, saving a lot of export processing time for repeat exports with minor non image altering exports... if that could be scheduled to be added, that would be a really useful option to speed work flows.

I do suspect that there will be a lot of interest in purchases of your standard edition for gaussian mapping users, so making it as user friendly as possible would be a good thing for all I suspect!

Many thanks!!

20

Feature Requests / Re: Export COLMAP in standard

« on: October 02, 2024, 04:20:19 PM »

Having tried adding the ply file to the colmap sparse folder, the import works, but it is unclear as to which cloud is being used, I suspect that the ply is being ignored.
Furthermore, I tried importing the ply separately, but PS complains that two image sets cannot be processed at once.

So, I think to conclude, this is not possible to mix dataset formats.

21

Feature Requests / Re: Export COLMAP in standard

« on: October 02, 2024, 04:13:43 PM »

This altered Colmap points3D.txt file (without projections data) imports into Jawset Postshot for Gaussian Splatting processing with no issue and produces far greater accuracy than using just the tie points alone.

Nice. Have you tried to directly use Dense Cloud .ply file in Postshot (without mimicking points3D.txt)? It seems that it should also work - https://www.jawset.com/docs/d/Postshot+User+Guide/Importing+Images

Hi, No, I haven't yet, but I suspect that the mixing of Colmap import alongside of ply might not work - I shall try and report back

22

Feature Requests / Re: Export COLMAP in standard

« on: October 02, 2024, 03:34:27 PM »

can you add the option to export a dense cloud as well as or instead of the sparse cloud?

In Colmap format's points3D.txt - points need to have their projections (named 'Track') in cameras - see https://colmap.github.io/format.html#points3d-txt . Such tracks exists for Tie Points because Sparse Cloud was created from 2D keypoints detected in images and then - those 2D keypoints were matched between images and were transformed into 3D Tie Points.

Dense Cloud can be exported in such format because points in Dense Cloud doesn't have tracks - it is unknown what cameras observe which points (and what points were occluded), moreover - such information is too heavy to be represented in text-based points3D.txt+images.txt efficently, because these files formats were not supposed to be used in such way.

So, it makes sense to export Dense Cloud only if some GS implementation can use it AS IS - without tracks - i.e. without projections in cameras, because Dense Cloud doesn't have it by its nature. Do you know such GS implementations? May be they support plain and simple .ply-file import? If so - you can just Export+Import+Use Dense Cloud via .ply-binary format.

Hi, Thank you for taking the time to come back with the detailed response on this.

I have been experimenting with replacing the points3D.txt with a dense pointcloud exported from Metashape, then reduced using cloudcompare, then converting to the correct colmap points3D.txt format and replacing the original sparse/tie points file exported by Metashape.

This altered Colmap points3D.txt file (without projections data) imports into Jawset Postshot for Gaussian Splatting processing with no issue and produces far greater accuracy than using just the tie points alone.

So, I guess that even if it may not work with all GS processing software (I havent tried with Nerfstudio (can someone please?)) It does appear to work with Postshot using the dense pointcloud -

So.. if it is possible to add the option for which pointcloud to use in the export anyway, this would be very handy, as it means that all Colmap file compilation can be made all inside of Metashape with no further conversion stages after the export.


Also, just to request it again, can you also add the option to choose whether to export the undistorted images as well, so that repeat processing is not required for this stage of export, which would save a lot of time.

Many thanks! I really appreciate your effort on this topic!

23

Feature Requests / Re: Export COLMAP in standard

« on: September 27, 2024, 03:28:44 PM »

Regarding .dng, we will fix it in 2.2.0. Thanks for telling about the problem!

That's great thank you!

If we could chose which pointcloud to export, that would be the highest request from me! Thanks!

24

Feature Requests / Re: Export COLMAP in standard

« on: September 12, 2024, 02:21:23 PM »

good point !

25

Feature Requests / Ability to delete points in Gradual Selection within the open dialog

« on: September 12, 2024, 01:54:56 PM »

Gradual selection is a very powerful tool, and for many users workflow, will be often used .

Currently, one cannot delete the selected points whilst the "Gradual Selection" dialog is open - The delete key doesn't function and one has to close the command box, then delete, then reopen the command if further culling is to be performed which is a highly inefficient workflow.

Many thanks!

26

Feature Requests / Re: Export COLMAP in standard

« on: September 11, 2024, 05:07:52 PM »

Another request if possible, is currently the points exported do not get cropped by the object bounding crop area - could this be made possible please?

With Gaussian Splatting, this is quite important, as any outlying sparse points contribute to noise or "floaters" in the splat - having a controllably isolated set of points at export is quite an import part of the pipeline.

Thanks!

You can remove tie points before exporting. Use selection tools and just crop the area you want to leave or cut off points you don't need.

Hi, nice tip thank you - only this is a destructive method - crop box would be non destructive

27

Feature Requests / Re: Export COLMAP in standard

« on: September 10, 2024, 01:34:31 PM »

I seem to be having problems when trying to export cameras if they are .dng (complains it cannot write to destination folder) - will experiment a bit more with this, but if someone else is able to take a look at this and see if they can recreate, that would be great - thanks.

Yes, this appears to be a problem - cannot write to folder when trying to export images that are DNG

28

Feature Requests / Re: Export COLMAP in standard

« on: September 10, 2024, 12:04:26 PM »

Another request if possible, is currently the points exported do not get cropped by the object bounding crop area - could this be made possible please?

With Gaussian Splatting, this is quite important, as any outlying sparse points contribute to noise or "floaters" in the splat - having a controllably isolated set of points at export is quite an import part of the pipeline.

Thanks!

29

Feature Requests / Re: Export COLMAP in standard

« on: September 08, 2024, 06:59:12 PM »

OK, so hopefully quite a simple request, can you add the option to export a dense cloud as well as or instead of the sparse cloud?

This would allow more options to manipulate the points and even potentially completely replace them using external software. (I know this can be done post export, but it would be a handy option in some circumstances anyway. Many thanks.

One other option, it would be handy to be able not to re-export the undistorted images, if you need to make a small change that doesn't affect the distorted images - this would save a lot of time on second exports.

Otherwise, this is working great! Thank you again!

30

Feature Requests / Re: Export COLMAP in standard

« on: September 07, 2024, 12:15:29 PM »

I seem to be having problems when trying to export cameras if they are .dng (complains it cannot write to destination folder) - will experiment a bit more with this, but if someone else is able to take a look at this and see if they can recreate, that would be great - thanks.