error: wrong jacobian size (v 2.2.2)

[andyroo]

Hi Agisoft folks!

I'm evaluating test data from a multicamera mapping system with 4 cameras (this system).

I was able to process 3880 images (no GPS data) loaded to individual camera calibration models in a "normal" project, but when I loaded them as 970 multi-camera images ("as folder"), I get a "wrong jacobian size" error during alignment. In camera calibration initially I enabled the "adjust offset" option for slave camera position/rotation but did not indicate an initial reference. I tried again after estimating the camera positions and rotations and entering them based on rough measurements (still allowing to adjust) and got the same error.

I am processing on Win11 with a Dell Precision 7680 w/ 64GB RAM and a NVIDIA RTX 2000 with Metashape 2.2.2 and all the latest drivers as of a couple weeks ago. It looks like it holds pretty steady at about 20% RAM used, and it didn't look like the GPU was choking either.

The only non-standard thing I did(?) is to load the markers after exporting from the non-multicam project because I didn't want to re-place them.

**potentially another bug** I tried exporting markers in xml format from the reference frame on the non-multicam project and re-importing them to the multicam project and I got an error that was something like "invalid format" - so I exported markers from file/export, then imported from I think the reference pane, and it worked.

[Alexey Pasumansky]

Hello andyroo,

Are you able to reproduce the issue on smaller subset of original imagery?

What parameters you are using for Align Photos command and whether you can share the log with the error?

[andyroo]

This seems to be related to marker export/import from different camera setups (I was trying to avoid manually placing markers again).

Are you able to reproduce the issue on smaller subset of original imagery?

I can reproduce the issue with 5 sets of 4 images.

In the chunk with the jacobian size error, I imported markers from a chunk with the same set of images, but  with each camera loaded separately and configured with an independent camera model in the camera calibration dialog. The chunk had been aligned.

I tried to export markers from the "independent" chunk and and import markers to the "multi-camera" chunk from the reference pane but got a "invalid format" message when importing, so I exported from one chunk and imported to the other with file/export/markers and file/import/markers.

What parameters you are using for Align Photos command and whether you can share the log with the error?

Alignment (no image positions):
Accuracy: High, generic preselection checked, kp limit 60000, tp limit 0, everything else unchecked.
Markers checked and scalebars checked: Alignment fails
Markers checked and scalebars unchecked: Alignment succeeds

I am aligning with no image coordinates, and using estimated coordinates for markers on the calibration plate (local coordinates). The coordinates were imported from estimated coordinates from a previous metashape project with a DSLR, which we used to validate the measurements of our machined measurements (scalebar values) on the calibration plate.

I can share the log but I don't think it's very informative. I'm guessing the relevant part to see where it's happening is:

#start of log excerpt
evaluating initial pair...
initial pair evaluated in 0.015 sec.
initial pair unstable, considering additional pairs.
additional pairs considered in 0 sec.
optimizing initial pair...
Finished processing in 3.994 sec (exit code 0)
Error: Wrong jacobian size

[Alexey Pasumansky]

Hello andyroo,

Maybe you can share the minimal project that can be used to reproduce the problem with three chunks:
1. images loaded as separate cameras with markers' projections placed,
2. same images loaded as multicamera system,
3. copy of chunk 2 but with the imported markers.
all with the matched photos, so that we can run align cameras.

[andyroo]

Hi Alexey,

I already shared a link for a zip with you (to support email) before I read this. The zip has an image folder and psx with 5 frames from the 4-camera rig in a multi-camera chunk and generates the error when you try to align. I was able to load the cameras to individual independent calibration groups with the same markers and scale bars and get them to align (not well) without error. Also if you export/import markers/cameras in xml format from the reference pane you should see the "invalid format" error I was talking about. I can only export and import markers by using export/markers and import/markers from the file menu.

Andy

[Alexey Pasumansky]

Hello Andy,

The issue should be resolved in 2.2.3 pre-release:
https://download.agisoft.com/metashape-pro_2_2_3_x64.msi
https://download.agisoft.com/metashape-pro_2_2_3_amd64.tar.gz
https://download.agisoft.com/metashape-pro_2_2_3.dmg