Hi,
I had this happen to me before. Have you tried re-aligning the misaligned cameras (right-click on the selected images, "Align Selected Cameras")?
Currently I don't have an example project to test, but you might have to reset the alignment before (right-click on selected images, "Reset Camera Alignment").
Cheers!