Hello SK12345,
You can enable "load camera orientation angles from XMP meta data" in the Advanced preferences tab before adding the image to the chunk.
Then you can also specify the higher accuracy for the camera orientation angles (from the Reference pane settings dialog or using Set Accuracy command from the Reference pane context menu for the selected cameras). But make sure that there is no incorrect information loaded, otherwise, with the high accuracy the invalid values may affect the alignment results.
The problem with the alignment that you are facing could be a result of the lack of the image overlap, can you share a few screenshots demonstrating the issues with the alignment?