Hello Fkybarless,
I think you can fix it by using at least one GCP in addition to the camera coordinates or having valid camera orientation angles loaded to the Reference pane (yaw, pitch, roll).
Or more images should be added that do not follow the same line.