Hello Regon,
You can uncheck the cameras in the Reference pane, which coordinates you do not want to use for georeferencing and alignment optimization.
Usually, the GPS measurement accuracy is written to the image meta data and is imported to Accuracy column of the Reference pane. The coordinates will be then taken with the weight corresponding to the accuracy.