Hello emaxwell,
Markers can be used as valid matching points between photos, but it works only for "Align Selected Cameras" option. And you do not need to check them on in the Ground Control pane if the coordinate information is missing, just leave them unchecked.