Hello Apavlicek,
You can use Ruler tool in the aligned project to measure any point in the sparse cloud, then calculate the offset as difference between average GCPs' altitude and measure point altitude. Add this offset to the camera altitude data and re-import the correct values to the Reference pane.