If it does not overlap, then no 3D information was generated for the area that is imaged on this photograph.
If there is not 3D info, then no 3D point will go looking for a pixel RGB value in that particular image even if it was georeferenced directly (unless you can get DSM info for that part)