Because Photoscan still use algorithms from early photogrammetry days (that probably as old as mammoth ***t). All Cloud dots are "real" for Photoscan, but depend on mesh generation resolution settings, alone dots or dots islands can be ignored. So you SHOULD remove all garbage from dense cloud before generate mesh.
You can read about poison mesh generation or other technics for understand how this work. Photoscan just use such mesh generation create raw mesh about 1.5~2x more poly than target count and later just decimate for your target poly count.