Can we use depth image to properly scale the dense pointcloud.

[ppant]

I am looking at a RGBD image mosaic and when only RGB image is passed for mosaic the dense point cloud visually looked correct but the scale of an object is not correct. Is there a way to use the depth image to properly scale the point cloud?

Thanks