CAD is not the way to go for large polygon count meshes and even worse for dense point clouds unless you have specific plug-ins. You should better try with software packages designed to handle laser scanner data if your field of application is mainly close range; or, just use GIS tools if your field of application is Geomatics.
Georeferenced data are usually rejected by programs that are not intended for handling large numbers coordinaes (UTM), so what you could try is to translate your model so to a place its center near the (0,0,0) by using a big integers vector during export from photoscan to Solidworks. I have never tried with that program, but it happens with others.
You will find much more usable photoscan models exported as DEM inside GIS tools, you can also make good use of the dense point cloud with programs developed for lidar data.
Regards
PD, if you specify your need I may suggest a finer approach