Forum

Poll

Which is better, GPU power or CPU power to handle Processing and 3D Analytics of Big Ortho/Lidar Projects

GPU
0 (0%)
CPU
1 (33.3%)
Mix of both and how?
2 (66.7%)

Total Members Voted: 3

Voting closed: October 02, 2015, 09:36:46 PM

Author Topic: Building a server for Big Data Processing - Build for CPU or GPU Power?  (Read 3503 times)

JonEllinger

  • Newbie
  • *
  • Posts: 2
    • View Profile
My team and I looking for advice from IT professionals and software engineers in the remote sensing industry on how to best build out a server to handle the processing and analytics of large data sets, both imagery and LiDAR.  We are looking to create point clouds from imagery as well as fuse LiDAR and imagery datasets together for analysis.  We hope to run the majority of our processing and analytics from the server over a fast connection within the office. 

We are looking for advice on how to instruct the firm who is building the server for us.  We have heard the CPU power is maily usefuly for the routine calculations of business software, but GPU power is better for calculations that involve trigonometry such as aerial photo triangulation and point cloud creation.  And that some software firms are developing their software suites to harness the many cores of GPUs rather than CPUs. 

Thoughts?  Suggestions?  Advice?  All are greatly appreciated.  jellinger722@gmail.com.

Wishgranter

  • Hero Member
  • *****
  • Posts: 1202
    • View Profile
    • Museum of Historic Buildings
Re: Building a server for Big Data Processing - Build for CPU or GPU Power?
« Reply #1 on: September 19, 2015, 12:16:49 AM »
Hi JonElinger
[/size]
what sort of datasets are you planing to process ?
[/color][/size]how many images, resolution and type of reconstrucion subject are you planing ? 
 

read email....
[/color]
----------------
www.mhb.sk

hanparker

  • Newbie
  • *
  • Posts: 25
    • View Profile
Re: Building a server for Big Data Processing - Build for CPU or GPU Power?
« Reply #2 on: September 19, 2015, 09:45:06 AM »
HI Jon,

I'm using the Amazon EC2 - GPU g2.8xlarge https://aws.amazon.com/ec2/instance-types/ . Be interested to see other peoples opinions.

JonEllinger

  • Newbie
  • *
  • Posts: 2
    • View Profile
Re: Building a server for Big Data Processing - Build for CPU or GPU Power?
« Reply #3 on: September 24, 2015, 11:18:20 PM »
Thanks for the replies.  We will be working with a broad range of imagery sets.  From UltraCam Eagle (260 megapixel, 1gb Tiffs) to much smaller Sony A7RII mirrorless camera raw files from drone platforms.  We are going to be creating 3D point clouds from the imagery and would like suggestions on how to build out a server for large data 3D model creation.  We plan to host the data on the server and are thinking about doing multicore processing on the server with GPUs for faster orthophoto creation. 

As I understand it for BIG single processes like running Aerial Triangulation and 3D point cloud triangulation and creation we might want to prefer using a very powerful CPU rather than a bunch of GPUs for those processes.  We hope to have several powerful workstations for these big processes but the rest of the time for QC and analysis we hope to have the data live on the server with analysts and technicians on virtual machines on the processing floor accessing the data on the server for their work.  We will have a 10gig line installed in the office so hopefully the transfer speed between the workstations and the server won't be an issue.   

Obviously, I'm not an IT expert so I'd love some general advice from people who have great setups at their jobs on how to design ours?  I would greatly appreciate it.