Forum

Author Topic: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2  (Read 6079 times)

deadwilder

  • Newbie
  • *
  • Posts: 5
    • View Profile
Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« on: May 29, 2018, 11:14:22 PM »
Hello,

Ever since I installed a second GPU Geforce GTX 1080 on my PC, Photoscan 1.4.2 Pro has been constantly crashing. It will often crash when building meshes, building textures and aligning photos. Sometimes the software crashes and sometimes Windows does. \I have "Use CPU when performing GPU related processing" unticked.
 
I'm under the impression the crashes have to do with using two GPUs since the crashes seem to stop once I disable the second GPU in Photoscan.

I'm using Windows 10 educational, PC specs are: i7-7700k, 32gb ram, Consair water cooler, EVGA 850 G2. I'm not using Geforce Experience to update GPU drivers and I have the latest drivers installed. What could be causing the frequent crashes? Is there anything I can do to have Photoscan run smoothly with my 2 GPUs?



Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 14813
    • View Profile
Re: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« Reply #1 on: May 30, 2018, 08:28:31 AM »
Hello deadwilder,

Is there any difference if you disable first or second GPU for processing?

Also are there any errors in the processing log (if you have enabled console output redirection to the external file) or there's nothing unusual?
Best regards,
Alexey Pasumansky,
Agisoft LLC

deadwilder

  • Newbie
  • *
  • Posts: 5
    • View Profile
Re: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« Reply #2 on: May 30, 2018, 08:47:21 AM »
Hi Alexey,

I spoke too soon when I said that disabling the second GPU solved the problem. It makes crashing less frequent, but it still happens. I didn't notice any difference if the first or second GPUs were selected.

There's nothing out of the ordinary in the log. The log just stops registering the process once the software crashes, but there is no error message.

I ran a couple of GPU stress tests this afternoon and both Furmark and Heaven ran for a long time without any problems. I also use both GPUs to render large Cinema 4D projects without getting any crashes.

Do you think I should try to use an earlier version of Photoscan?

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 14813
    • View Profile
Re: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« Reply #3 on: May 30, 2018, 01:41:57 PM »
Hello deadwilder,

I've sent you a diagnostics utility to test.

Also make sure that latest NVIDIA drivers are installed.

If the issue persists, please send the processing log and the diagnostics output to support@agisoft.com or via PM.
Best regards,
Alexey Pasumansky,
Agisoft LLC

Zim240

  • Newbie
  • *
  • Posts: 8
    • View Profile
Re: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« Reply #4 on: June 08, 2018, 09:49:08 AM »
Good day,

I have a similar problem. Yesterday I installed a 1080Ti with the previous 970. Agi would not process using both cards:

2018-06-08 08:44:42 Agisoft PhotoScan Professional Version: 1.4.2 build 6205 (64 bit)
2018-06-08 08:44:42 Platform: Windows
2018-06-08 08:44:42 CPU: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz (desktop)
2018-06-08 08:44:42 CPU family: 6 model: 60 signature: 306C3h
2018-06-08 08:44:42 RAM: 31.9 GB
2018-06-08 08:44:42 OpenGL Vendor: NVIDIA Corporation
2018-06-08 08:44:42 OpenGL Renderer: GeForce GTX 1080 Ti/PCIe/SSE2
2018-06-08 08:44:42 OpenGL Version: 4.6.0 NVIDIA 398.11
2018-06-08 08:44:42 Maximum Texture Size: 32768
2018-06-08 08:44:42 Quad Buffered Stereo: not enabled
2018-06-08 08:44:42 ARB_vertex_buffer_object: supported
2018-06-08 08:44:42 ARB_texture_non_power_of_two: supported
2018-06-08 08:44:42 Using simple console. Rich console can be enabled in Preferences dialog.
2018-06-08 08:44:54 Loading photos...
2018-06-08 08:44:54 Finished processing in 0.016 sec (exit code 1)
2018-06-08 08:45:33 AlignPhotos: accuracy = Medium, preselection = reference, keypoint limit = 40000, tiepoint limit = 4000, apply masks = 0, filter tie points = 0, adaptive fitting = 0
2018-06-08 08:45:33 Matching photos...
2018-06-08 08:45:33 Detecting points...
2018-06-08 08:45:33 Using device: GeForce GTX 1080 Ti, 28 compute units, 11264 MB global memory, compute capability 6.1
2018-06-08 08:45:33   driver version: 9020, runtime version: 5050
2018-06-08 08:45:33   max work group size 1024
2018-06-08 08:45:33   max work item sizes [1024, 1024, 64]
2018-06-08 08:45:33 Using device: GeForce GTX 970, 13 compute units, 4096 MB global memory, compute capability 5.2
2018-06-08 08:45:33   driver version: 9020, runtime version: 5050
2018-06-08 08:45:33   max work group size 1024
2018-06-08 08:45:33   max work item sizes [1024, 1024, 64]
2018-06-08 08:45:33 [GPU] photo 1: 19627 points
2018-06-08 08:45:37 Warning: cudaStreamDestroy failed: out of memory (2)
2018-06-08 08:45:37 Finished processing in 4.33 sec (exit code 0)
2018-06-08 08:45:37 Error: CUDA_ERROR_OUT_OF_MEMORY (2) at line 123

It works when selecting each card individually, they wont work together.

Thanks in advance.

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 14813
    • View Profile
Re: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« Reply #5 on: August 10, 2018, 08:11:17 PM »
Hello Andre240,

Which GPU is used for the visualization in your case? Are you able to process the data using only one GPU at a time and whether it is valid for both cards?
Best regards,
Alexey Pasumansky,
Agisoft LLC

Griffonaus

  • Newbie
  • *
  • Posts: 2
    • View Profile
Re: Dual GPU Geforce GTX 1080 Constantly Crashing 1.4.2
« Reply #6 on: September 01, 2018, 12:32:30 PM »
I am having this same problem with a single Nvidia Geforce GTX 1080.
Win 10
Intel i7-4720HQ 2.6GHz
Photoscan Standard 1.4.3

I have installed the latest video drivers and a clean re-install of Win 10.

I have run old models which processed easily on the old GTX Geforce 970