Hi, i fear this issue is not taken serious enough!
By doing some tests on 5 different computers (all with different Nvidia cards) i can reproduce the issue every time i want...
It seems to me, that you just have to go high enough with the settings, or increase the dataset for the problem to occur!
(or low enough for it not to happen - depends on your point of view)
I just did some tests with this dataset:
http://www.agisoft.com/datasets/building.zipWhen generating the dense cloud with ultra high settings and moderate filtering it consistently fails:
2017-02-28 12:19:42 Agisoft PhotoScan Professional Version: 1.3.0 build 3772 (64 bit)
2017-02-28 12:19:42 Platform: Windows
2017-02-28 12:19:43 OpenGL Vendor: NVIDIA Corporation
2017-02-28 12:19:43 OpenGL Renderer: GeForce GTX 580/PCIe/SSE2
2017-02-28 12:19:43 OpenGL Version: 4.5.0 NVIDIA 376.53
2017-02-28 12:19:43 Maximum Texture Size: 16384
2017-02-28 12:19:43 Quad Buffered Stereo: not enabled
2017-02-28 12:19:43 ARB_vertex_buffer_object: supported
2017-02-28 12:19:43 ARB_texture_non_power_of_two: supported
2017-02-28 12:19:43 LoadProject
2017-02-28 12:19:43 Loading project...
2017-02-28 12:19:45 loaded project in 2.124 sec
2017-02-28 12:19:45 Finished processing in 2.124 sec (exit code 1)
2017-02-28 12:20:16 Checking for missing images...
2017-02-28 12:20:16 checking for missing images... done in 0.016 sec
2017-02-28 12:20:16 Finished processing in 0.016 sec (exit code 1)
2017-02-28 12:20:16 BuildDenseCloud: quality = Ultra high, depth filtering = Moderate
2017-02-28 12:20:16 Initializing...
2017-02-28 12:20:16 Using device: GeForce GTX 580, 16 compute units, 1536 MB global memory, CUDA 2.0
2017-02-28 12:20:16 max work group size 1024
2017-02-28 12:20:16 max work item sizes [1024, 1024, 64]
2017-02-28 12:20:16 sorting point cloud... done in 0 sec
2017-02-28 12:20:16 processing matches... done in 0 sec
2017-02-28 12:20:16 initializing...
2017-02-28 12:20:16 selected 50 cameras from 50 in 0.125 sec
2017-02-28 12:20:16 Loading photos...
2017-02-28 12:20:20 loaded photos in 4.312 seconds
2017-02-28 12:20:20 Reconstructing depth...
2017-02-28 12:20:22 [GPU] estimating 3498x2857x1728 disparity using 1166x1429x8u tiles
2017-02-28 12:20:25 [CPU] estimating 4002x2665x1120 disparity using 1001x889x8u tiles
2017-02-28 12:20:32 timings: rectify: 1.891 disparity: 8.733 borders: 0.579 filter: 0.655 fill: 0
2017-02-28 12:20:35 [GPU] estimating 2795x2800x224 disparity using 466x400x8u tiles
2017-02-28 12:20:43 timings: rectify: 1.157 disparity: 6.5 borders: 0.546 filter: 0.548 fill: 0
2017-02-28 12:20:45 [GPU] estimating 3561x2717x1024 disparity using 1187x906x8u tiles
2017-02-28 12:20:55 timings: rectify: 1.234 disparity: 8.126 borders: 0.562 filter: 0.672 fill: 0
2017-02-28 12:21:01 timings: rectify: 1.953 disparity: 36.733 borders: 0.702 filter: 0.766 fill: 0
2017-02-28 12:21:01 [GPU] estimating 3961x2493x416 disparity using 793x831x8u tiles
2017-02-28 12:21:05 [CPU] estimating 3498x2857x1728 disparity using 1166x953x8u tiles
2017-02-28 12:21:10 timings: rectify: 1.437 disparity: 8.006 borders: 0.781 filter: 0.812 fill: 0
2017-02-28 12:21:14 [GPU] estimating 4002x2665x1120 disparity using 1001x889x8u tiles
2017-02-28 12:21:24 timings: rectify: 1.797 disparity: 9.003 borders: 0.515 filter: 0.579 fill: 0
2017-02-28 12:21:32 [GPU] estimating 2412x12895x512 disparity using 804x1173x8u tiles
2017-02-28 12:21:41 timings: rectify: 0.969 disparity: 38.007 borders: 0.344 filter: 0.447 fill: 0
2017-02-28 12:21:47 [CPU] estimating 4207x1867x512 disparity using 1052x934x8u tiles
2017-02-28 12:21:58 timings: rectify: 5.922 disparity: 20.824 borders: 2.357 filter: 3.076 fill: 0
2017-02-28 12:22:04 [GPU] estimating 3980x1867x448 disparity using 796x934x8u tiles
2017-02-28 12:22:12 timings: rectify: 1.193 disparity: 6.464 borders: 0.743 filter: 0.767 fill: 0
2017-02-28 12:22:15 [GPU] estimating 4116x1809x800 disparity using 824x905x8u tiles
2017-02-28 12:22:16 timings: rectify: 0.881 disparity: 29.64 borders: 0.489 filter: 0.58 fill: 0
2017-02-28 12:22:20 [CPU] estimating 4143x2414x640 disparity using 1036x1207x8u tiles
2017-02-28 12:22:23 timings: rectify: 1.038 disparity: 6.278 borders: 0.709 filter: 0.667 fill: 0
2017-02-28 12:22:25 [GPU] estimating 4040x1907x832 disparity using 808x954x8u tiles
2017-02-28 12:22:34 timings: rectify: 1.186 disparity: 7.203 borders: 0.643 filter: 0.533 fill: 0
2017-02-28 12:22:37 [GPU] estimating 4091x2108x960 disparity using 1023x703x8u tiles
2017-02-28 12:22:45 timings: rectify: 1.037 disparity: 7.22 borders: 0.624 filter: 0.765 fill: 0
2017-02-28 12:22:48 [GPU] estimating 4028x1981x736 disparity using 806x991x8u tiles
2017-02-28 12:22:55 timings: rectify: 1.049 disparity: 35.688 borders: 0.664 filter: 0.706 fill: 0
2017-02-28 12:22:56 timings: rectify: 1.219 disparity: 6.545 borders: 0.825 filter: 0.873 fill: 0
2017-02-28 12:22:59 [GPU] estimating 3948x1898x288 disparity using 790x949x8u tiles
2017-02-28 12:23:01 [CPU] estimating 3962x2493x416 disparity using 991x1247x8u tiles
2017-02-28 12:23:06 timings: rectify: 0.921 disparity: 5.268 borders: 0.828 filter: 0.754 fill: 0
2017-02-28 12:23:15 [GPU] estimating 4116x1809x800 disparity using 824x905x8u tiles
2017-02-28 12:23:23 timings: rectify: 1.707 disparity: 6.782 borders: 0.671 filter: 0.678 fill: 0
2017-02-28 12:23:26 [GPU] estimating 4090x1982x480 disparity using 818x991x8u tiles
2017-02-28 12:23:34 timings: rectify: 1.409 disparity: 6.47 borders: 0.81 filter: 0.794 fill: 0
2017-02-28 12:23:37 timings: rectify: 2.085 disparity: 36.377 borders: 0.946 filter: 0.942 fill: 0
2017-02-28 12:23:37 [GPU] estimating 4143x2414x640 disparity using 1036x805x8u tiles
2017-02-28 12:23:40 [CPU] estimating 3502x2089x192 disparity using 1168x1045x8u tiles
2017-02-28 12:23:49 timings: rectify: 1.538 disparity: 10.187 borders: 0.973 filter: 1.083 fill: 0
2017-02-28 12:23:52 [GPU] estimating 4201x1868x864 disparity using 841x934x8u tiles
2017-02-28 12:24:01 timings: rectify: 1.237 disparity: 7.529 borders: 0.5 filter: 0.596 fill: 0
2017-02-28 12:24:04 [GPU] estimating 4124x1900x800 disparity using 825x950x8u tiles
2017-02-28 12:24:08 timings: rectify: 0.842 disparity: 28.139 borders: 0.53 filter: 0.564 fill: 0
2017-02-28 12:24:13 timings: rectify: 1.431 disparity: 7.653 borders: 0.696 filter: 0.611 fill: 0
2017-02-28 12:24:15 [GPU] estimating 3581x1597x384 disparity using 1194x799x8u tiles
2017-02-28 12:24:16 [CPU] estimating 2795x2800x224 disparity using 932x934x8u tiles
2017-02-28 12:24:22 timings: rectify: 0.728 disparity: 5.365 borders: 0.58 filter: 0.569 fill: 0
2017-02-28 12:24:30 [GPU] estimating 3730x2433x1216 disparity using 933x811x8u tiles
2017-02-28 12:24:40 timings: rectify: 1.169 disparity: 8.583 borders: 0.5 filter: 0.593 fill: 0
2017-02-28 12:24:43 [GPU] estimating 4028x2848x800 disparity using 806x950x8u tiles
2017-02-28 12:24:46 timings: rectify: 1.415 disparity: 30.671 borders: 0.498 filter: 0.649 fill: 0
2017-02-28 12:24:51 [CPU] estimating 3816x3128x576 disparity using 954x1043x8u tiles
2017-02-28 12:24:57 timings: rectify: 1.963 disparity: 11.251 borders: 0.792 filter: 1.165 fill: 0
2017-02-28 12:25:00 [GPU] estimating 4038x2330x640 disparity using 1010x777x8u tiles
2017-02-28 12:25:11 timings: rectify: 1.58 disparity: 8.472 borders: 0.699 filter: 0.992 fill: 0
2017-02-28 12:25:14 [GPU] estimating 3883x2433x768 disparity using 971x811x8u tiles
2017-02-28 12:25:24 timings: rectify: 1.379 disparity: 8.451 borders: 0.679 filter: 0.779 fill: 0
2017-02-28 12:25:33 [GPU] estimating 3561x2717x1024 disparity using 891x906x8u tiles
2017-02-28 12:25:38 timings: rectify: 1.52 disparity: 48.304 borders: 0.687 filter: 0.833 fill: 0
2017-02-28 12:25:43 [CPU] estimating 3730x2433x1216 disparity using 933x1217x8u tiles
2017-02-28 12:25:43 timings: rectify: 1.659 disparity: 9.446 borders: 0.548 filter: 0.612 fill: 0
2017-02-28 12:25:47 [GPU] estimating 3816x3128x576 disparity using 954x782x8u tiles
2017-02-28 12:25:59 timings: rectify: 1.868 disparity: 10.832 borders: 0.711 filter: 0.834 fill: 0
2017-02-28 12:26:02 [GPU] estimating 4028x2848x800 disparity using 1007x950x8u tiles
2017-02-28 12:26:14 timings: rectify: 1.383 disparity: 10.184 borders: 0.832 filter: 1.024 fill: 0
2017-02-28 12:26:18 [GPU] estimating 4084x2745x1088 disparity using 817x687x8u tiles
2017-02-28 12:26:18 timings: rectify: 1.129 disparity: 36.451 borders: 0.469 filter: 0.632 fill: 0
2017-02-28 12:26:26 [CPU] estimating 4083x2745x1088 disparity using 1021x915x8u tiles
2017-02-28 12:26:32 timings: rectify: 1.767 disparity: 12.628 borders: 0.494 filter: 0.689 fill: 0
2017-02-28 12:26:40 [GPU] estimating 3884x2433x768 disparity using 971x811x8u tiles
2017-02-28 12:26:51 timings: rectify: 1.733 disparity: 8.598 borders: 0.602 filter: 0.874 fill: 0
2017-02-28 12:26:54 [GPU] estimating 3885x2857x448 disparity using 972x953x8u tiles
2017-02-28 12:27:05 timings: rectify: 1.681 disparity: 9.282 borders: 0.97 filter: 1.075 fill: 0
2017-02-28 12:27:08 timings: rectify: 1.608 disparity: 42.767 borders: 0.494 filter: 1.025 fill: 0
2017-02-28 12:27:09 [GPU] estimating 4041x2742x1184 disparity using 809x914x8u tiles
2017-02-28 12:27:12 [CPU] estimating 4038x2330x640 disparity using 1010x1165x8u tiles
2017-02-28 12:27:21 timings: rectify: 2.009 disparity: 10.629 borders: 0.734 filter: 0.863 fill: 0
2017-02-28 12:27:24 [GPU] estimating 3938x2525x1984 disparity using 985x842x8u tiles
2017-02-28 12:27:35 timings: rectify: 1.736 disparity: 9.481 borders: 0.454 filter: 0.596 fill: 0
2017-02-28 12:27:42 [GPU] estimating 3980x1867x448 disparity using 796x934x8u tiles
2017-02-28 12:27:45 timings: rectify: 1.03 disparity: 34.155 borders: 0.55 filter: 0.595 fill: 0
2017-02-28 12:27:49 timings: rectify: 1.151 disparity: 5.721 borders: 0.582 filter: 0.647 fill: 0
2017-02-28 12:27:51 [GPU] estimating 4090x1982x480 disparity using 818x991x8u tiles
2017-02-28 12:27:52 [CPU] estimating 3884x2857x448 disparity using 971x953x8u tiles
2017-02-28 12:28:01 timings: rectify: 0.883 disparity: 8.134 borders: 0.807 filter: 0.799 fill: 0
2017-02-28 12:28:04 [GPU] estimating 4207x1867x512 disparity using 842x623x8u tiles
2017-02-28 12:28:09 Hierarchical SGM failed: 2017-02-28 12:28:09 GPU processing failed, switching to CPU mode
unspecified launch failure at line 208
2017-02-28 12:28:10 [CPU] estimating 4207x1867x512 disparity using 1052x934x8u tiles
2017-02-28 12:28:28 timings: rectify: 1.242 disparity: 38.327 borders: 0.637 filter: 0.788 fill: 0
2017-02-28 12:28:31 [CPU] estimating 3461x2536x768 disparity using 1154x1268x8u tiles
2017-02-28 12:28:58 timings: rectify: 0.899 disparity: 27.291 borders: 0.48 filter: 0.545 fill: 0
2017-02-28 12:29:03 finished depth reconstruction in 522.192 seconds
2017-02-28 12:29:03 Device 1: 19% work done with performance: 16.3823 million samples/sec (CPU), device used for 462.55 seconds
2017-02-28 12:29:03 Device 2: 80% work done with performance: 68.4154 million samples/sec (GeForce GTX 580), device used for 275.848 seconds
2017-02-28 12:29:03 Total performance: 84.7977 million samples/sec
2017-02-28 12:29:03 Warning: unspecified launch failure
2017-02-28 12:29:03 Warning: invalid resource handle
2017-02-28 12:29:03 Finished processing in 527.177 sec (exit code 0)
2017-02-28 12:29:03 Error: unspecified launch failure at line 67
System specs for this test:
Intel I7 920
GTX 580
12GB RAM
I know this is a low-spec-pc, but i'm out of time testing on our production machines...
I assure you even our dual-xeon, nvidia quadro workhorse has the same issue!
Needless to say it works fine once i reinstalled the previous version 1.2.6
I strongly suggest a rollback or at least a switch in the settings to use OpenCL again instead of CUDA!