Forum

Author Topic: Cluster Processing Assistance  (Read 23324 times)

jhead

  • Newbie
  • *
  • Posts: 7
    • View Profile
Cluster Processing Assistance
« on: October 02, 2014, 10:12:51 AM »
I am having some trouble getting my network processing up and running and was wondering if anyone else has had any experience with it?

I am able to start the server (Comp1) and connect two node computers to it (Comp1 and Comp2) which say they have connected to server at xxx.xxx.xxx.xxx:5841 (i left it default but it went to this). However, I am not able to connect to the server in Photoscan; it just hangs on 'connecting to server'.

Could it have something to do with having a node running on the same computer as the server?

Thanks

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 15465
    • View Profile
Re: Cluster Processing Assistance
« Reply #1 on: October 02, 2014, 02:57:14 PM »
Hello jhead,

Agisoft PhotoScan should work on the same computer as server just fine.

Please make sure that you are entering a real IP address of the server, and not a localhost as it can resolve to IPv6 address..

You can also try connecting to the server with a Network Monitor first.
Best regards,
Alexey Pasumansky,
Agisoft LLC

jhead

  • Newbie
  • *
  • Posts: 7
    • View Profile
Re: Cluster Processing Assistance
« Reply #2 on: October 03, 2014, 12:54:58 AM »
Thanks for the quick reply Alexey.

Yeah I tried connecting with the network monitor but that also just sits there.
I do notice in the server console that it gets a ping but says something about there being no jobs or something.

I'll have a look when i get back to the office and update my post with what it actually says.

hni

  • Newbie
  • *
  • Posts: 3
    • View Profile
Re: Cluster Processing Assistance
« Reply #3 on: January 06, 2015, 01:42:15 PM »
Dear support,

On the same topic,

I've built a cluster and I guess it works because:
  • Network monitor shows nodes
  • Network monitor lists projects
  • Network monitor shows calculations progresses with no failures
  • Photoscan shows calculations progresses
  • Nodes and servers indicate their works ("key point partition loaded in 0.021124 sec", "matches saved in 0.557364 sec", etc. for nodes "received finished message", etc. for server)

Unfortunately, after calculation has finished, the client doesn't display any align picture. I tried do perform calculation directly in the client in order to see if it is a client problem, the calculation result displays perfectly.

Client is mac os x yosemite.
Server and nodes are ubuntu based.
They all access a shared network.

Could you please help me?

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 15465
    • View Profile
Re: Cluster Processing Assistance
« Reply #4 on: January 09, 2015, 05:10:13 PM »
Dear hni,

Could you please specify what happens after you close the processing dialog box on the client after the processing is finished?
At this step the data only begins to load to the client GUI from the shared folder, so it may take some time to transfer the data, especially if the project is large.
Best regards,
Alexey Pasumansky,
Agisoft LLC

hni

  • Newbie
  • *
  • Posts: 3
    • View Profile
Re: Cluster Processing Assistance
« Reply #5 on: January 10, 2015, 05:11:36 PM »
Thank you for your reply,

In fact, I do nothing special than waiting. Nothing happens.

And, even if I close Agisoft, open it and reload the project (*.psx) from the shared network, the left panel desperately shows 0 aligned images and nothing is displayed in the model view.

I know that the project (*.psx) has been updated by nodes because I can noticed changed timestamp on files on the shared network.

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 15465
    • View Profile
Re: Cluster Processing Assistance
« Reply #6 on: January 11, 2015, 05:54:17 PM »
Hello hni,

Maybe then you can zip .psx file with the related folders (like chunk0) and sen it to us (support@agisoft.com)? Probably there's really no aligned cameras?
Best regards,
Alexey Pasumansky,
Agisoft LLC

hni

  • Newbie
  • *
  • Posts: 3
    • View Profile
Re: Cluster Processing Assistance
« Reply #7 on: January 14, 2015, 01:24:51 AM »
Hello,

thank you again, I've just sent you an archive of the case by mail.

There should be aligned cameras because if a deactivate node clustering and I align camera directly in the client, cameras are aligned, and the result is displayed in the model view (I see cameras and angles).


Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 15465
    • View Profile
Re: Cluster Processing Assistance
« Reply #8 on: January 14, 2015, 06:51:17 AM »
Hello hni,

Thank you for sending the data. We'll check it on Mac, but opening the .psx on Windows results in correct visualization of the aligned cameras.
Best regards,
Alexey Pasumansky,
Agisoft LLC

mrthoms

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Cluster Processing Assistance
« Reply #9 on: July 03, 2017, 11:30:13 AM »
Good PM/AM sir! i have a similar problem regarding to cluster processing....i do have a pdf manual version but i can't follow the instructions(newbie here)...please can you elaborate the step by step instructions and how to connect the server to client(s) if by chance that you have a video tuts on how to do it please can you link it to me :D ...thanks in advance :D
« Last Edit: July 03, 2017, 11:35:45 AM by mrthoms »

mrthoms

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Cluster Processing Assistance
« Reply #10 on: July 03, 2017, 03:12:53 PM »
Update:
Now i can connect the clients from the server :D yayy... will check if the process will work later :D....my other concern is my network storage is a desktop computer which also my server (enabled sharing folder) my question is can a server also run a task together with the clients?

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 15465
    • View Profile
Re: Cluster Processing Assistance
« Reply #11 on: July 03, 2017, 03:27:59 PM »
Hello mrthoms,

You can run server and node instances on the same machine, but the system should be stable enough, since the server crash would lead to the loss of the current unsaved batches.
Best regards,
Alexey Pasumansky,
Agisoft LLC

mrthoms

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Cluster Processing Assistance
« Reply #12 on: July 04, 2017, 03:46:02 AM »
will i need to also execute the code for creating a node through cmd on my server? and if i have an ongoing task where can i see the ongoing task on my additional node? Do i need to run the software on all of my nodes and execute a task each? by the way thanks for the fast reply :D
« Last Edit: July 04, 2017, 05:13:27 AM by mrthoms »

Alexey Pasumansky

  • Agisoft Technical Support
  • Hero Member
  • *****
  • Posts: 15465
    • View Profile
Re: Cluster Processing Assistance
« Reply #13 on: July 04, 2017, 09:51:16 AM »
Hello mrthoms,

If you wish to run server and node instances of PhotoScan on the same computer, you need to do it from two separate terminal windows.

Server should be started first, before running the nodes in the network, as they will be trying to connect it.

Server is controlling the jobs and managing the nodes, if new node is added to the solution, server will check, if there's any task that can be sent to the new node.

The tasks themselves should be started from the client GUI, providing that the network preferences tab is filled correctly.
Best regards,
Alexey Pasumansky,
Agisoft LLC

mrthoms

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Cluster Processing Assistance
« Reply #14 on: July 04, 2017, 10:58:25 AM »
my cluster processing worked yay :D thanks to you i just finished one of my project and closed the connection...and right now i just re setup the process same server same nodes i'm successfully created a server but when setting up the nodes im getting an error of "cant connect to 192.XXX.XX.XXX...cant connect to server" :(