Messages

1

Python and Java API / Speed up my Metashape process, any solution?

« on: July 19, 2022, 07:04:50 PM »

Hi everyone!

I'm working with metashape and python, and I'm trying to speed up a little my script, because I have to process 1 milion point.
Considering the impossibility to multiprocess or parallelize my process inside Metashape, where I extract 2d coordinates from the best camera for eny 3d coordinate. I was thinking to extract in some kind of way all the parameters of any camera inside the program to use these to make the projection of eny single 3d point out from the metashape program, and maybe speed up a little everything. what do you think about this possibility? Do you have any Script advice to help me?

Thnak you in advance for your time.
Best regards
Emanuele

2

Python and Java API / Re: Cannot achieve multi-threading with concurrent.futures.ThreadPoolExecutor

« on: July 14, 2022, 02:57:06 PM »

Hi, dobedobedo,

Have you solved your problem? I have a similar one and I'd like to see how you solved the situation... I'm really stack...

In case,
thank you in advance.

Best regards.
Emanuele

3

Python and Java API / Speed up metashape process - multiprocessing or other multicore/thread methods

« on: July 14, 2022, 02:46:12 PM »

Dear everyone,

I have a little question about how Python and Metashape works.
I have a problem, because I have to speed up a script which extract coordinates for any selected point in Metashape, but it needs like 27 days to run across 1 milion points.
For this reason I was wondering if you know a way to multiprocess everything and speed up a little the process.
I have already splitted  my dataframe in several parts, to call it in different functions, and I tried with asyncio to see if the process was speeding up a little but nothing. So I was wandering if multiprocessing package was a good solution. Unfortunately until now it gives me always an error:

Traceback (most recent call last):
  File "C:/Users/eepi0002/PycharmProjects/train/Proiection_asyncio.py", line 207, in <module>
    tree_array1.start()
  File "C:\Users\eepi0002\AppData\Local\Programs\Python\Python38\lib\multiprocessing\process.py", line 121, in start
    self._popen = self._Popen(self)
  File "C:\Users\eepi0002\AppData\Local\Programs\Python\Python38\lib\multiprocessing\context.py", line 224, in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "C:\Users\eepi0002\AppData\Local\Programs\Python\Python38\lib\multiprocessing\context.py", line 326, in _Popen
    return Popen(process_obj)
  File "C:\Users\eepi0002\AppData\Local\Programs\Python\Python38\lib\multiprocessing\popen_spawn_win32.py", line 93, in __init__
    reduction.dump(process_obj, to_child)
  File "C:\Users\eepi0002\AppData\Local\Programs\Python\Python38\lib\multiprocessing\reduction.py", line 60, in dump
    ForkingPickler(file, protocol).dump(obj)
TypeError: cannot pickle 'Metashape.Metashape.Camera' object

Do you have any Idea?
Thank you in advance.
Best regards.
Emanuele Papucci.

4

Python and Java API / Chunk.analyzePhotos() to evaluate the quality of my images?

« on: June 24, 2021, 05:33:33 PM »

Hi everyone,

Sorry for bother you again, I have a problem with this script to evaluate images quality, because the name and method are changed over the versions of this program, and now I didn't find any good example to help me understand how to use this command better:

This is a for cycle, I just post the final part of the script where is the problem... because I don't know how to use this Metashape command.
The principal problem is this analyzePhotos that doesn't work, in fact, I made several try but every time this function give me a None result, and if I use float he tell me that I can't use this function because the data it's a none type, and this is normal...

Someone can help me to understand? thank you in advance,
Best regards.

Code: [Select]


                  if dist < mindis:
            mindis = dist
            mincam = camera
            mincam.label = camera.label  # camera with min distance to Principal Point
            selcam.append(mincam)  # append all the important parameters in a list of lists.
            plt.show()

    mincam.selected = True
   
    for IMAGE in selcam:
       
        if float(Metashape.Chunk.analyzePhotos(chunk, IMAGE)) < 0.7:
             print("IMAGE")


         

5

Python and Java API / Re: Crop single camera image, using a polygon with Python.

« on: June 08, 2021, 11:12:45 AM »

Hi,

thank you for reply to me,

seems very good, with this I think to conclude my script!
Thank you for your help!

6

Python and Java API / Crop single camera image, using a polygon with Python.

« on: June 07, 2021, 05:37:31 PM »

Hi everyone,

I'm sorry, I have a big problem, and after 2 days of research into this forum, I decide to ask directly a possible solution of this problem.

I need to crop a part of a camera image that I selected, using a polygon and save it, the problem is that I don't understand how make this crop.

this is part of my script, that I need to complete, there is someone that can help me?

Thank you in advance for your help!
Best regards.

   

Code: [Select]

          #starting work with single tree:
    tree = []
    def find_tree(trees, x):
        count = 0
        for char in trees:
            if char[0] == x[0]:
                print(True)
                point = Metashape.Vector(char[1])  # point of interest
                a = T.inv().mulp(crs.unproject(point))
                b = mincam.transform.inv().mulp(a)
                coords_2D = mincam.sensor.calibration.project(b)
                tree.append(coords_2D)
                count = count - count
            elif char[0] != x[0]:
                # print(False)
                count += 1
                if count == 200:
                    print(count)
                    return tree


    tree1 = find_tree(trees, x)
    print(tree1)

    # crop of the selected images for single chunk:

    img = mincam.image()
    if img.data_type == 'U8':
        ext = '.jpg'
        dtype = numpy.uint8
    if img.data_type == 'U16':
        dtype = numpy.uint16
        ext = '.tif'
    if img.data_type == 'F32':
        ext = '.tif'
        dtype = numpy.float32

    # for x in tree1:
    #     print(x)

    poly = Metashape.Geometry.Polygon(tree1)
    print(poly)

    tree_final = []
    # list_of_vectors = [(v.x, v.y) for v in tree1]
    for v in tree1:
        tree_final.extend([[v.x, v.y]])
    print(tree_final)

    narr = np.array(tree_final)
    print(narr)
   

7

General / Re: Back-projection of 3D points into images

« on: June 07, 2021, 10:18:54 AM »

Perfect, it's work!

Thank you very much! I didn't know that v.x and v.y could be vectors coordinates!

8

General / Re: Back-projection of 3D points into images

« on: June 04, 2021, 05:05:57 PM »

Hi everyone,

when I obtain the coords2D, that in my case I insert in a list, these have type: Metashape.vector(coord2D). I would like to use these coord for make a polygon, but I don't understand how to extract a list of only int/float coord without this vector type. Do you have any Idea about solve this problem?

Thank you in advance for who will answer!

ps. this is an example of the list that I obtain:

[Vector([4487.467456499467, 4724.472068038938]), Vector([4491.722834552519, 4723.479952075152]), Vector([4496.532831576831, 4721.955053350271]), Vector([4484.4644832271515, 4724.819504895852]), Vector([4488.020088719773, 4723.997431237368]), Vector([4496.612417644212, 4722.017372068412]), Vector([4496.266248244279, 4722.790323937209]), Vector([4490.26616917476, 4721.596411398969]), Vector([4489.307185386602, 4729.175754631007]), Vector([4498.092177685087, 4726.549650712506]), Vector([4492.830413054364, 4728.494083066204]), Vector([4500.063634090015, 4727.286639288784]), Vector([4495.175886426696, 4723.516960399526]), Vector([4491.574518970151, 4724.528124771405]), Vector([4491.375263337253, 4725.067263233492]), Vector([4498.619344435478, 4723.281060767815]), Vector([4498.626978572264, 4723.941696509445]), Vector([4502.134831922718, 4723.0413444295245])]

9

Python and Java API / Create a buffer shape mask around a marker to cut off and save an image/camera.

« on: March 24, 2021, 03:24:26 PM »

Hi everyone,

I return here, to ask a second question for my project. In fact now, I have a working algorithm that give me a list of best image for each 3d mark convert in 2d coordination. You can see the script below. Now ne problem is if it's possible sing the camera that I found with the algorithm to cut off for each camera of interest a piece of the best image. For do this I need to use My 2d coordinate for each mark, and create a buffer shape mask to use for cut off the selected image.

My working script for now it's this:

Code: [Select]

import Metashape
import csv


path = "I:/Backsjon190527/save_progress/"
doc = Metashape.Document()
doc.open(path + "Finale.psx")
chunk = doc.chunk
crs = chunk.crs
T = chunk.transform.matrix
print(crs)


csvfile = 'I:/Backsjon190527/save_progress/hs1.csv'
def ReadCSVasList(csvfile):
    try:
        with open(csvfile) as csv_file:
            reader = csv.reader(csv_file, dialect='excel')
            datalist = []
            datalist = list(reader)
            return datalist
    except IOError as err:
            print("I/O error({0})".format(err))


csv_data_list = ReadCSVasList(csvfile)
print(csv_data_list)
# To Ignore 1st Element (Headers)
csv_data_list.pop(0)
print(csv_data_list)

result = []

for x in csv_data_list:
        x.pop(0)
print(csv_data_list)

for i in range(0, len(csv_data_list), 1):
   result.append(list(map(float, csv_data_list[i])))

print(result)

selcam = list()

for x in result:
    ## script to find the best image near each marker in the Vector list.
    P = Metashape.Vector(x)  # point of interest in geographic coord
    mindis = 1e09
    # P = Metashape.Vector((459307.345426, 7192625.624622, 158.808)) # vector with X,Y,Z coordinates of point in same CRS as chunk ( I need to understand )
    cam_dist_P = {}  # dict containing  distance in pixels of P to each camera Principal Point

    for camera in chunk.cameras:
        sensor = camera.sensor
        w = sensor.width
        h = sensor.height
        cx = sensor.calibration.cx  # Principal point coordinates x
        cy = sensor.calibration.cy  # Principal point coordinates y
        if not camera.project(T.inv().mulp(chunk.crs.unproject(P))):  # check if projected Point within sensor size
            continue
        xp = camera.project(T.inv().mulp(chunk.crs.unproject(P))).x  # Prrojected point coordinates x
        yp = camera.project(T.inv().mulp(chunk.crs.unproject(P))).y  # Prrojected point coordinates y
        if xp < 0 or xp > w or yp < 0 or yp > h:  # check if projected PointI within sensor size
            continue
        dist = (camera.project(T.inv().mulp(chunk.crs.unproject(P))) - Metashape.Vector(
            (w / 2 + cx, h / 2 + cy))).norm()  # distance in pixels from projected point and P
        cam_dist_P[camera.label] = dist
        if dist < mindis:
            mindis = dist
            mincam = camera  # camera with min distance to Principal Point

    selcam.append(mincam)
        # for image in mincam:


        # Metashape.ModelKeyPoint(Metashape.PointCloud.renderImage(selcam), x)


    print(mincam)

    mincam.selected = True


print(selcam)


This script give to me this result:

[<Camera '100_0015_0047'>, <Camera '100_0015_0047'>, <Camera '100_0015_0048'>, <Camera '100_0015_0036'>, <Camera '100_0015_0036'>, <Camera '100_0015_0049'>, <Camera '100_0015_0048'>, <Camera '100_0015_0046'>, <Camera '100_0015_0046'>, <Camera '100_0015_0040'>, <Camera '100_0015_0047'>, <Camera '100_0015_0045'>, <Camera '100_0015_0040'>, <Camera '100_0015_0040'>, <Camera '100_0015_0046'>].

For the new problem I found on the metashape python reference manual some probably use full commands like these:

Code: [Select]

# c = Metashape.ImageCompression()
# c.jpeg_quality = 50
# chunk.cameras[mincam].image().save(path + fr"{test50}.jpg", c) #create a loop for new file names saving for each cutted image.
Metashape.Mask

# new_shape = chunk.shapes.addShape() #create a new mask shape to cut off a chunk of the selected photo.
# new_shape.type = Metashape.Shape.Polygon
# new_shape.has_z = False
# new_shape.center = [xxx] #center for the new shape?


Someone can give me some advice, or have any Idea to how continue this work?
Thank you in advance to who will help me!
Best regards,
Emanuele.

10

Python and Java API / Re: Projecting from 3D point coordinates to the best areal camera/image, save that.

« on: March 22, 2021, 10:51:36 AM »

Ah, oh my god, thank you so mutch! I'm sorry do not undestand before! I'm just a beginner in python, so a lot of things are really difficult for me! But thank you very mutch!

11

Python and Java API / Re: Projecting from 3D point coordinates to the best areal camera/image, save that.

« on: March 19, 2021, 07:02:03 PM »

Hi Paulo,
thank you for answer me!

Probably the script can help me! The only problem is that before I find the best image per marker, I need to project the 3D coordinates for that point to 2D coordinates. So I can use 2D coordinates to find the best image and cut off a buffer of that around the marker. But the script you give me, need vector with 3 coordinates to work. Do you think there is a method to use 2D coordinates point? Or in alternative, Do you think can be better try to use 3D coordinates to find the best Image and then transform that in 2D coordinates?... What do you think?

Thank you again for your help!
Best regards,
Emanuele.

12

Python and Java API / Projecting from 3D point coordinates to the best areal camera/image, save that.

« on: March 19, 2021, 01:00:22 PM »

Hello everyone,

I start a project where I need to project some 3D coordinates ( that I don't have on metashape, but in a csv.file) on 2d areal camera/image using python linked to a metashape project. Then I need to cut off and save the best areal image were each point is projected, so I will have a folder with all the best image of the single point in the map.

Someone can help me?

I started using this script that I saw in another post here in the forum:

Code: [Select]

import Metashape, math, csv

path = "I:/Backsjon190527/save_progress/"
doc = Metashape.Document()
doc.open(path + "Finale.psx")
chunk = doc.chunk
crs = chunk.crs
print(crs)

# export format:
# point_ID X Y Z
# [camera_label x_proj y_proj]

M = chunk.transform.matrix
point_cloud = chunk.point_cloud
projections = point_cloud.projections
points = point_cloud.points
npoints = len(points)
print(npoints)
tracks = point_cloud.tracks



path1 = Metashape.app.getSaveFileName(path + 'New.csv',
                                     filter="Text / CSV (*.txt *.csv);;All files (*.*)")
file = open("New.csv", 'wt')

print("Script started...")

point_ids = [-1] * len(point_cloud.tracks)
for point_id in range(0, npoints):
    point_ids[points[point_id].track_id] = point_id
points_proj = {}

for photo in chunk.cameras:

    if not photo.transform:
        continue
    T = photo.transform.inv()
    calib = photo.sensor.calibration

    for proj in projections[photo]:
        track_id = proj.track_id
        point_id = point_ids[track_id]

        if point_id < 0:
            continue
        if not points[point_id].valid:  # skipping invalid points
            continue

        point_index = point_id
        if point_index in points_proj.keys():
            x, y = proj.coord
            points_proj[point_index] = (points_proj[point_index] + "\n" + photo.label + "\t{:.2f}\t{:.2f}".format(x, y))

        else:
            x, y = proj.coord
            points_proj[point_index] = ("\n" + photo.label + "\t{:.2f}\t{:.2f}".format(x, y))

for point_index in range(npoints):

    if not points[point_index].valid:
        continue

    coord = M * points[point_index].coord
    coord.size = 3
    if chunk.crs:
        # coord
        X, Y, Z = chunk.crs.project(coord)
    else:
        X, Y, Z = coord

    line = points_proj[point_index]

    file.write("{}\t{:.6f}\t{:.6f}\t{:.6f}\t{:s}\n".format(point_index, X, Y, Z, line))


file.close()
print("Finished")
This code probably is not good for what I want to do...

Thank you in advance for who will help me!
Best regard.
Emanuele.

13

Python and Java API / Re: Changing coordinate system on all cameras

« on: March 18, 2021, 12:57:57 PM »

Hi Alexy, thank you for your support!

I made the wrong question probably before, so I need to ask you now another thing.

What I mean is: How I can get the vector coordinates normally? Because I work in pycharm so I usually don't open Agisoft Metashape for this elaborations.

So, my question is, if I need to change e camera and project crs, where I can find vector coordinates? In more, I tried both the method, but when I open for check agisoft and the project, and I go on the calculator icon on reference, I see that the crs is not change! It is normal?
Sorry for the questions, I want only understand how to work this things!

14

Python and Java API / Re: Changing coordinate system on all cameras

« on: March 17, 2021, 06:59:49 PM »

I'm sorry, I don't understand well the Vector part! what are X, Y, Z and where I can find these, for example in an opened project with metashape?

Because I trying to change the crs by scripts on a Metashape project, but I don't understand this part! I'm sorry for bother!

Thank you in advance,
Best regards,
Emanuele.