Remove duplicate images

[magic]

Hi Alexey
Few days ago iv tried this script to remove all duplicate images from my workspace with works well with low number of images :

Code: [Select]

import PhotoScan, os

chunk = PhotoScan.app.document.chunk
print("start")
photos = set()
for camera in list(chunk.cameras):
      if camera.photo.path in photos:
             chunk.remove(camera)
      else:
             photos.add(camera.photo.path)

Problem starts when after few actions like merge etc and several chunks from 60k cameras I go up to 300k(all doubles) and when I tried to started this script its was like turning about 4 hours  without any results , then iv breaked it , takes to long time, did it is possible to optimize this script and get it run faster ?? Iv tried few others(similar pythons scripts) method but no one of them works with PS. Did we vgot some solution Alexey or we cant do it together with PS??

[Alexey Pasumansky]

Hello magic,

You can add the camera instances to be removed to the list and then, after the iteration is finished) pass this list to chunk.remove() function.

[magic]

Ok thx will check it next Tuesday,
Have a fun and happy new year

[magic]

Hi Alexey
I cant figured this out Alexey, have to make a list and then go to those list and deleting images in ?

Code: [Select]

import PhotoScan, os

chunk = PhotoScan.app.document.chunk

for camera in chunk.cameras:
    li = ()
    for camera in li:
         chunk.remove(photos)
else:
   
    photos.add(camera.photo.path)


[magic]

Did You can check it Alexey please still have some error at the end of my script

Code: [Select]

import PhotoScan, os

chunk = PhotoScan.app.document.chunk

photos = set()

for photos in list(chunk.cameras):
    print(photos)  #over here i print all my list photos ,think so its ok
    if camera.photo.path in photos:  #<<<<I'v got an error- argument is not iterable
 
        chunk.remove(photos)

    else:
        photos.add(camera.photo)
Why before that worked and now error coming out , what I do wrong Alexey

[Alexey Pasumansky]

Hello magic,

Please try this one:

Code: [Select]

import PhotoScan, os

chunk = PhotoScan.app.document.chunk
print("start")
paths = set()
photos = list()
for camera in list(chunk.cameras):
      if camera.photo.path in paths:
             photos.append(camera)
      else:
             paths.add(camera.photo.path)

chunk.remove(photos)
print("finished. %d duplicates removed" % len(photos))

[magic]

Hi Alexey
Works better now
Thanks a lot