Agisoft Metashape

Agisoft Metashape => Face and Body Scanning => Topic started by: Yukihiro Iwayama on October 17, 2019, 02:08:31 PM

Title: Image Dataset of Full Body 88 images for 3D Scan
Post by: Yukihiro Iwayama on October 17, 2019, 02:08:31 PM
I’m releasing image dataset of full body scan Photogrammetry.

https://github.com/HappyOcean/Full_Body_Photogrammetry (https://github.com/HappyOcean/Full_Body_Photogrammetry)

(https://www.real-avatar.com/img/dataset_sample.png)
dataset sample

88 images - 8MP, Raspberry Pi Camera Module v2

One of the reconstructed and textured resulting 3D model is skfb.ly/6NUVq (http://skfb.ly/6NUVq) on Sketchfab
(https://www.real-avatar.com/img/YukihiroIwayama_Sample_Model.png)
Yukihiro_Iwayama_Full_Body_Photogrammetry

Directly uploaded from RealityCapture no modification in other 3D software.

Needless to say, you can use these images Metashape. the initial choice was just due to my convenience at this moment. I use Metashape as well though I'm new to this forum.

Free to download and use. Give credit to : Yukihiro Iwayama : https://twitter.com/HappyOcean, Yukihiro Iwayama : https://www.facebook.com/yukihiro.iwayama

Hope this could contribute as some sort of reference data set especially for those who are not quite familiar but are interested in body scan.

There is too little of this kind of full image date set for A Pose Human. Personally, I haven’s seen it that’s why I release.
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Yukihiro Iwayama on October 17, 2019, 02:10:20 PM
Retopology by Wrap3
https://skfb.ly/6NWU8
(https://www.real-avatar.com/img/Retopology_Wrap3_Yukihiro_Iwayama.png)
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 17, 2019, 06:28:55 PM
Thanks for sharing. Unfortunately Metashape is really bad with those kinds of data-sets compared to Reality Capture. There's no way to get anything good out of without  masking every single photo (even though camera alignement is perfect Metashape is unable to detect enough feature on the subjects to properly reconstruct it. 80% of the Tie Points are on the background.

(https://i.postimg.cc/YShsQZbY/Annotation-2019-10-17-172615.jpg)

(https://i.postimg.cc/BQSNxRvb/Annotation-2019-10-17-172732.jpg)

Maybe Alexey can help...

Mak
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Yukihiro Iwayama on October 17, 2019, 07:21:53 PM
Mak, Thank you for your testing and feedback as I was doing my way and getting nowhere. I'll try masking, I guess that the upper body could be challenging anyway.
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 17, 2019, 07:31:03 PM
Yukihiro,

Yeah this is literately one of the situation where Reality Capture is simply unbeatable. For whatever reason Metashape (& Photoscan before) simply can't get those type of scans right unless masking is used. Unlike RC which doesn't require anything to get a superbe mesh. 😒🤨

You should email Alexey & the Agisoft team at support@agisoft.com and maybe asked them what would be the best way to get anything out of this data set.

Cheers

Mak
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Alexey Pasumansky on October 17, 2019, 08:20:09 PM
Thanks for sharing. Unfortunately Metashape is really bad with those kinds of data-sets compared to Reality Capture. There's no way to get anything good out of without  masking every single photo (even though camera alignement is perfect Metashape is unable to detect enough feature on the subjects to properly reconstruct it. 80% of the Tie Points are on the background.
That's what I've got using depth maps based reconstruction (no masks applied).

Although I see some defects, they are not so severe, like on your screenshots.

Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 17, 2019, 08:42:15 PM
Alexey,

Can you share your settings ?

Here are mine (depth maps method with no masks):

(https://i.postimg.cc/QM7JW8ST/Body.jpg)

And here's with everything on medium:

(https://i.postimg.cc/wMW9cdFX/body-medium.jpg)

Cheers

Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 18, 2019, 10:49:57 AM
Alexey,
I've tried again with different settings and still can't get anything close to what you are getting. :(

Cheers

Mak
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: bestable on October 18, 2019, 12:49:44 PM
Me neither. I would like to see detailed walkthrough.. For now it seems that reality capture performs a lot better.
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 18, 2019, 04:30:26 PM
Glad to know that I'm not the only one unable to get anything usable.
Would really like to know which settings Alexey used.

Another failed attempt..

(https://i.postimg.cc/v8XdpPjr/highii.jpg)

Cheers

Mak
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Alexey Pasumansky on October 18, 2019, 08:23:13 PM
Hi,

The steps that I have followed:
- aligned using High accuracy, no preselection, 40 000 / 10 000 for point limits,
- detected markers,
- optimized the camera alignment,
- build mesh (High quality) for the whole (default) area,
- reduced the bounding box to the area of interest and re-built mesh have re-use depth maps option enabled.
After the reconstruction used Smooth Mesh operation to reduce the slight noise on the surface.
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: bestable on October 18, 2019, 08:27:11 PM
Any workflow for Standard version users?
I feel left out a bit.
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 18, 2019, 08:28:46 PM
Hi,

The steps that I have followed:
- aligned using High accuracy, no preselection, 40 000 / 10 000 for point limits,
- detected markers,
- optimized the camera alignment,
- build mesh (High quality) for the whole (default) area,
- reduced the bounding box to the area of interest and re-built mesh have re-use depth maps option enabled.
After the reconstruction used Smooth Mesh operation to reduce the slight noise on the surface.

Thanks Alexey

Detected Markers ? Isn't this Pro only feature ?

Cheers

Mak
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: bestable on October 18, 2019, 09:03:34 PM
That is my progress pics of the described workflow except i did not use "detected markers" part:

(https://i.imgur.com/OaucAzu.gif)
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 18, 2019, 09:18:30 PM
Alexey,

Getting better results (the trick was obviously to generate the mesh once for the whole volume to get as much depth maps as possible before resizing it down..& re-using the depth maps..)

As usual the mesh is plagued by the same issues as introduced in 1.5.1 (holes, unwanted polys inside, non connected polys etc)

This is with main/mesh_trimming_radius : 0

(https://i.postimg.cc/br2MRCpK/Annotation-2019-10-18-201004.jpg)

(https://i.postimg.cc/Dwg2sZC1/Annotation-2019-10-18-201031.jpg)

main/mesh_trimming_radius : 30

(https://i.postimg.cc/y6M9pQ7v/Annotation-2019-10-18-202025.jpg)

(https://i.postimg.cc/gj8wPpG4/Annotation-2019-10-18-201957.jpg)

Cheers

Mak
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Alexey Pasumansky on October 18, 2019, 09:37:42 PM
Yes, detect markers is available in Pro only. But you can try to optimize the alignment even in Standard edition.

I've used that due to the workflow description on the model's page on Sketchfab:
Quote
Import

Align -> Detect Markers -> Align 2 times

Set reconstruction region around the subject.

Reconstruction : Normal

Close Holes -> Clean Model

Simplify -> Smooth

And I have removed any trimming radius related tweaks prior to the processing the mesh. Used pre-release of 1.6.0 though.
Title: Re: Image Dataset of Full Body 88 images for 3D Scan
Post by: Mak11 on October 18, 2019, 09:46:33 PM
Yes, detect markers is available in Pro only. But you can try to optimize the alignment even in Standard edition.

I've used that due to the workflow description on the model's page on Sketchfab:
Quote
Import

Align -> Detect Markers -> Align 2 times

Set reconstruction region around the subject.

Reconstruction : Normal

Close Holes -> Clean Model

Simplify -> Smooth

And I have removed any trimming radius related tweaks prior to the processing the mesh. Used pre-release of 1.6.0 though.

Yes, missing the detect markers feature doesn't seem to be that big of an issue here.

BTW I'm testing on Build 1.6.0 build 9217.

The fact that the algorithm still insists on creating unwanted polys when there isn't enough depth data is still the most annoying thing ever...I would literately be happy with a simple hole in the mesh (or how it was handled pre-1.5.1) instead  of this mess which is a real pain to clean up afterwards in 3DCoat/Zbrush. 

Cheers