Real Moving objects to virtual 3d engine

[barrubba]

I already have a lot of experience in photogrammetry and 3d rendering.
A client asked me something unique for my experience.
He wish to transform a real moving subject (a singer) into an animated 3d model, to be imported into a virtual environment where the fans with virtual devices like Oculus, can go near the artist while singing.
I have already pro equipment like greenscreen, cameras and camcorders, but I have no idea how to detect the moving subject in 3d point cloud and than animated geometry.
Thank you