Maria Roszyk
← Work

Memories

Film a person on your phone, get a 3D model back, step into the scene.

  • Year2018
  • StackPhotogrammetry (Agisoft, Colmap, OpenMVS) · Blender · Unity + SteamVR · Python, C#
  • AwardCategory winner, Content Production, and HTC Vive prize; Creating Reality Hackathon, USC, March 2018
  • TeamreAnimators, five people; I captured the scenes and cleaned the meshes for rigging and Unity
  • LinksProject on DevpostAbout the hackathon
A photogrammetry portrait from the same capture pipeline

Memories was an open-source photogrammetry pipeline with a VR experience on top. You filmed a still scene or a person on a phone, uploaded the video to a self-hosted server, and got a 3D model back. Three scenes captured during the hackathon could then be entered in VR, one of them with a rigged, animated character made from a single smartphone video. To move between scenes you leaned into them.

I captured the scenes and the people and cleaned the meshes in Blender before rigging and import into Unity. The lesson the team took away, and that I still use, is that an early, low-fidelity proof of concept beats a complete toolkit when the clock is running.

Next: Code for Unexpected Events