Memories
Film a person on your phone, get a 3D model back, step into the scene.
- Year2018
- StackPhotogrammetry (Agisoft, Colmap, OpenMVS) · Blender · Unity + SteamVR · Python, C#
- AwardCategory winner, Content Production, and HTC Vive prize; Creating Reality Hackathon, USC, March 2018
- TeamreAnimators, five people; I captured the scenes and cleaned the meshes for rigging and Unity
- LinksProject on DevpostAbout the hackathon

Memories was an open-source photogrammetry pipeline with a VR experience on top. You filmed a still scene or a person on a phone, uploaded the video to a self-hosted server, and got a 3D model back. Three scenes captured during the hackathon could then be entered in VR, one of them with a rigged, animated character made from a single smartphone video. To move between scenes you leaned into them.
I captured the scenes and the people and cleaned the meshes in Blender before rigging and import into Unity. The lesson the team took away, and that I still use, is that an early, low-fidelity proof of concept beats a complete toolkit when the clock is running.