We propose a set of ML methods for freely integrating live-action volumetric video with hand-drawn volumetric animation. The Kinect, the first consumer depth camera, arrived in 2010; in 2016, the HTC Vive headset introduced the first mass-market 6DoF controllers. Combined, these two advances unlocked a new approach to creating frame-by-frame animation with 6DoF drawing tools, which our research develops as the Lightning Artist Toolkit (Latk)—a complete pipeline for hand-drawn volumetric animation.
