The Director's Lens: An Intelligent Assistant for Virtual Cinematography
Lino , Christophe
Christie , Marc
Ranon , Roberto
Bares , William
- Publisher: HAL CCSD
Motion-Tracked Virtual Cameras | ACM : H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.5: Video (e.g., tape, disk, DVI) | Virtual Cinematography | [ INFO.INFO-MM ] Computer Science [cs]/Multimedia [cs.MM] | [ INFO.INFO-AI ] Computer Science [cs]/Artificial Intelligence [cs.AI] | [ INFO.INFO-GR ] Computer Science [cs]/Graphics [cs.GR] | ACM : H.: Information Systems/H.5: INFORMATION INTERFACES AND PRESENTATION (e.g., HCI)/H.5.1: Multimedia Information Systems/H.5.1.0: Animations | [ INFO.INFO-HC ] Computer Science [cs]/Human-Computer Interaction [cs.HC] | Cinematography | Virtual Camera Planning
International audience; We present the Director's Lens, an intelligent interactive assistant for crafting virtual cinematography using a motion-tracked hand-held device that can be aimed like a real camera. The system employs an intelligent cinematography engine that can compute, at the request of the fi lmmaker, a set of suitable camera placements for starting a shot. These suggestions represent semantically and cinematically distinct choices for visualizing the current narrative. In computing suggestions, the system considers established cinema conventions of continuity and composition along with the filmmaker's previous selected suggestions, and also his or her manually crafted camera compositions, by a machine learning component that adapts shot editing preferences from user-created camera edits. The result is a novel workflow based on interactive collaboration of human creativity with automated intelligence that enables effi cient exploration of wide range of cinematographic possibilities, and rapid production of computer-generated animated movies.