K-Planes: Explicit Radiance Fields in Space, Time, and Appearance

Sara Fridovich-Keil, Giacomo Meanti, Frederik Rahbaek Warburg, Benjamin Recht, Angjoo Kanazawa

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

We introduce k-planes, a white-box model for radiance fields in arbitrary dimensions. Our model uses (d2) (“d-choose-2”) planes to represent a d-dimensional scene, providing a seamless way to go from static (d = 3) to dynamic (d = 4) scenes. This planar factorization makes adding dimension-specific priors easy, e.g. temporal smoothness and multi-resolution spatial structure, and induces a natural decomposition of static and dynamic components of a scene. We use a linear feature decoder with a learned color basis that yields similar performance as a nonlinear black-box MLP decoder. Across a range of synthetic and real, static and dynamic, fixed and varying appearance scenes, k-planes yields competitive and often state-of-the-art reconstruction fidelity with low memory usage, achieving 1000x compression over a full 4D grid, and fast optimization with a pure PyTorch implementation. For video results and code, please see sarafridov.github.io/K-Planes.
Original languageEnglish
Title of host publicationProceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition
PublisherIEEE
Publication date2023
Pages12479-12488
ISBN (Print)979-8-3503-0130-4
ISBN (Electronic)979-8-3503-0129-8
DOIs
Publication statusPublished - 2023
Event2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops - Vancouver, Canada
Duration: 17 Jun 202324 Jun 2023

Conference

Conference2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops
Country/TerritoryCanada
CityVancouver
Period17/06/202324/06/2023

Fingerprint

Dive into the research topics of 'K-Planes: Explicit Radiance Fields in Space, Time, and Appearance'. Together they form a unique fingerprint.

Cite this