AbstractWith the advent of holographic near‐eye displays, the need for rendering algorithms that output holograms instead of color images emerged. These holograms usually encode phase maps that alter the phase of coherent light sources such that images result from diffraction effects. While common approaches rely on translating the output of traditional rendering systems to holograms in a post processing step, we instead developed a rendering system that can directly output a phase map to a Spatial Light Modulator (SLM).Our hardware‐ray‐traced sparse point distribution, and depth mapping enable rapid hologram generation, allowing for high‐quality time‐multiplexed holography for real‐time content. Additionally, our system is compatible with foveated rendering which enables further performance optimizations.