[P] A CUDA-free instant NGP renderer: Support real-time rendering and camera interaction and consume less than 1GB of VRAM.

Submitted by TaichiOfficial t3_zm8ohb in MachineLearning

Project repo: https://github.com/Linyou/taichi-ngp-renderer

Instant NGP is a novel view synthesis framework that reduces the model training for a single scene from hours to a few seconds.

This project is a CUDA-free instant NGP renderer implemented in Taichi. Supported by Taichi's built-in GUI system, the project supports real-time rendering and camera interaction while consuming less than 1GB of VRAM. It also contains a fully fused multilayer perceptron (MLP) enabled by the SharedArray feature.

The following are some pre-trained NeRF synthesis scenes:

https://preview.redd.it/kdlwzps1uy5a1.png?width=1236&format=png&auto=webp&s=f803745aa67f072bf04ebc178b5f0da8cabb3e77

138

Comments

You must log in or register to comment.

delight1982 t1_j0ajto0 wrote

Great work 👏 Taichi looks awesome

10

sneakpeekbot t1_j0akhtq wrote

Replying to TaichiOfficial (#934,560)

Here's a sneak peek of /r/taichi_lang using the top posts of all time!

#1: Taichi user theAfish simulates a non-rotating Schwarzschild black hole and its accretion disk via ray marching. Semi-implicit Euler method is used and general relativity involved to simulate the light paths. See source code: https://github.com/theAfish/BlackHoleRayMarching/blob/master/main.py | 1 comment
#2: A 10k-particle comet simulation, completed within 100 lines of Python code | 1 comment
#3: A classic Cornell box scene: Ray tracing rendered in Python and accelerated by Taichi | 3 comments

^^I'm ^^a ^^bot, ^^beep ^^boop ^^| ^^Downvote ^^to ^^remove ^^| ^^Contact ^^| ^^Info ^^| ^^Opt-out ^^| ^^GitHub

2

investigatingheretic t1_j0avnft wrote

Holy fucking shit man, you're doing god's work for the ambitiously industrious, yet computationally ret--uh.. challenged among us.

{this message was brought to you by my trusty old duo infernale, i7-3770 & GTX 660 Ti — and I will let you know that I finished Cyberpunk2077 with my brave little silicon stallion. Lowest possible settings in 1024x768, but it's about plot and worldbuilding amirite}
13

anymorenevermore t1_j0cybzz wrote

As a guy doing ML in a 3050 TI Mobile!!! I thank you

1

the_damian t1_j0e09je wrote

Definitely you made my day!

1

drinkscoffeedrinks t1_j0gqxbi wrote

Could you elaborate on how it's so much more performant than other versions?

1