VFX with GS

I recently tried combining Gaussian Splatting with VFX.

The original model was sculpted with clay and painted by hand, then captured through 3D scanning.

One of the challenges I ran into was background removal. The results from my original scanning workflow weren’t very clean, so I tried using AI-based background removal instead — and surprisingly, it worked really well. I feel like this kind of practical problem-solving is where AI can be especially useful.

For the interactive part, I passed the mouse position into VFX Graph and used it to affect the Gaussian Splats in real time, creating some simple interactive effects. It was a nice experiment in exploring how Gaussian Splatting can be combined with real-time VFX and interaction.

There were quite a few technical challenges along the way, but fortunately, everything worked out in the end.

It was a really interesting experiment, and I’m happy with how it turned out.

Keijiro’s Splat VFX project was a huge inspiration for this experiment. Thank you!