I finally managed to get a rig update... and what a CRAZY upgrade.
As part of the Dell Technologies ambassador program, I received a #DellProMax T2 tower equipped with an #NVIDIA RTX 6000, opening up so many opportunities!
What do you think I should try out first?
I spent the last 3 months putting together this handbook on #GaussianSplatting.
To be the first to grab your copy, subscribe to the XR AI Spotlight newsletter (link on top of my profile) and you will be the first to be notified when it is available.
To know more about all of the above, like the list of camera array tools or the 3DGenAI models that can generate 3DGS (and much more 😎), make sure to follow me and subscribe to the XR AI Spotlight newsletter.
xraispotlight.substack.com
- Use a "Synthetic" video generated by AI or even captured within a game itself... (like the workflow you see in the video that takes advantage of ANNX studio 😉)
- Take advantage of 3D #GenAI tools like Trellis, SAM3D or a "world model" like Marble from World Labs.
- Using camera arrays within a 3D tool like Blender, Unity or Unreal to capture images that are then processed via local or cloud-based tools
Synthetic #GaussianSplatting is one of the cool tech I cover in my upcoming handbook on 3DGS, and it turns out there are 3 ways to make them.
In the thread🧵
This tool to animate #GaussianSplatting is ONLY one of the 10 cool things I found last week. The rest is here 👉 xraispotlight.substack.com/p/rig-and-sk...
Hideo Kojima's next game will be in Augmented Reality and powered by Niantic's geolocalization system.
On which device do you think it's going to be?
After the announcement of the Meta Horizon Engine, I had to update my list of apps to experience #GaussianSplatting in #VR.
You can get the list by subscribing to my newsletter (link on top of my profile) and it is packed with apps, tools and tech demos to view 3DGS also on a #MetaQuest.
Did you miss the interview with Sam Cole, the founder of FitXR ?
Check it out here 👉 https://youtu.be/F42TINCu3l0
We discuss his #XR journey, the role #AI is playing in fitness and how he sees the 2 colliding.
This is @meshcapade.com and I had the chance to interview the founder, Naureen Mahmood right here 👉 https://open.substack.com/pub/xraispotlight/p/this-ai-tool-is-the-perfect-companion
The level of polish and the number of functionalities in this #mixedreality app for #Quest caught me off guard. It takes courage to invest in such a niche experience and pour so much love into it.
It's called Nailit!, it's free, and you should 100% try it.
And here goes the weekend 😅
I just received the Portal Cam from XGRIDS.
Time for a quick setup and some test runs before doing an in-depth coverage.
If you enjoy this type of content subscribe to my newsletter where I share a lot of this stuff 😉
xraispotlight.substack.com
Launch FastVLM (huggingface.co/spaces/apple...) freely available on Hugging Face and set the OBS virtual camera as input
Start OBS and set up a virtual camera that will capture the casting window. Here is a tutorial on how to do it:
www.youtube.com/watch?v=fj-Z...
To set it up, cast the Meta Quest view on the web or using the Meta Quest Developer Hub (for a wider field of view using the cinematic mode):
horizon.meta.com/casting/
FastVLM, is a Vision language model 85x faster and 3.4x smaller than anything before. It can understand both visual and text, it runs in real time, has the potential to be run on device.
machinelearning.apple.com/research/fas...
FastVLM from Apple enables real-time captioning, so I decided to "hook it up" to my #MetaQuest and test it in #Virtualreality and #Mixedreality.
Full set-up in the thread 🧵
Did you miss last week's conversation with Xiaobi Iris Pan, Lead XR AI Designer at Amazon?
xraispotlight.substack.com/p/designing-...
Every week I go through the coolest stuff you can learn from and test first hand. Here is the list 👉 substack.com/home/post/p-...
Do you want to learn more about Gaussian Splatting?
This is a great resource. Olli Huttunen is an authority in the space and he shares the best tools and practices to create and optimise 3DGS as well as facts that will change the way you look at splats
xraispotlight.substack.com/p/tools-work...
In this in-depth interview, we take a look behind the scenes of capturing 4D #GaussianSplatting and what it takes to experience corporate training, UFC fights, Runway shows, and more in #VR 👉 youtu.be/nSi54OHaJNU
#3DGS #volumetricvideo
I wrote a 19-page document with a comprehensive list of ALL WAYS in which you can get immersed in this type of photorealistic scenes on Quest or Vision Pro.
Just subscribe to my newsletter:
xraispotlight.substack.com
VR Chat adds support for Gaussian Splatting, but there are several better options I have collected in this list 👇
This is one of the updates, news and tech demos, hard to find anywhere else and included in my weekly roundup.
⚠️To make sure you receive this in your inbox join the waitlist here:
docs.google.com/forms/d/e/1F...
The tech demo in the video does an incredible job at visualising the differences between various models. Check it out yourself here:
www.360images.fr/3dgs/postsho...
I briefly discussed the different models for generating Gaussian Splatting (SPLAT3, MCMC and ADC) in my video comparing various 3DGS apps:
youtu.be/CrlSey4RmVI?...
This tool lets you compare the output of various models to generate 3DGS.
Link in the thread
