Story Content

Vibe Coding XR research of Google has brought a new XR incredible concept, the one that allows anyone to create XR immersive experiences without having any connection to traditional code-writing skills.

The tool, based on Gemini and the open-source XR Blocks framework, can generate hand-crafted natural language utterances into a fully simulated WebXR to run on Android XR within less than 60 seconds, potentially including graphics and simulated physics.

These spatial experiences can be constructed by users right in the Chrome desktop simulators or on Android XR devices such as Samsung Galaxy XR. Complex spatial logic, multi-modal flows, and generative AI integrations are automatically tackled by the system, resulting in the extended reality development being available to developers, creators, and designers.

Some examples are interactive math tutors, physics laboratories, and chemistry modeling. XR Blocks is an open-source framework that serves as the free web-based demo of the workflow xrblocks.github.io/gem. It is a key move towards the democratization of spatial computing and faster innovation of AI + XR.

This innovation is based on the expanding trend of the so-called vibe coding, wherein high-level intent is substituting low-level programming throughout the AI instruments of Google.