Mark Zuckerberg can still explain What exactly is a metaverse, but the CEO of Meta just introduced another technology that he thinks will be crucial to the company’s vision of creating immersive environments. Meta AI researchers are working on a voice-enabled bot that will allow users to change their virtual environment with voice commands.
Zuckerberg introduced the first version of this concept, called the Builder Bot, at a virtual event details the company’s latest AI research.
“It allows you to describe a world and then it creates aspects of that world for you,” Zuckerberg said. In his demo, he and another Meta employee used voice commands to create a very basic beach scene with picnic tables, clouds and, yes, Zuckerberg’s. signature hydrofoil. They also added some sound effects of seagulls and ocean waves.
For now, however, the technology seems to be at a relatively early stage. The environment Zuckerberg created looks flatter and has a much lower resolution than previous metaverse demos, although his legless avatar is present just like other recent demos. “As we advance this technology further, you will be able to create nuanced worlds to explore and share experiences with others with just your voice,” he said.
The construction bot is part of a larger AI project called Project CAIRaoke that aims to create the kind of conversational AI needed to create these virtual worlds. Facebook isn’t the first to experiment with this type of research. OpenAI introduced a neural network capable of generating last year. But Zuckerberg says the CAIRaoke project will be central to Meta’s future.
“In the metaverse, we will need AI built around helping people navigate our virtual world as well as our physical world with augmented reality,” Zuckerberg said. “When we put glasses on our faces, it will be the first time that an AI system can actually see the world from our perspective: See what we see, hear what we hear and more .”
Zuckerberg’s comments come as he’s trying to pivot the company from social media to metaverse technology, a move that has so far proven to be a major hit. . But when Facebook’s core service started losing users for the first time, Zuckerberg said the experience was “super reverse” like the company’s VR. will drive future growth.
All products recommended by Engadget are handpicked by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission.