looking to get out of creating virtual 3D worlds with a model. NVIDIA says GET3D can create characters, buildings, vehicles, and other types of 3D objects. Models can also create shapes quickly. The company notes that GET3D can generate about 20 objects per second using a single GPU.
The researchers trained the model using composite 2D images of 3D shapes taken from multiple angles. NVIDIA says it took just two days to feed about 1 million images into GET3D using the A100 Tensor Core GPU.
Models can create objects with “high-fidelity textures and intricate geometric details”, NVIDIA’s Isha Salian . The shapes GET3D creates “have the form of a triangular mesh, like a papier-mâché paper model, covered with textured material,” Salian added.
Users will be able to quickly import objects into the game engine, 3D modeler, and movie renderer for editing, as GET3D will generate them in compatible formats. That means it’s much easier for developers to create dense virtual worlds for games and metaverses. NVIDIA cited robotics and architecture as other use cases.
Based on a training dataset of car images, GET3D can generate sedans, vans, race cars, and vans, the company says. It can also transform into foxes, rhinos, horses and bears after being trained in animal images. As you might expect, NVIDIA notes that the larger and more diverse the training set fed into GET3D, the “more rich and detailed the output.”
With the help of another NVIDIA AI engine, , different styles can be applied to an object with text-based prompts. You can apply a burnt look to a car, convert a model of a house into a haunted house or, as a tech demo video suggests, apply tiger stripes to any animal. any.
The NVIDIA team that created GET3D believes that future versions can be trained based on real-world images rather than synthetic data. It is also possible to train the model on many different types of 3D shapes at the same time, instead of having to focus on one type of object at a time.
All products recommended by Engadget are selected by our editorial team, independent of our parent company. Some of our stories include affiliate links. If you buy something through one of these links, we may earn an affiliate commission. All prices are correct at time of publication.