Nvidia has launched GauGAN360, which is a new experimental online art tool that turns rough sketches into 360° HDR environments which can be used in 3D scenes.
The tool is based on the same technology as Nvidia’s original GauGAN artificial intelligence-based painting app. It allows users to paint the overall form of a landscape and have GauGAN360 generate a matching equirectangular image or a cube map. It can also turn quick doodles into synthetic 360° environments for use in 3D scenes.
Nvidia introduces GauGAN360 as the next evolution of its popular AI painting app, GauGAN. Launched in 2019, GauGAN uses an artificial intelligence model based on Generative Adversarial Networks to generate photorealistic images matching rough sketches from the users.
GauGAN does pretty much the same thing as GauGAN360. However, instead of a conventional 2D image, the result is an equirectangular image or a cube map that can be used as an environment map inside 3D software.
Workflow in GauGAN360 is similar to GauGAN. Users can paint the rough form of the image they want to generate onto the online template with the click of a button. AI does the rest. Different brush colors represent different landscape elements, and there are 25 available. The elements are divided into ground elements like mud, sand, land, sky, plants, etc.
The controls are pretty basic. There is a choice of three brush shapes and a brush size slider to generate images from very quick doodles. Users can also upload an actual image to use as a source. GauGAN360 will generate a synthetic image with the same overall composition as the original.