The 3D graphics card company Nvidia recently released this mind-bending bit of research, developed in conjunction with some of the University of California, Berkeley, team behind the best dance video of the year. It’s a driving simulator that allows you to pilot a car through a city. Why is that a big deal? Because that city, from its buildings to its streets to its cars, is being created in real time by AI.
Like most AI that generates images, the software was taught on a training set. It learned from driver camera footage of vehicles moving through several major cities. This footage was segmented, meaning that it was labeled with “car” or “tree” so the AI could learn to identify details. And by sheer repetition, it gradually learned what these items should look like and where they should go. Then, as is customary in machine learning, two algorithms duked it out, drawing these items and attempting to fool one another with their forgeries. What resulted is the demo you see here. Nvidia was able to paint a blobby 3D world with a sharp, realistic veneer.
Yes, Nvidia’s footage does have that same murky look that generative AI drawings generally have–the sort of fuzzy photorealism that designers achieved in Mortal Kombat by photographing real actors and downsampling them into 16-bit graphics. No one would look at either project closely and be fooled, but it feels pretty real, anyway.
