Autodesk has announced a $200 million investment in the frontier AI research company World Labs, as part of that company’s larger $1 billion funding round. Other investors, in World Labs as part of the same round, include AMD, Nvidia, Fidelity, and VC firm Andreessen Horowitz.
This is the largest startup investment in Autodesk’s history and echoes a conviction that AI should augment, not replace, human ingenuity while going beyond text and language and entering the physical world.
World Labs
World Labs is a frontier AI research company co-founded by Dr. Fei-Fei Li (CEO), Justin Johnson, Christopher Lassner, and Ben Mildenhall. The company is focused on spatial intelligence and is a world leader in this domain of artificial intelligence. World Labs is building AI models that can perceive, generate, reason, and interact with the 3D world.
A screen capture from Autodesk’s video on its investment in World Labs. We like this image because it conjures the feeling of the unknown and the weightlessness of the promises of AI. How much weight will AI tech take off the shoulders of design professionals? But at the same time, working in the future of AI is like working in outer space. It’s that radical. (IMAGE: Autodesk)
World Labs’ first product is called Marble, and it generates spatially consistent, high-fidelity 3D environments that you can inhabit and move through. Once created, you can also edit them as you are inhabiting them. You can also model inside them with familiar modeling tools, but in general, the feeling is a combination of traditional 3D manipulation and text-prompt-based editing and generation.
Investment from Autodesk
World Labs’ Marble platform looks especially strong in many, if not most, of the fields that Autodesk software operates, from architecture and interiors to robotics and manufacturing to gaming and entertainment. The strategic investment at a glance looks like this:
- USD 200 million in World Labs (an AI startup working at the frontier of AI)
- Autodesk’s largest startup investment to date
- A research-level / technical collaboration focused on physical-world AI and multimodal world models.
Dr. Fei-Fei Li remarks about the backing and investment by Autodesk and their strategic collaboration, saying:
“Physical AI must understand worlds, not just words. With Autodesk’s deep expertise in geometry, simulation, and real-world design, we have a uniquely complementary opportunity to ground AI in how the world is actually designed and built, for designers, builders, and creators.”
Marble’s API technology enables third-party tool providers to leverage the World Labs AI technologies in their host applications. One such application is web-based Fenestra. (see image below).
World Labs spatial intelligence AI technologies have attracted the investment interest of Autodesk, AMD, Nvidia, Fidelity, and more.
Both Marble and Fenestra are fully web-based, and both support Gaussian Splats rendering through SparkJS. When a user submits an image or text prompt using Fenestra, the web-based software connects to the Marble API and constructs a navigable 3D environment, which can be further edited and explored. Both spatial and 2D elements can coexist in supplying the AI engine the inference data it needs.
Another tool using the Marble API is Interior AI. This new tool has garnered quite a bit of publicity from top-shelf press, including the New York Times and Fast Company. We don’t like its homepage tag line, “Fire your interior designer,” and the messaging it sends, and especially think that Autodesk’s position with AI technologies is that they will complement the design professional, not eliminate them.
What Autodesk is saying is that the company wants to forge a different path for AI, as opposed to the hyperscale AI investments and centralized platforms crunching on ever larger LLMs. They write, “Our investment in World Labs represents a different path, focused on solving the hardest problems in designing, building, and operating the physical world, guided by human needs and domain expertise rather than scale alone.”
To read the blog post about the investment, go here.
Architosh Analysis and Commentary
With a USD 1 billion funding round from heavy hitters like Nvidia and Fidelity, Autodesk’s largest-ever investment in a startup appears to be a strong strategic play. We wonder how the Marble API may interact with the new AI technologies we saw at last Fall’s Autodesk University. Those neural CAD engines were aimed at a different kind of utilization of AI technologies, but we can certainly see how multimodal AI workflows and technologies can be combined.
World Labs says they are focusing next on fully interconnected design canvases. Fenestra is working on what they are calling an Infinite Canvas. CAD and BIM systems today already have infinite internal 3D and paper-space 2D worlds (ie, “canvases”). What we are seeing in the AEC/O market is vast, rapid advancements in the “pixel”-based technology stream of our industry. This has been the case since Midjourney and GANs. AEC pros, however, must get this pixel image-oriented or vide-oriented pixel laden content into precise and accurate parametric 2/3D vectorial data. That challenge has begun, but it’s a vital bridge piece that will greatly help the acceleration of these kinds of AI visual tools in the AEC markets (not that these tools aren’t already on fire in the market, because they are!)
