Nvidia launched Cosmos 3 at GTC Taipei, an open physical AI foundation model for robots and autonomous vehicles. The system utilizes a mixture-of-transformers architecture to integrate vision, reasoning, and action prediction. This multimodal model processes text, images, video, and sound to generate physically accurate simulations.
The technology aims to reduce AI training cycles from months to just days. Nvidia released Cosmos 3 as an open platform to establish a foundation for the broader physical AI industry. The company is also distributing training scripts and datasets to encourage wider adoption.
Nvidia established the Cosmos Coalition alongside partners including Agile Robots and Runway. This collaboration will focus on the joint development of next-generation world models.