In a significant development for the AI infrastructure sector, Nvidia has announced a major partnership with Palantir Technologies to create a sovereign AI operating system reference architecture. Announced on Thursday, this joint system is designed to allow governments and enterprises to run artificial intelligence workloads on their own domestic infrastructure, maintaining full control over data, models, and applications. The architecture leverages Nvidia's high-performance Blackwell Ultra hardware systems, which feature eight GPUs per unit and Spectrum-X Ethernet networking, and is paired with Palantir's full software suite including AIP, Foundry, Apollo, Rubix, and AIP Hub.
Palantir Chief Architect Akshay Krishnaswamy emphasized the system's design for "the most complex and sensitive environments," while Nvidia's VP of Enterprise AI Platforms, Justin Boitano, highlighted its role in enabling industries and nations to process data with speed and efficiency. The reference architecture is now available for review on Palantir's website.
Separately, a report from the Wall Street Journal reveals that ByteDance, the parent company of TikTok, is constructing a massive AI computing cluster in Malaysia using Nvidia's latest Blackwell chips. The project, undertaken with Southeast Asian cloud firm Aolani Cloud, involves at least 500 Nvidia Blackwell servers containing roughly 36,000 B200 AI chips, with an estimated total cost exceeding $2.5 billion. This move is seen as a strategic effort to circumvent U.S. export restrictions on advanced AI chips sold directly to Chinese firms.
Aolani Cloud is sourcing the servers from Aivres, an assembler of Nvidia-based processors, and states it follows all export control rules. ByteDance intends to use the Malaysian cluster for AI research and development outside of China and to support global demand for its AI products, such as the Seedance video generation model. This substantial investment underscores the persistent, high-stakes global demand for Nvidia's AI hardware, even amidst geopolitical trade barriers.
