Yotta Data Services has announced a collaboration with NVIDIA to deliver cutting-edge GPU computing infrastructure and platforms for its Shakti Cloud platform. The collaboration will advance the development of AI solutions in India by bringing state-of-the-art AI capabilities within reach of numerous organisations, businesses, AI researchers, and a multitude of startups across the country.
With this offering, Yotta customers will be able to train large language models (LLMs) and other AI workloads serving the growing needs of Indian, Asian, and broader global markets.
Yotta has already placed a large order for NVIDIA H100 Tensor Core GPUs, a powerful GPU for AI and HPC workloads, and plans to go operational with 4096 GPUs by January 2024 and 16,384 GPUs by June 2024. With complete support from NVIDIA and a shared vision to develop India’s sovereign AI landscape, Yotta also plans to massively scale up its GPU stable to 32,768 by the end of 2025. This will directly address the huge demand for high-performance GPUs by research labs, enterprises, and startups for HPC and AI workloads.
With this collaboration, Yotta becomes the first NVIDIA Partner Network cloud partner (NCP) in India and joins the global NCP list as an Elite Partner.
Further, Yotta is deploying an NVIDIA-powered reference architecture with NVIDIA InfiniBand networking that will allow GPU clusters to deliver great performance at scale for large AI training and inferencing workloads, as well as HPC workloads.
Yotta’s Shakti Cloud AI platform will include various PaaS services from day one, including foundational AI models and applications that will help Indian enterprises create powerful AI tools and products.
Yotta will deploy the first cluster of 16,384 GPUs at NM1, Yotta’s highly acclaimed and Asia’s largest Uptime Tier-IV data centre, located in Navi Mumbai. Next, Yotta will deploy a similar-sized cluster at D1, Yotta’s newest and largest hyperscale data centre in Greater Noida, near Delhi.
This collaboration comes at a moment of phenomenal growth in India’s AI adoption efforts, with the country becoming a hub for research, online gaming, and digital content creation. AI adoption in India is expected to grow at a compound annual growth rate of more than 20% to reach US$14 billion by 2030. The Indian gaming industry is similarly expected to furiously grow to reach US$5 billion by 2025. All these industries rely heavily on GPU computing to meet expected customer demands.
Commenting on this development, Jay Puri, executive vice president of Worldwide Field Operations at NVIDIA, said, “India has emerged as a vibrant hub for technological innovation and digital transformation. Our collaboration with Yotta will help open up access to the specialised infrastructure that makes AI possible at scale and bring GPU capabilities to customers in India, accelerating advancements in AI and fostering innovation across industries.”