Groq® and Carahsoft to provide rapid AI inference speed to the public sector

Groq®, the leader in real-time AI inference, and Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®, announced a partnership to deliver fast and cost- and energy-efficient AI inference speed to Government agencies and Federal systems integrators throughout the United States. Under the distribution agreement, Carahsoft will serve as Public Sector distributor for Groq, making its innovative AI inference solutions available to the Public Sector through Carahsoft’s reseller partners and NASA Solutions for Enterprise-Wide Procurement (SEWP) V contracts. 

Accessed through GroqCloud™ via an API or a private cloud, the Groq LPU™ Inference Engine is a cutting-edge AI inference technology. It is revolutionizing Government use cases, including accelerated analyst velocity, continuous monitoring with visualized graph intelligence and GenAI-accelerated contract search, discussion, and bid proposal drafting.

“We’re thrilled to partner with Carahsoft to expedite the adoption of AI by agencies at all levels of Government across the United States,” said Aileen Black, Groq Public Sector President. “The advent of generative AI has catapulted society out of the information age and into a new AI-powered era. At Groq, we are determined to empower the Public Sector to take full advantage of AI by providing the real-time inference required to bring generative AI applications to life efficiently.”

“We are excited to bring the fast, energy-efficient and cost-effective real-time AI inference that Groq provides to the Public Sector, giving agencies access to a variety of innovative, AI-based solutions,” said Craig P. Abod, Carahsoft President. “Carahsoft looks forward to collaborating with Groq and our reseller partners to supply all levels of Government nationwide with the latest AI solutions. This partnership enables agencies to become early adopters of AI and model how to leverage AI for uses as common as day-to-day operations and as significant as critical missions that ensure national security.” 

All Groq systems are designed, fabricated, and assembled in North America, eliminating supply chain constraints and adversarial risks. The LPU was designed from the ground up to be energy efficient and currently requires 1/10th of the energy at scale than the equivalent GPU systems available today. The LPU Inference Engine is the leading solution on the market that leverages an efficiently designed hardware and software architecture to satisfy the low carbon footprint requirements of today, while still delivering an unparalleled speed of compute.

Partner Resources

Popular Right Now

Edgecore Insight Podcast

Ep-1: Navigating the Waters of Sustainability

Others have also read ...